Publications

Konrad Staniszewski

2025

• Konrad Staniszewski , Szymon Tworkowski, Sebastian Jaszczur , Yu Zhao, Henryk Michalewski , Łukasz Kuciński , Piotr Miłoś , Structured Packing in LLM Training Improves Long Context Utilization, The 39th Annual AAAI Conference on Artificial Intelligence, Philadelphia, the United States of America, 24 February 2025 - 3 March 2025, 39 (24) 2025, p. 25201-25209. See in PBN

2024

• Yu Zhao, Yuanbin Qu, Konrad Staniszewski , Szymon Tworkowski, Wei Liu, Piotr Miłoś , Yuxiang Wu, Pasquale Minervini, Analysing The Impact of Sequence Composition on Language Model Pre-Training, 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand, 11 August 2024 - 16 August 2024, 1 2024, p. 7897-7912. See in PBN

2023

• Szymon Tworkowski, Konrad Staniszewski , Mikołaj Pacek, Yuhuai Wu, Henryk Michalewski , Piotr Miłoś , Focused Transformer: Contrastive Training for Context Scaling, 37th Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, the United States of America, 10 December 2023 - 16 December 2023. See in PBN
• Konrad Staniszewski , Parity Games of Bounded Tree-Depth, 31st EACSL Annual Conference on Computer Science Logic, Warszawa, Poland, 12 February 2023 - 15 February 2023, 252 (33) 2023, p. 1-20. See in PBN