publications

2026

1. arXiv

   Approximating Softmax in Pretrained LLMs: Model Sensitivity and Kernel Acceleration

   Shangzhen Zhu, Muyan Hu, and Tomasz Kozlowski

   Sep 2026

   arXiv Bib Video Blog

   @misc{zhu2026approximating,
     title = {Approximating Softmax in Pretrained {LLMs}: Model Sensitivity and Kernel Acceleration},
     author = {Zhu, Shangzhen and Hu, Muyan and Kozlowski, Tomasz},
     year = {2026},
     month = sep,
     archiveprefix = {arXiv},
   }

2. arXiv

   Pretraining Transformers with Quantized Softmax in Attention

   Shangzhen Zhu, Muyan Hu, and Tomasz Kozlowski

   Sep 2026

   arXiv Bib Video Blog

   @misc{zhu2026pretraining,
     title = {Pretraining Transformers with Quantized Softmax in Attention},
     author = {Zhu, Shangzhen and Hu, Muyan and Kozlowski, Tomasz},
     year = {2026},
     month = sep,
     archiveprefix = {arXiv},
   }