2025 PNAS Out-of-distribution generalization via composition: a lens through induction heads in transformers Jiajun Song, Zhuoyan Xu, and Yiqiao Zhong Proceedings of the National Academy of Sciences, 2025 arXiv Blog Code 2024 Preprint Proposing and solving olympiad geometry with guided tree search Chi Zhang, Jiajun Song, Siyu Li, and 5 more authors arXiv preprint arXiv:2412.10673, 2024 2023 Preprint Uncovering hidden geometry in Transformers via disentangling position and context Jiajun Song, and Yiqiao Zhong arXiv preprint arXiv:2310.04861, 2023 arXiv Bib Blog Code @article{song2023uncovering, title = {Uncovering hidden geometry in Transformers via disentangling position and context}, author = {Song, Jiajun and Zhong, Yiqiao}, journal = {arXiv preprint arXiv:2310.04861}, year = {2023}, }