publications

Papers and preprints.

2026

  1. Homogenized Transformers
    arXiv preprint arXiv:2604.01978, 2026

2025

  1. Learning Single-Index Models via Harmonic Decomposition
    Nirmit Joshi, Hugo Koubbi, Theodor Misiakiewicz, and 1 more author
    In Advances in Neural Information Processing Systems, 2025

2024

  1. Dynamic Metastability in the Self-Attention Model
    Borjan Geshkovski, Hugo Koubbi, Yury Polyanskiy, and 1 more author
    CoRR, 2024
  2. The Impact of LoRA on the Emergence of Clusters in Transformers
    Hugo Koubbi, Matthieu Boussard, and Louis Hernandez
    CoRR, 2024