I study how data distributions, optimizer geometry, and architecture shape foundation-model training, optimizer performance, and learned representations.
Fengzhuo Zhang
Postdoctoral Fellow
Center for Algorithms, Data, and Market Design at Yale
Yale University · New Haven, Connecticut
Email: fengzhuo.zhang [at] yale.edu
I develop statistical and optimization theory for foundation models, with an emphasis on how modern learning systems train, reason, adapt, and serve users.
About Me
I am a Postdoctoral Fellow at the Center for Algorithms, Data, and Market Design at Yale University, where I am fortunate to be mentored by Professors Zhuoran Yang and Dirk Bergemann. I received my Ph.D. in Electrical and Computer Engineering from the National University of Singapore in 2025 under the guidance of Professors Vincent Y. F. Tan and Lin Zhao. Prior to that, I received my B.Eng. in Electronic Engineering from Tsinghua University in 2020, where I had the privilege of working with Professor Yuan Shen.
My research interests lie in the statistical and optimization theory of foundation models. My recent work studies the optimization and training dynamics of language models, statistical models of In-Context Learning and Chain-of-Thought reasoning, and economic models of LLM services grounded in these optimization and statistical characterizations.
Research Highlights
I develop statistical foundations of how language and multi-modal models use context and reasoning traces to make predictions, connecting in-context learning and chain-of-thought prompting to Bayesian inference.
I analyze equilibria among heterogeneous users to understand how model performance and computational costs shape AI personalization, congestion, and platform design.
News
- Jul. 2026Gave a talk at the Shanghai Innovation Institute on “Why Muon Outperforms Adam: A Curvature Perspective.”
- 2026“Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods” is to appear in JMLR.
- 2026“Supervised Fine-Tuning vs. In-Context Learning” appeared at ACM EC.
- Feb. 2026Gave a talk at Nexus for IntelligeCE on the slash pattern in attention and RoPE.
- Jan. 2026Joined Yale University as a Postdoctoral Fellow at CADMY.
- Jun. 2025Completed a Ph.D. in Electrical and Computer Engineering at NUS.
Appointments and Education
Postdoctoral Fellow, Center for Algorithms, Data, and Market Design at Yale
Mentors: Dirk Bergemann and Zhuoran Yang
Ph.D. in Electrical and Computer Engineering
Advisors: Vincent Y. F. Tan and Lin Zhao
Bachelor of Electronic Engineering