About Me
Hi! I'm a first year ELLIS PhD student at the MPI for Intelligent Systems advised by Prof. Bernhard Schölkopf, and supported by the Hector Fellow Academy.
I am interested in understanding the internal mechanisms of large language models (LLMs), particularly their "world models"—the structured representations they develop to interpret and make sense of data. My work falls within the field of Mechanistic Interpretability that tries to dissect these systems to uncover their underlying processes, behaviors, and limitations. Beyond LLMs, I am intrigued by the broader concept of "world models"—representations of the world that enable predictive reasoning. These models will be fundamental to building systems that can anticipate and adapt to complex environments!
Before starting my PhD, I did a BSc in mathematics at EPFL and spent one year at ENS in Paris (Ulm). I then transitioned to pursue a MSc in Neural Systems and Computation at ETH Zürich. During my master, I worked by Prof. Maneesh Sahani at the Gatbsy Unit in London on non-generative representation learning.

Florent Draye
PhD Student in Machine Learning
MPI-IS, Germany
Education
-
PhD, Machine Learning
Max Planck Institute | 2024–Present
-
MSc, Neural Systems and Computation
ETH Zürich | 2022–2024
GPA: 5.9/6
-
Exchange Program, Mathematics
Ecole Normale Supérieure (Ulm) | 2021–2022
GPA: 18.3/20
-
BSc, Mathematics
EPFL | 2019–2022
GPA: 5.88/6
Prizes
-
Best bachelor average grade among all sections (1200+ students)
EPFL, 2019–2022
Experiences
-
Machine Learning Research Intern
Gatsby Unit UCL, 09/2023-02/2023
-
Data Science Intern
Mindmaze, Summer 2023
News
Just started my PhD with Prof. Bernhard Schölkopf
January 2025
Research
A Review on the Universal Approximation Theorems of Artificial Neural Networks
U Faure†, F Draye†, Bachelor Thesis 2022
† Equal contribution
PDF