SITP Seminar: State of AI Reasoning for Theoretical Physics - Insights from the TPBench Project
Event Details:
Location
Speaker: Moritz Münchmeyer (UW Madison) In Person and zoom
Zoom info: https://stanford.zoom.us/j/92249714551?pwd=baDhMAb6iCoUW8UjAOB2ag4CbrqR…
The newest large-language reasoning models are for the first time powerful enough to perform mathematical reasoning in theoretical physics at graduate level. In the mathematics community, data sets such as FrontierMath are being used to drive progress and evaluate models, but theoretical physics has so far received less attention. In this talk I will present our dataset TPBench (arxiv:2502.15815, tpbench.org), which was constructed to benchmark and improve AI models specifically for theoretical physics. We find extremely rapid progress of models over the last months, but also significant challenges at research level difficulty. I will also discuss strategies to improve these models for theoretical physics and show some early results using test-time scaling techniques on our problems.
Related Topics
Explore More Events
KIPAC Seminar: Cin-zs: an entry of the DESC Photo-z Data Challenge
Jahmour Givans (University of Cincinatti)Campus, Varian 206-Campus, Varian 206KIPAC Tea Talk: Are Cluster Galaxies Too Efficient at Strong Lensing? Revisiting a Tension Between Observations and Simulations / Exploring a cosmic ray inverse-Compton origin to the SZ-to-X-ray pressure deficit in the cool core cluster ZwCl 3146
Cian Roche (MIT) / Emily Silich (Caltech)Campus, PAB 102/103-Campus, PAB 102/103