🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
2026-08-26 23:15Models🔥 28.9 heat score
1sources
1days unfolding
28.9heat score
4mentions
SummaryAI generated
On August 26, 2026, the team led by Anima Anandkumar, a professor at California Institute of Technology, released an open-source weather prediction model called FourCastNet. Based on Neural Operators technology, this model utilizes physical prior knowledge such as spherical harmonics to solve modeling challenges in continuous physical systems like meteorology, fusion, and fluid heat flow. FourCastNet can perform comparably to the best existing physical simulations in terms of performance and supports accurate short-term predictions using consumer-grade GPUs. Due to the scarcity of data and high resolution requirements in these fields, the traditional Transformer architecture, which relies on large amounts of tokens, is difficult to apply directly. Therefore, this research emphasizes progress through the construction of structured models and inductive bias, rather than simply expanding in scale.
The team led by Anima Anandkumar, a professor at California Institute of Technology, developed the open-source weather prediction model called FourCastNet. This model performs on par with existing best-of-breed physical simulations and supports accurate short-term predictions using consumer-grade GPUs. Based on Neural Operators technology, FourCastNet utilizes physical prior knowledge such as spherical harmonics to solve modeling challenges in continuous physical systems like meteorology, fusion, and fluid heat flow. Due to the scarcity of data and high resolution requirements in these fields, the traditional Transformer architecture, which relies on large amounts of tokens, is difficult to apply directly. Therefore, this research emphasizes progress through the construction of structured models and inductive biases, rather than simply relying on scale expansion.