Mathematics is a subject for the young

[This is a guest post by Tristan Buckmaster. This blog post was initially written in a different file format and converted using AI. — T.]

This blog post expands on a theme mentioned at the end of my recent talk at the Institute for Advanced Study on October 19.

I would like to thank Matei Coiculescu, Jaume de Dios Pont, Nestor Guillen, Bryna Kra, Terence Tao and Rachel Ward for their valuable comments and suggestions.

It is often said that mathematics is a young person’s game, and that mathematicians do their best work early in their careers. I believe this is about to become true in a completely different sense. Mathematics is changing faster than at any point in its history. Today’s graduate students and postdocs will shape its future. Our responsibility is to protect their ideas and recognize their contributions.

In my statement on September 7th, the night Levent Alpöge and I released our Euler result and the day before OpenAI announced its Navier–Stokes result, I wrote that we had reached a Deep Blue–Kasparov moment. When Deep Blue beat Kasparov in 1997, the headline was that a machine had surpassed one of the greatest chess players of all time. Beyond just marking the moment a machine eclipsed human intellect, I chose this analogy because of the nature of the machine itself. Deep Blue was a purpose-built IBM supercomputer, entirely inaccessible to the general public. Today a program on a mobile phone plays far stronger chess than Deep Blue ever did.

This is where I think mathematics is now. OpenAI’s proof reportedly required the coordination of 10,000 agents over 88 hours, at an estimated cost in the millions to solve a problem with a $1 million bounty. At present, computation on this scale is entirely out of reach for the wider mathematical community. However, given the exponential growth in capabilities paired with decreasing costs, such a comparable computation may soon be more broadly accessible.

The question is no longer whether machines can do research mathematics, but how the subject will change as a result.

Chess did not die with the advent of modern chess engines. Engines democratized high-level preparation, resulting in the most globally diverse generation of top players ever. When I told a reporter that “the game is up,” I meant to describe the end of the academic rat race, the race to be the first to resolve a famous open problem is over. Mathematics as a subject is not.

Mathematics differs from chess in one important way, though: it is not performative. Chess survives partly because people love watching humans play. I am not going to convince anyone to watch two Fields medallists duke it out on a livestream proving a theorem. What gives it lasting relevance is something else: human understanding.

Suppose that tomorrow a machine certifies a proof of the Riemann hypothesis — whether with pages of AI slop or via a Lean file. No one doubts that the Riemann hypothesis is true. A certification would convert thousands of conditional theorems into unconditional ones. Mathematicians would still be left with the question: why is it true? De Toffoli and Duede captured this perfectly with their reference to Deep Thought, the computer in The Hitchhiker’s Guide to the Galaxy that analyzes the meaning of life for 7.5 million years and returns the answer “42.”

Mathematics has never been a list of true statements. Certifying a result settles the question, not the search for understanding.

Bridging mathematics and physics: One area I see as an exciting prospect for applying modern AI systems is the intersection of mathematics and physics. Indeed, I do not believe it is a surprise that some of the most exciting results to come out of AI so far have been in mathematical physics. Historically, mathematics and physics were inextricably linked, each serving as inspiration for the other: Newton developed calculus to formulate classical mechanics, Fourier analysis grew out of the study of thermal diffusion, Riemannian geometry supplied the mathematical underpinning of general relativity, and the needs of quantum mechanics shaped functional analysis. In the past decades, however, mathematics and physics have diverged. Physics is driven by heuristic arguments that are not true in the strictest sense, but are morally true and allow one to arrive at the correct answer. Quantum field theory is the standard example, where renormalization and the path integral make remarkably accurate predictions while still lacking a rigorous foundation. Closing the gaps in physical derivations is immensely challenging, and this is a key reason for the divergence of the fields. Rigorous derivation is not just an exercise in pedantry. It points to gaps in the physical theory, identifies the precise regimes and time scales on which an effective description is valid, and provides clues towards a more complete theory.

In years preceding the advent of AI in mathematics, a beautiful example of success in this pursuit, is Deng and Hani’s derivation of the wave kinetic equation as a large box limit of the nonlinear Schrödinger equation. Later, with Ma, they gave an analogous derivation of the Boltzmann equation from hard-sphere dynamics for as long as the Boltzmann solution exists, resolving Hilbert’s sixth problem for rarefied gases. The combinatorial analysis behind these results is a tour de force, and it took years of work. LLMs could potentially allow us to carry out such a program for other effective theories, where doing it by hand would frankly be out of reach. Ultimately, one could hope that LLMs will allow us to extend this standard of rigorous proof to all branches of the physical sciences.

Protecting our ideas: Currently, there are some fundamental structural problems in terms of how AI companies interact with the mathematical community.

AI companies, who strip mine our data, including unpublished work, private notes and research grant applications, have an egregious conflict of interest in competing against their own customers with unlimited resources and internal models unavailable to the public — this is not confined to mathematics but applies more broadly. By OpenAI’s own account, its push on the Millennium problems was spurred by rumors that a rival had solved two of them — demonstrating that caution, due diligence, and basic ethics can be cast aside simply to avoid being one-upped by a rival.

On October 6th, OpenAI released hundreds of manuscripts with proofs that were mostly unreadable and in some cases false. In the release, they misleadingly claimed that the work took on average three hours of computation on a single agent: they later admitted that they did not count numerous failed attempts at the problems as well as previous work done by other agents — rendering the three hours claim essentially meaningless. Again, OpenAI did essentially no due diligence, failing to investigate whether once again they may be building on the private, unreleased work of their customers, some of whom were graduate students and postdocs who were literally days away from releasing their own work.

In August, OpenAI claimed that such a dump would be `distasteful’, that their `main focus is shipping great models so everyone can use them to make discoveries of their own’. After Navier–Stokes, OpenAI had teased us with supposed solutions to additional Millennium problems, yet they achieved none. A natural question is to ask why OpenAI would go through with such a PR stunt that risks alienating their customers. These companies are spending tens of billions of dollars a year more than they earn, which helps to explain their thirst for PR stunts and their willingness to take such seemingly inexplicable risks.

Mathematicians now type half-formed ideas into commercial models every day. These sessions are invaluable to an AI company: they provide a road map of our thought process, and reveal which research directions are promising. Until recently, AI-assisted proofs of important mathematical results were considered a pipe dream, and many of us were simply not concerned with data privacy since we never imagined today’s capabilities arriving so quickly.

It is imperative to protect our ideas and not let AI companies become the ultimate gatekeepers of knowledge. In this vein, I would like to see:

  • Collective enterprise agreements with AI companies should become ubiquitous. Many universities already have institutional agreements with AI providers, and these offer far better protections than consumer agreements. Even so, such agreements could be further strengthened by including zero data retention clauses and auditing provisions to ensure that the conditions of the agreements are respected. Many mathematicians, myself included, do their research on consumer subscriptions that those agreements do not cover. We need to make sure all academics work under the protection of such agreements.
  • We need stricter regulatory guardrails on user data. More generally, we need stricter regulations governing how AI companies collect data. Training on user data must be explicitly opt-in rather than opt-out. Finally, deceptive practices, such as absorbing an entire session’s worth of data as a result of a user providing feedback on a single response, must be explicitly banned.
  • We should further invest in open-weight infrastructure, assisting in the development of open-weight models. We cannot assume the interests of Academia and the AI companies are aligned. Academic institutions that control where their models are run can circumvent the fear of having their ideas stolen by trillion dollar corporations. Chess was democratized by engines anyone could run at home. Shared, open infrastructure for mathematics, funded in an independent way, is a lofty goal worth pursuing.

Less reliance on user data benefits both sides: leading to more trust from the academics and the encouragement of new innovative ways to train models.

Recognizing contributions: As Tao put it at the ICM this summer, we are moving from an era of proof scarcity to an era of proof abundance. Our credit system was built for the era of scarcity. Being first to a famous result was a reasonable proxy for depth of understanding, because nobody could get there without understanding a great deal along the way. That proxy no longer holds and so we will need new ways of assigning credit that are not simply correlated with access to resources.

Some concrete suggestions:

  • Reward well written exposition of important results in mathematics.
  • AI disclosures are a mixed bag and there is currently a perverse incentive not to disclose the use of AI. Disclosing AI assistance should not diminish a result and detailed disclosures should become standard.
  • Development of shared tools and resources, as well as contributions to large collaborative projects should earn recognition, mimicking practices in other sciences.
  • Mathematicians should be evaluated on the ideas and methods they developed, not just on whether or not they were first to prove a result.

More generally, we will need to move away from bean counting publications in top journals. Whatever replaces it must still offer transparent ways of evaluating work, rather than relying on reputation and personal connections, which tends to produce closed networks and patronage.

The future of mathematics: Chess did not end in 1997. Mathematics will not end in 2026. I am however convinced that within the next few years it will be unrecognizable. That future will not be shaped by me or my peers. It will be shaped by the next generation.

I am already amazed by what our students and postdocs at NYU are doing with these tools. I suspect that in their hands the line between pure and applied mathematics will blur further, perhaps disappear, and that we will see a richer connection between mathematical proofs and the physical sciences.

For the next generation of mathematicians to flourish, we need protections and control over user data, restraint from AI companies, a lower barrier to entry to the use of frontier-level models, and a new credit system that rewards understanding rather than access. Mathematics has long been said to belong to the young. They will decide what it becomes.

AI Disclaimer: I used LLMs to help edit this post, including suggesting wording for some passages.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论