LLMs
-
2 Jun 2025
Thomas Ptacek archive
Even if all progress on LLMs stopped today, LLMs would remain the second most important development in a software career spanning the mid-1990s to now.All progress on LLMs could halt today, and LLMs would remain the 2nd most important thing to happen over the course of my career.
-
2 Jun 2025
Thomas Ptacek archive
LLMs can write a large fraction of the tedious code a developer will ever need to write, and most code on most projects is tedious.LLMs can write a large fraction of all the tedious code you’ll ever need to write. And most code on most projects is tedious. LLMs drastically reduce the number of things you’ll ever need to Google.
- 5 months earlier
-
20 Dec 2024
François Chollet archive
The memorize-fetch-apply paradigm behind LLMs can reach arbitrary skill given training data, but it cannot adapt to novelty or acquire new skills on the fly.This "memorize, fetch, apply" paradigm can achieve arbitrary levels of skills at arbitrary tasks given appropriate training data, but it cannot adapt to novelty or pick up new skills on the fly (which is to say that there is no fluid intelligence at play here.)
↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org
-
20 Dec 2024
François Chollet archive turned
The memorize-fetch-apply paradigm behind LLMs can reach arbitrary skill given training data, but it cannot adapt to novelty or acquire new skills on the fly.OpenAI's new o3 model represents a significant leap forward in AI's ability to adapt to novel tasks. This is not merely incremental improvement, but a genuine breakthrough, marking a qualitative shift in AI capabilities compared to the prior limitations of LLMs.
OpenAI's new o3 model represents a significant leap forward in AI's ability to adapt to novel tasks. This is not merely incremental improvement, but a genuine breakthrough, marking a qualitative shift in AI capabilities compared to the prior limitations of LLMs.
↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org