Book review: Kevin Roose – The AGI Chronicles: The Inside Story of the Race to Create an Artificial Superintelligence

This book has been published quite recently and basically re-tells the last 10 years of developments with a focus on LLMs and the few dozen people, most located in the area of San Francisco, who are the main players in this “game”. The companies that are covered are mostly OpenAI, Google and Anthropic.
It does not really cover the 50 or 60 years of AI research before that.
The author, Kevin Roose is a relatively well known SF based tech journalist who seems to have pretty good access to many of the main players. He also hosts a very interesting podcast called “Machine Gods” together with Casey Newton
I found it quite an interesting read. A few things that stood out to me were the following:
- If you want to pinpoint one guy who has maybe contributed the most to develop ChatGPT then Ilya Sutskever would be my choice. He actually had the idea to combine the Transformer logic developed by Google with a neural network trained on speech. A rather well known artifact is that actually Google invented this but didn’t really understand its significance. The flip side is that Sutskever was not very successful in kicking out Sam Altman during the OpenAI palace coup.
- What I find the most perplexing aspect of this all is, that even the super experts like Sutskever don’t really understand how these models suddenly develop capabilities that they were not explicitly trained for. Andrej Karpathy once described it as “summoning a ghost from the machine”. I guess that also might be one of the reasons why some of the people involved developed quasi religious feelings about these models.
- However, what the experts understood early on is that more compute makes these models more capable. Later on, they also discovered that more data for training has the same effect. So the “more compute” mantra has been there since quite some time.
- Another really fascinating aspect of the book is, how small the group of people actually is who is behind this now world changing technology. Essentially, it is a few hundred people who mostly know each other, maybe even hated each other and often have lived in the same house for some time as “AI researcher houses” seem to have been a big thing some years ago,
- Equally interesting is how the author describes that Google almost lost the race. As many big companies there was a lot of infighting at Google. The main issue seems to have been that Google researchers are mostly working for themselves with no real coordination. So for quite some time, they lacked the computational resources to improve the LLMs because they could not pool enough internal capacity. There was Google Brain and Deep Mind who both worked on certain aspects of AI, but didn’t fully understand the significance of Chatbots.
Google management was also cautious because they feared for their cash cow, the search business. According to the book, the return of founder Sergey Brin changed things dramatically. Although he officially only worked as a programmer, one phone call from him would suddenly make things happen. But I think Google was really close to becoming another Microsoft (which almost missed the internet and fully missed mobile)…. - The book also shines a light on the two main “faiths” in the AI race: Amodei & Co who are more on the Doomer side and campaigning for “pacing the frontier” and the “Accelerationists” who claim that this technology needs to be pushed forward as quickly as possible to create “heaven on earth” and 10% GDP growth p.a.. The accelerationist were headed (among others) by none other than Jensen Huang, the just fired CEO of Nvidia. With the results of the midterms and Jensen’s firing, one could expect that now the more cautious people prevail at least for some time.
- The book doesn’t try to predict the future, which I find very good. It is clearly a chronicle and doesn’t try to predict something that cannot be predicted.
Overall, I think the book allows a unique view into the ecosystem of AI experts, their beliefs and also their sometimes significant personal shortcomings.
Tf you want to read this book, now is probably the time , as already a lot of stuff is happening and history is moving fast these days.
The chapter of that history will be written most likely by the end of this week when Anthropic goes public.
What a time to be alive.






































