pull down to refresh

We continue to see rapid progress with AI development. Here are three observations about the economics of AI:
  1. The intelligence of an AI model roughly equals the log of the resources used to train and run it. These resources are chiefly training compute, data, and inference compute. It appears that you can spend arbitrary amounts of money and get continuous and predictable gains; the scaling laws that predict this are accurate over many orders of magnitude.
  2. The cost to use a given level of AI falls about 10x every 12 months, and lower prices lead to much more use. You can see this in the token cost from GPT-4 in early 2023 to GPT-4o in mid-2024, where the price per token dropped about 150x in that time period. Moore’s law changed the world at 2x every 18 months; this is unbelievably stronger.
  3. The socioeconomic value of linearly increasing intelligence is super-exponential in nature. A consequence of this is that we see no reason for exponentially increasing investment to stop in the near future.
I'm too uneducated to rule on the above, or the below, but I suspect the below to hold true:
In some ways, AI may turn out to be like the transistor economically—a big scientific discovery that scales well and that seeps into almost every corner of the economy. We don’t think much about transistors, or transistor companies, and the gains are very widely distributed. But we do expect our computers, TVs, cars, toys, and more to perform miracles.
Eh, this seems fraught and conflicts with the quote directly above:
In particular, it does seem like the balance of power between capital and labor could easily get messed up, and this may require early intervention. We are open to strange-sounding ideas like giving some “compute budget” to enable everyone on Earth to use a lot of AI, but we can also see a lot of ways where just relentlessly driving the cost of intelligence as low as possible has the desired effect.
I've been using ChatGPT much more aggressively lately as a tool to help me do various work-related things, and it accelerates my productivity enormously. Some types of things it's been able to help me out with... things that would've taken me hours to do successfully, if at all:
  • "Find me the legal basis for this action..." --> correctly found the legal basis, complete with document and section (verified)
  • "Explain this code snippet..." --> explains in a way that I could understand, helped me understand the codebase way more quickly than parsing myself...
  • "Find a quote where this person made a comment to this effect..." --> found a news article with the direct quotation. No more hallucinating quotes; this is what I needed to strengthen a presentation I was making
reply