I think some attentive VCs couldve predicted this.

Paper from OAI 2020 about scaling laws: https://arxiv.org/pdf/2001.08361 The idea that you can make a system smarter by just putting in more money is very appealing. The earliest OAI coding model is here (Aug 2021): https://openai.com/blog/openai-codex/