The $5.5 million training cost for OpenAI's GPT-3.5 only refers to the final training run and does not include the costs associated with R1's training or the extensive R&D and hardware expenses, which are likely in the hundreds of millions.

OpenAI's release of GPT-2 in November 2019 marked a significant milestone with 1.5 billion parameters, followed by GPT-3, which was over 100 times larger and more capable than its predecessor.

OpenAI's newest model, o1, significantly improves performance in mathematics and coding, achieving high scores on challenging benchmarks.

Despite criticisms, OpenAI and DeepMind have been transparent about their methodologies, making it easier for others to replicate models like GPT-3 if they can secure enough compute and talent.

DeepSeek's R1 is an open-source reasoning model that claims to achieve performance comparable to OpenAI's models at a significantly lower cost, causing a stir in the AI community.

OpenAI revealed GPT-4.5 as a model capable of reasoning and systematically thinking through complex problems, clearly surpassing GPT-4 in mathematics, coding, and logical tasks.

GPT-3 made headlines by smashing benchmarks previously considered out of reach for AI, excelling in software engineering, math, and PhD-level science questions.

OpenAI's latest model, o1, is gaining traction among developers, with 15% of the summer batch already using it despite its recent release.

DeepSeek's R1 model builds on V3 by applying various algorithmic improvements to enhance its reasoning capabilities, achieving performance similar to OpenAI's models on complex reasoning benchmarks.