Thinking Machines Lab, founded by former OpenAI CTO Mira Murati, released Inkling 2 Small, a 594-billion-parameter MoE model that can automate parts of AI training, as it seeks about 5 billion dollars at a 40 billion dollar valuation.
Key points
- 594 billion total parameters, 17 billion active per token
- 1 million token context window
- 86.3 percent on SWE-Bench Pro v2 Hard; 72.1 percent on DeepSWE v1.1
- Raising about 5 billion dollars at a 40 billion dollar valuation
Notably, its technical report says later-stage pretraining data was substantially sampled from trajectories of Moonshot's Kimi K3.
Read the full story on threerouter: https://www.threerouter.com/blog/356
