Daniel Newman argues the narrative that Chinese and open models won't slow if frontier labs ‘pace’ themselves…
The narrative that China and Open models will not slow down even if the frontier labs were to slow makes no sense to me. All the best open models have large dependencies on Anthropic and OpenAI. The pace of all AI development is set by what the frontier does and while open models have done interesting work to deliver performance, its training costs would balloon and its ability to deliver more cost efficient versions of leading edge models would stall without access to large scale distillation. So what am I missing here? 🧐
Your basic premise is technically wrong. The open source labs especially Chinese labs aren't really dependent on Anthropic or OpenAI anymore. The models do basic math, nothing fancy, all that matter is data. They have been collecting real data now that their models are being used extensively. They have the data equation solved, they also now that good models for generating synthetic data. IMO, models will become commodity. What will matter is harness and products, that's where you can build the moat.