ByteDance is reportedly in the early stages of training an AI model with up to 10 trillion parameters, a size that could rival Anthropic's most advanced Mythos system. According to three sources, the model would be three times larger than Moonshot's Kimi K3, currently the largest Chinese model released.
The pre-training phase typically lasts three to six months, after which the model would be fine-tuned and potentially released. The final size has not yet been determined.
Comments