Thinking Machines details 4-bit training for Inkling 2 Small

On November 13, Thinking Machines detailed how it trained Inkling 2 Small using 4-bit forward passes in expert layers and 8-bit backward passes. In its largest runs, the lab reported an 8% pretraining speedup and a 20% reinforcement learning speedup.