On October 19, AWS released the TorchNeuron native backend in public beta with Neuron 2.33.0. It runs PyTorch models on Trainium2 and Trainium3 through the neuron device, supports torch.compile, and has source code available on GitHub.
AWS releases TorchNeuron public beta for PyTorch on Trainium
Sources
1
vidgetc
Tech, gaming & AI news — always at hand
Google Play · Soon
App Store · Soon
Comments