# Hardware Acceleration

Chinese Team Sets NanoGPT Speedrun Records via Architecture Redesign

Caiyun Technology leveraged dynamic attention and dense connections to push 124M-parameter training times down to 1 minute 16 seconds.