I built a PyTorch optimizer for large GPU workloads — looking for feedback[P]

Hey, I've been working on a PyTorch optimizer called ApexW and figured I'd share it here to get some feedback from people who know more about this stuff than I do. The main goal is to reduce optimizer-state memory usage…