PolarGrad (Polar Gradient methods; Lau et al., 2025) is a class of matrix-gradient optimizers based on the concept of gradient-anisotropy preconditioning in optimization. It has close relation to Muon ...
I'm working on a personal project called KaoCards, a flashcard app for remembering people's names and faces. When I designed the product I thought it'd be cool to have an animated gradient as the ...