Issues

• AdamW performing Adam without weight decay?

  HomebrewML/HeavyBall#71 · Filter by author tom-jod opened on Jul 1, 2025
  4

• MARS gamma parameter

  HomebrewML/HeavyBall#62 · Filter by author tom-jod opened on May 19, 2025
  2

• [Feature request] SCION optimizer

  HomebrewML/HeavyBall#54 · Filter by author sozforex opened on Mar 22, 2025
  2

• [Feature Request] AdaLomo optimizer

  HomebrewML/HeavyBall#35 · Filter by author akbar2habibullah opened on Jan 29, 2025
  1

• CUDA Illegal memory access when starting training

  HomebrewML/HeavyBall#18 · Filter by author marthinwurer opened on Nov 30, 2024
  14

• [Feature] Make HeavyBall compatible with FSDP2 (DTensor)

  HomebrewML/HeavyBall#15 · Filter by author casper-hansen opened on Nov 22, 2024
  4

• fix for copy_stochastic with Dtensor

  HomebrewML/HeavyBall#14 · Filter by author ethansmith2000 opened on Nov 22, 2024