labmlai/annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

⭐ 65805 | 🍴 6617

Luolc/AdaBound

An optimizer that trains as fast as Adam and as good as SGD.

⭐ 2911 | 🍴 338

LiyuanLucasLiu/RAdam

On the Variance of the Adaptive Learning Rate and Beyond

⭐ 2548 | 🍴 332

Unity-Technologies/VolumetricLighting

Lighting effects implemented for the Adam demo: volumetric fog, area lights and tube lights

⭐ 1787 | 🍴 256