Discover the Best Open-Source Optimizers Projects Sorted by Stars

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

Nx-powered Neural Networks

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.

🎯 A comprehensive gradient-free optimization framework written in Python

A New Optimization Technique for Deep Neural Networks

A no-nonsense kernel tweak script for Linux and Android systems, backed by evidence.

RAdam implemented in Keras & TensorFlow