Repository with codes for HPO with the following methods and packages:
Scikit:
- scikit-learn: GridSearch, RandomSearch, HalvingSearch
- scikit-optimize: Bayesian optimization
- scikit-hyperband (modified): Hyperband
Microsoft NNI:
- Simulated Annealing
- Bayesian Optimization Gaussian Process (BOGP)
- Bayesian Optimization HyperBand (BOHB)
- Deep Networks for Global Optimization (DNGO)
- Metis
- HyperBand
- Tree Parzen Estimator (TPE)
- Population Based Training (PBT)
Optuna:
- Grid Search
- Random Search
- Tree Parzen Estimator (TPE), incl. TPE for NAS
DEAP:
- Genetic Algorithm (GA)
- Particle Swarm Optimization (PSO)