Batch Size
Definition
Batch size is a critical hyperparameter that determines how many samples are processed …
Hyperparameters
Bayesian optimization
Definition
Bayesian optimization uses a probabilistic surrogate model, typically a Gaussian Process, …
Learning Rate
Definition
The learning rate determines how much the model’s weights are updated relative to …
Rate
Definition
In AI, ‘rate’ most frequently refers to the learning rate, a hyperparameter …