Definition
In machine learning, stability refers to the robustness of a model’s performance and parameters when subjected to small perturbations in the training data. A stable algorithm will yield similar models and predictions even if the dataset changes slightly, such as through resampling or adding noise. High stability is crucial for reliable deployment, as unstable models may overfit to specific quirks in the training set, leading to poor generalization on unseen data. It is often analyzed alongside bias and variance trade-offs.
Summary
The property of a machine learning model to produce consistent predictions when trained on slightly different datasets.
Key Concepts
- Robustness
- Generalization
- Variance
- Resampling
Use Cases
- Evaluating model reliability
- Selecting algorithms for critical applications
- Cross-validation strategy design