What is Model Drift
Degradation of ML model quality over time
Model Drift is the gradual degradation of ML model quality and accuracy over time due to changes in data or environment.
Types of Drift
- Data Drift — changes in input data
- Concept Drift — changes in relationship between features and target
- Prediction Drift — changes in prediction distribution
- Label Drift — changes in target variable
Causes
- Changes in user behavior
- Seasonal data fluctuations
- External economic factors
- Technical changes in data sources
- Obsolescence of training data
Detecting Drift
- Monitoring model quality metrics
- Statistical tests (KS-test, PSI)
- Tracking feature distributions
- A/B testing predictions
Mitigation Methods
- Regular model retraining
- Online learning — continuous training
- Ensemble methods with updates
- Automated MLOps pipelines