What is Few-Shot Learning
Training model on few examples
Few-Shot Learning is a machine learning approach that enables models to learn from very few examples (typically 1 to 10) for each class.
Main Approaches
- Meta-Learning — learning to learn
- Metric Learning — learning similarity between examples
- Data Augmentation — expanding data from small datasets
- Transfer Learning — using pre-trained models
Types by Number of Examples
- Zero-Shot — no examples, only task description
- One-Shot — one example per class
- Few-Shot — several examples (2-10) per class
Applications
- Face recognition from single photo
- Rare disease classification
- AI assistant personalization
- Quick chatbot adaptation
Benefits
- Reduced data requirements
- Fast adaptation to new tasks
- Decreased data labeling costs
Few-Shot Learning is critical for GPT and other large language models (LLMs).