Definition
In artificial intelligence, a foundation model refers to a large-scale machine learning model trained on broad data at scale, such as images, text, or audio. These models are designed to be adaptable and can be fine-tuned for specific applications like natural language processing, computer vision, or robotics. Their general-purpose nature allows them to perform well across diverse domains without requiring task-specific training from scratch, forming the foundational layer of modern generative AI systems.
Summary
A pre-trained model trained on vast datasets to serve as a base for various downstream tasks.
Key Concepts
- Pre-training
- Fine-tuning
- Large-scale data
- Generalization
Use Cases
- Natural Language Processing
- Image Generation
- Code Completion