Definition
Released by Meta AI in July 2023, Llama 2 represents a significant evolution in open-weight large language models. It offers pre-trained and fine-tuned variants ranging from 7 billion to 70 billion parameters. Key improvements include a doubled context window of 4096 tokens, optimized transformer architecture for efficiency, and enhanced safety measures through extensive human feedback. It marked a pivotal moment by making high-performance models accessible to researchers and developers globally, fostering innovation in the open-source AI community.
Summary
Llama 2 is a family of large language models released by Meta in July 2023, featuring optimized architectures and larger context windows compared to its predecessor.
Key Concepts
- Open-weight models
- Transformer architecture
- Context window
- Fine-tuning
Use Cases
- Research prototyping
- Custom chatbot development
- Code generation tasks