Definition
In AI, knowledge often refers to explicit information stored in databases, ontologies, or neural network weights that allows for reasoning and inference. It sits above information in the DIKW hierarchy (Data, Information, Knowledge, Wisdom). For LLMs, knowledge is implicitly encoded during pre-training, allowing the model to retrieve and synthesize facts to answer queries accurately.
Summary
Knowledge is the structured understanding, facts, skills, and insights derived from information, experience, or reasoning, enabling effective decision-making.
Key Concepts
- DIKW Hierarchy
- Reasoning
- Implicit vs Explicit
- Fact Retrieval
Use Cases
- Question answering systems
- Expert systems
- RAG (Retrieval-Augmented Generation)