XLM-RoBERTa
Definition
XLM-RoBERTa (Cross-lingual Language Model RoBERTa) is a large-scale multilingual model …
NLP
Zero-Shot Prompting
Definition
Zero-shot prompting involves asking a pre-trained language model to complete a task …
WordPiece
Definition
WordPiece is a tokenization method widely used in natural language processing models like …
Toxicity
Definition
Toxicity in AI refers to the generation or propagation of content that is disrespectful, …
Toxicity Detection
Definition
Toxicity detection employs natural language processing techniques to analyze text inputs …
Text Generation
Definition
Text Generation is a fundamental application paradigm in natural language processing …
Text Classification
Definition
Text classification is a supervised learning task where algorithms assign predefined …
Sequence labeling
Definition
Sequence labeling involves predicting a categorical label for every token in a given …
Semantic folding
Definition
Semantic folding refers to the process of compressing complex, high-dimensional vector …
Sentence Similarity
Definition
Sentence similarity measures the degree of semantic overlap between two distinct …
Sentence Transformers
Definition
Sentence Transformers are extensions of traditional Transformer models (like BERT) …
Semantic analysis
Definition
It goes beyond syntactic structure to interpret the actual intent and significance of …
Qwen3.5
Definition
Qwen3.5 denotes a specific release in the Qwen lineage developed by Alibaba Cloud. This …
Qwen
Definition
Qwen represents a family of advanced large language models created by Alibaba …
Pythia
Definition
Pythia is a series of open-source large language models (LLMs) created by EleutherAI, …
Products and applications of OpenAI
Definition
This term encompasses the commercial and research products created by OpenAI, a leading …
Pedagogical agent
Definition
A pedagogical agent is a software component, often embodied as a virtual character, that …
Paraphrasing
Definition
Paraphrasing in Natural Language Processing involves generating alternative expressions …
P-Tuning
Definition
P-Tuning (Prompt Tuning) is a technique designed to adapt large pre-trained language …
Ocr
Definition
Optical Character Recognition (OCR) uses image processing and pattern recognition …
Native-language identification
Definition
Native-language identification (NLI) is a subfield of natural language processing that …
Multilingual
Definition
Multilingual models are designed to handle diverse linguistic inputs without requiring …
Mask Generation
Definition
Mask generation involves producing spatial or temporal masks that determine which …
Machine Learning and Knowledge Extraction
Definition
This field combines machine learning techniques with natural language processing and data …
Lyra
Definition
In the context of modern AI terminology, Lyra often denotes specialized AI systems …
MAUVE
Definition
MAUVE is a statistical measure designed to assess how closely the output of a generative …
Long Context
Definition
Long context refers to the capacity of transformer-based models to handle extensive input …
Language/action perspective
Definition
Rooted in speech act theory and pragmatics, this perspective emphasizes how utterances …
LLM-as-a-Judge
Definition
LLM-as-a-Judge is an evaluation paradigm where a Large Language Model serves as an …
Knowledge graph embedding
Definition
Knowledge graph embedding methods, such as TransE or DistMult, transform discrete graph …
Intelligent word recognition
Definition
Intelligent Word Recognition refers to advanced optical character recognition (OCR) …
Gpt2
Definition
Generative Pre-trained Transformer 2 (GPT-2) is an autoregressive language model that …
GPT-5.6
Definition
GPT-5.6 refers to a speculative or forthcoming version in the lineage of OpenAI’s …
Fill Mask
Definition
Fill Mask is a fundamental pre-training objective used in transformer-based models like …
ExBERT
Definition
ExBERT provides interpretability for the BERT transformer model by analyzing the …
Document Classification
Definition
Document classification is a fundamental natural language processing task where …
ELMo
Definition
ELMo generates context-sensitive word embeddings by processing input text through a …
Dataset:Trivia QA
Definition
TriviaQA is a dataset designed for open-domain question answering, featuring over a …
Dataset:Wikihow
Definition
The WikiHow dataset consists of approximately 60,000 how-to articles collected from the …
Dataset:Wikipedia
Definition
Wikipedia is one of the largest and most comprehensive collections of human knowledge …
Dataset:Yahoo Answers Topics
Definition
The Yahoo Answers Topics dataset is a subset of the larger Yahoo Answers archive, …
Dataset:S2Orc
Definition
S2ORC is a comprehensive corpus of scholarly articles derived from Semantic Scholar. It …
Dataset:Embedding Data/Altlex
Definition
The Altlex dataset consists of pairs of sentences that share the same underlying meaning …
Dataset:Embedding Data/Qqp
Definition
Quora Question Pairs (QQP) is a binary classification dataset containing over 400,000 …
Dataset:Embedding Data/Sentence Compression
Definition
Sentence compression datasets consist of pairs where the target sentence is a shortened …
Dataset:Bookcorpus
Definition
BookCorpus is a collection of texts from over 10,000 unpublished books, scraped from the …
Computational humor
Definition
Computational humor studies how machines can produce or interpret jokes, puns, and witty …
Conditional Random Field
Definition
Conditional Random Fields (CRFs) are a class of discriminative models commonly used in …
Commonsense knowledge
Definition
Commonsense knowledge refers to the vast amount of implicit information about everyday …
Character computing
Definition
This concept focuses on the manipulation of text where the fundamental unit of …
Bloom
Definition
While historically referring to Benjamin Bloom’s educational taxonomy, in modern AI …
Bert
Definition
BERT is a transformer-based machine learning technique for NLP pre-training developed by …
Bag-of-words model
Definition
This natural language processing technique represents text as a multiset of words, …
Automated medical scribe
Definition
Automated medical scribes utilize natural language processing and speech recognition …
ASR-complete
Definition
The term ASR-complete signifies that an Automatic Speech Recognition system has reached a …
Vision Language
Definition
Vision-Language models, often referred to as Multimodal Large Language Models (MLLMs), …
Translation
Definition
Translation in AI refers to neural machine translation, where deep learning models map …
Positional Encoding
Definition
Since transformers process all tokens in parallel rather than sequentially like RNNs, …
Question Answering
Definition
Question Answering (QA) involves retrieving or generating accurate responses to user …
Semantic Search
Definition
Semantic search interprets the intent and contextual meaning behind a query, going beyond …
Summarization
Definition
Text summarization reduces large volumes of text into shorter versions without losing …
Named Entity Recognition
Definition
Named Entity Recognition (NER) is a subtask of information extraction that locates and …
Embedding Model
Definition
These models map high-dimensional data into a lower-dimensional continuous vector space …
Decoder
Definition
In sequence-to-sequence models, the decoder takes the context vector produced by the …
BPE
Definition
Byte Pair Encoding (BPE) is a data compression technique adapted for natural language …
self-supervised
Definition
Self-supervised learning is a subset of machine learning where the supervision signal is …
few-shot
Definition
Few-shot learning enables machine learning models to generalize from very limited data, …
Token
Definition
Tokens are the fundamental building blocks of input data in NLP, typically representing …
Tokenization
Definition
Tokenization is a critical preprocessing step in Natural Language Processing (NLP) that …
Transformer
Definition
Introduced in the ‘Attention Is All You Need’ paper, the Transformer …
Prompt
Definition
A prompt serves as the primary interface for interacting with large language models and …
Semantic
Definition
Semantic analysis in AI focuses on understanding the underlying meaning of inputs rather …
Post
Definition
In digital communication and AI data contexts, a ‘post’ refers to a discrete …
Pre-training
Definition
Pre-training is a foundational technique in deep learning where a model learns broad …
Natural Language Processing
Definition
Natural Language Processing (NLP) is a subfield of artificial intelligence that combines …
Multi-Head Attention
Definition
Multi-Head Attention extends the standard attention mechanism by running it multiple …
Long
Definition
In the context of AI, ’long’ often describes the capability to process …
Large Language Model
Definition
Large Language Models (LLMs) are advanced artificial intelligence systems based on …
Instead
Definition
While not a technical AI algorithmic term, ‘instead’ is crucial in prompt …
Hierarchical
Definition
Hierarchical AI systems organize information or control into a tree-like structure of …
Generation
Definition
In artificial intelligence, generation refers to the capability of models, particularly …
Context
Definition
In natural language processing, context is crucial for resolving ambiguity, such as …
Embedding
Definition
Embeddings are dense vector representations of data where semantic relationships are …
Attention Mechanism
Definition
An attention mechanism enables a model to weigh the importance of different elements …