Sentence Similarity
Definition
Sentence similarity measures the degree of semantic overlap between two distinct …
Metrics
MAUVE
Definition
MAUVE is a statistical measure designed to assess how closely the output of a generative …
Inception Score
Definition
The Inception Score (IS) is a statistical measure introduced to assess the performance of …
Evaluation of binary classifiers
Definition
This field involves analyzing metrics such as accuracy, precision, recall, F1-score, and …
Equalized odds
Definition
Equalized odds is a statistical parity constraint used in algorithmic fairness to ensure …
Confusion matrix
Definition
A confusion matrix is a specific table layout that allows visualization of the …
Category utility
Definition
This metric quantifies how well a set of categories allows one to predict the values of …
Bayesian regret
Definition
Bayesian regret quantifies the difference between the optimal reward achievable with …
ASR-complete
Definition
The term ASR-complete signifies that an Automatic Speech Recognition system has reached a …
Latency
Definition
Latency measures the responsiveness of an AI service, typically expressed in …
Wasserstein
Definition
The Wasserstein distance, also known as Earth Mover’s Distance, quantifies the …
Score
Definition
Scores quantify how well a machine learning model performs against specific metrics such …
Overall
Definition
When evaluating AI models, ‘overall’ metrics provide a holistic view of …
Evaluation
Definition
Evaluation involves systematically measuring how well an AI model performs on specific …
Benchmark
Definition
In artificial intelligence, a benchmark is a standardized test suite or dataset designed …
Bench
Definition
A benchmark serves as a standardized reference point for comparing the capabilities of …