Tracing
Definition
In the context of AI engineering, tracing involves capturing detailed logs of how data …
Performance
Throughput
Definition
In AI engineering, throughput is a critical performance metric indicating system …
Qwen2
Definition
Qwen2 signifies the second significant generation of the Qwen model family, introducing …
Mixed Precision Training
Definition
Mixed Precision Training (MPT) combines half-precision (FP16) and full-precision (FP32) …
Kimi K25
Definition
Kimi K25 is an advanced iteration within the Kimi family of models produced by Moonshot …
Compressed Tensors
Definition
Compressed tensors are multi-dimensional arrays used in deep learning where the numerical …
Caching
Definition
In AI engineering, caching optimizes performance by keeping recent or frequent query …
Async Processing
Definition
Asynchronous processing allows software to perform long-running tasks, such as I/O …
Accelerated Linear Algebra
Definition
This field focuses on speeding up fundamental linear algebra computations, which are core …
Quantization
Definition
Quantization converts high-precision floating-point numbers (like FP32) into …
Latency
Definition
Latency measures the responsiveness of an AI service, typically expressed in …
Distributed Training
Definition
Distributed Training accelerates model convergence by parallelizing computation over …
real-time
Definition
In artificial intelligence, real-time denotes the capability of a system to process …
Rate
Definition
In AI, ‘rate’ most frequently refers to the learning rate, a hyperparameter …
Robust
Definition
In artificial intelligence, robustness refers to the resilience of a model against …
Fast
Definition
The term ‘fast’ describes computational efficiency within artificial …
Efficient
Definition
Efficiency is a critical metric in artificial intelligence that measures how well a model …
Inference
Definition
Inference refers to the deployment stage where a finalized model is used to make …