Tanh
Definition
The hyperbolic tangent (Tanh) function is a non-linear activation function commonly used …
Deep_learning
Reparameterization trick
Definition
The reparameterization trick is a fundamental method used in variational autoencoders and …
Product of experts
Definition
The Product of Experts (PoE) is a method for constructing complex probability …
Multimodal representation learning
Definition
Multimodal representation learning involves training models to process and integrate …
Manifold hypothesis
Definition
This hypothesis explains why deep learning works effectively despite the curse of …
Highway network
Definition
Highway Networks are designed to address the vanishing gradient problem in deep learning …
Hidden Layer
Definition
A hidden layer consists of neurons that receive inputs from previous layers, apply …
Energy-based model
Definition
Energy-Based Models (EBMs) define a probability distribution over input data using an …
Differentially private stochastic gradient descent
Definition
DP-SGD is a variant of Stochastic Gradient Descent designed to protect the privacy of …
AlphaChip
Definition
AlphaChip is a specialized AI system designed to automate and enhance the placement and …
Adversarial Attack
Definition
Adversarial attacks exploit the vulnerabilities of neural networks by introducing subtle …
Vision
Definition
Computer Vision (CV) is a branch of artificial intelligence that trains computers to …
Residual Connection
Definition
Residual connections, also known as skip connections, allow gradients to flow through a …
Long Short-Term Memory
Definition
LSTM networks address the vanishing gradient problem common in standard RNNs by using a …
Activation Function
Definition
An activation function introduces non-linearity into a neural network, allowing it to …
pre-trained
Definition
A pre-trained model is a foundational AI model that has undergone extensive training on …
diffusion-based
Definition
Diffusion-based models are a class of generative AI that create new data samples by …
Transfer Learning
Definition
Transfer learning leverages pre-trained models to improve performance and reduce training …
Multi-Head Attention
Definition
Multi-Head Attention extends the standard attention mechanism by running it multiple …
Diffusion
Definition
Diffusion models are a class of generative AI that learn to reverse a stochastic process …
Convolutional Neural Network
Definition
Convolutional Neural Networks (CNNs) are designed to automatically and adaptively learn …
Attention Mechanism
Definition
An attention mechanism enables a model to weigh the importance of different elements …