TAAFT
Free mode
100% free
Freemium
Free Trial
Create tool
GlossaryDeep LearningBatch Normalization

Batch Normalization

[bætʃ ˌnɔːməlaɪˈzeɪʃən]
Deep Learning
Last updated: December 9, 2024

Definition

Technique that normalizes the input of each layer to improve training stability and speed

Detailed Explanation

Batch normalization normalizes the activations of each layer by adjusting and scaling the activations. This reduces internal covariate shift, allows higher learning rates, and acts as a regularizer.

Use Cases

Training deep neural networks, accelerating training

Related Terms

Spiking Neural Networks

Neural networks that more closely mimic biological neural networks by using discrete spikes for information transmission.

Deep Learning

Siamese Networks

Neural networks that learn to compare two inputs and determine their similarity

Deep Learning

Artificial Neural Networks

Computing systems inspired by biological neural networks that can learn to perform tasks from examples

Deep Learning