TAAFT
Free mode
100% free
Freemium
Free Trial
Deals
Create tool
Glossary
Machine Learning
Gradient Boosting Machines

Gradient Boosting Machines

[ˈɡreɪdiənt ˈbustɪŋ məˈʃinz]
Machine Learning
Last updated: December 9, 2024

Definition

Ensemble models that build sequential trees to minimize errors.

Detailed Explanation

Gradient Boosting Machines construct additive models by sequentially fitting decision trees to the negative gradient of the loss function. Each new model focuses on correcting the errors of the combined ensemble.

Use Cases

Regression and classification tasks winning machine learning competitions handling structured data predictive analytics.

Related Terms

Data Drift

Changes in the distribution of input features over time while the relationship between features and target remains constant.

Machine Learning

Preference Tuning

Fine-tuning methods (like DPO, RLHF) aligning models with human preferences using preferred vs. non-preferred output data.

Machine Learning

Agglomerative Clustering

A hierarchical clustering approach that builds nested clusters by merging closer clusters.

Machine Learning