Understanding XGBoost: A Deep Dive into the Algorithm
Author(s): Utkarsh Mittal Originally published on Towards AI. Introduction XGBoost (Extreme Gradient Boosting) has become the go-to algorithm for winning machine learning competitions and solving real-world prediction problems. But what makes it so powerful? In this comprehensive tutorial, we’ll unpack the mathematical …
Understanding Gradient Boosted Trees: The Foundation of XGBoost
Author(s): Utkarsh Mittal Originally published on Towards AI. Understanding Gradient Boosted Trees: The Foundation of XGBoost Gradient Boosted Trees have revolutionized machine learning, powering some of the most successful algorithms in data science. Before diving into the complexities of XGBoost, it’s essential …
RoPE (Rotary Position Embeddings): A Detailed Example
Author(s): Utkarsh Mittal Originally published on Towards AI. In transformer models, knowing the order of tokens is essential — even though the model processes tokens in parallel. Traditional positional embeddings rely on a fixed “lookup table” (learned for positions up to a …
Popular posts
Updates
Recent Posts
