About This Encyclopedia

Editorial Stance

The XGBoost Reader's Encyclopedia is an independent, community-maintained knowledge resource about the XGBoost gradient boosting algorithm. It is not a replacement for the official XGBoost documentation at xgboost.readthedocs.io.

Our purpose is complementary: we provide concept explanations for those who want to understand the "why" behind the "how", mathematical derivations with explicit steps (not just final formulas), annotated readings of key papers (Chen & Guestrin 2016, the original), and source-linked comparisons with LightGBM, CatBoost, and other gradient boosting implementations.

We are independent contributors with no affiliation to the official XGBoost project, DMLC, or any vendor. We publish this encyclopedia because we love the algorithm and believe its inner workings deserve clear exposition.

Methodology

  • All mathematical derivations are checked against the original papers and (where possible) against the XGBoost source code.
  • Comparison articles summarise documentation and published results; check the linked sources before relying on any number.
  • Code examples use the official xgboost Python package. Some older snippets predate XGBoost 3.x; if one fails for you, please report it below.
  • Code produced by the Starter Config Builder is executed against the specific releases listed on that page before each release of the tool.

Corrections and suggestions

Spotted an error, an outdated API or a broken example? Tell us here; every note is read.