Skip to content
← All questions

Why do decision-tree models not require feature scaling?

Decision-tree models do not require feature scaling because they split data based on feature conditions (thresholds) rather than absolute magnitudes. Monotonic rescaling of feature values does not change the branching structure or the order of splits.

Conditions

  • Model is a decision tree or an ensemble of trees (random forest, XGBoost, etc.).
  • Splitting logic is based on comparing feature values to thresholds.

Reasoning, step by step

  1. Observe that decision trees partition data using conditions like xi≤cx_i \le c.
  2. Note that scaling a feature monotonically (e.g., multiplying by a constant) preserves the order of values.
  3. Conclude that the thresholds and split points adjust accordingly, leaving the tree structure effectively unchanged in terms of information gain or impurity reduction.

Example

The speaker explains that for decision trees, 'if you keep the value high or if you keep the values small, it won't affect that much' because the tree is divided based on features.

Common misconceptions

  • Assuming all ML models need scaling, including tree-based ones.
  • Believing that scaling improves tree model performance when it typically has no effect on the split logic.

Watch the explanation

Connected concepts

Explore next

Related questions

Understand why

↗
Find a method

↗
Meet the concept

↗
Meet the concept

↗

Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.