What is the z-score standardization formula and what statistics does it target?
Conditions
- Applied per numerical feature.
- Uses the feature mean and standard deviation .
- Assumes .
Reasoning, step by step
- Calculate the mean and standard deviation of the feature.
- Subtract the mean from the original value to center the data.
- Divide by the standard deviation to scale the spread to 1.
Example
The video shows the formula and states that features are transformed to have the properties of a standard normal distribution with mean 0 and standard deviation 1.
Common misconceptions
- Believing that standardization forces the data to follow an exact normal distribution, whereas it only guarantees mean 0 and standard deviation 1.
- Confusing standardization with min-max normalization, which bounds values to [0, 1].
Watch the explanation
Connected concepts
Explore next
Related questions
Decision-tree models do not require feature scaling because they split data based on feature conditions (thresholds) rather than absolute magnitudes. Monotonic rescaling of feature values does not change the branching structure or the order of splits.
Conditions: Model is a decision tree or an ensemble of trees (random forest, XGBoost, etc.).; Splitting logic is based on comparing feature values to thresholds.
Feature scaling is needed because raw features often differ in units and magnitudes, making them incomparable. Scaling brings them onto a common scale, which is necessary for many machine learning algorithms to function properly.
Conditions: Dataset contains multiple features with different units or ranges.; The model is sensitive to feature magnitudes (e.g., distance-based or gradient-based).
Import `MinMaxScaler` from `sklearn.preprocessing`, instantiate it, and call `fit_transform` on the selected DataFrame columns. This fits the scaler to the data (learning min/max) and transforms the values to the [0, 1] range.
Conditions: Input data is numerical.; Scikit-learn library is installed.
Import `StandardScaler` from `sklearn.preprocessing`, instantiate it, and call `fit_transform` on the selected DataFrame columns. This transforms the data to have mean 0 and standard deviation 1.
Conditions: Input data is numerical.; Scikit-learn library is installed.
Min-max normalization transforms a feature value into , mapping the feature's observed range onto the interval .
Conditions: Applied per numerical feature.; Requires a finite minimum and maximum for the feature.; Assumes to avoid division by zero.
Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.