Learn/Data Science/Chapter 21

Chapter 21 of 30

Keep learning and build your Data Science skills.

70%
Chapter 21

Data Preprocessing

Learn how data is prepared before statistical analysis or machine learning.

Theory

Data preprocessing prepares raw data for analysis and modeling. Common preprocessing tasks include: • Handling missing values • Removing duplicates • Encoding categorical variables • Scaling numerical features • Detecting unusual values • Converting data types Preprocessing should be performed carefully to avoid introducing data leakage.

Example

from sklearn.preprocessing import StandardScaler

X = [
    [10],
    [20],
    [30]
]

scaler = StandardScaler()

X_scaled = scaler.fit_transform(X)

print(X_scaled)

Output

The numerical feature is standardized.

Practice

Preprocess a dataset containing numerical and categorical variables.

Interview Questions

1

What is data preprocessing?

2

Why is scaling useful?

3

What is data leakage?

Quick Quiz

Which option best describes this chapter?

A.Preparing data for analysis or modeling
B.Creating websites
C.Managing operating systems
D.Designing network protocols