Chapter 21 of 30
Keep learning and build your Data Science skills.
Data Preprocessing
Learn how data is prepared before statistical analysis or machine learning.
Theory
Data preprocessing prepares raw data for analysis and modeling.
Common preprocessing tasks include:
• Handling missing values
• Removing duplicates
• Encoding categorical variables
• Scaling numerical features
• Detecting unusual values
• Converting data types
Preprocessing should be performed carefully to avoid introducing data leakage.
Example
from sklearn.preprocessing import StandardScaler
X = [
[10],
[20],
[30]
]
scaler = StandardScaler()
X_scaled = scaler.fit_transform(X)
print(X_scaled)Output
The numerical feature is standardized.
Practice
Preprocess a dataset containing numerical and categorical variables.
Interview Questions
1
What is data preprocessing?
2
Why is scaling useful?
3
What is data leakage?
Quick Quiz
Which option best describes this chapter?
A.Preparing data for analysis or modeling
B.Creating websites
C.Managing operating systems
D.Designing network protocols