- Machine Learning Algorithms
- Giuseppe Bonaccorso
- 273字
- 2021-07-02 18:53:30
Managing missing features
Sometimes a dataset can contain missing features, so there are a few options that can be taken into account:
- Removing the whole line
- Creating sub-model to predict those features
- Using an automatic strategy to input them according to the other known values
The first option is the most drastic one and should be considered only when the dataset is quite large, the number of missing features is high, and any prediction could be risky. The second option is much more difficult because it's necessary to determine a supervised strategy to train a model for each feature and, finally, to predict their value. Considering all pros and cons, the third option is likely to be the best choice. scikit-learn offers the class Imputer, which is responsible for filling the holes using a strategy based on the mean (default choice), median, or frequency (the most frequent entry will be used for all the missing ones).
The following snippet shows an example using the three approaches (the default value for a missing feature entry is NaN. However, it's possible to use a different placeholder through the parameter missing_values):
from sklearn.preprocessing import Imputer
>>> data = np.array([[1, np.nan, 2], [2, 3, np.nan], [-1, 4, 2]])
>>> imp = Imputer(strategy='mean')
>>> imp.fit_transform(data)
array([[ 1. , 3.5, 2. ],
[ 2. , 3. , 2. ],
[-1. , 4. , 2. ]])
>>> imp = Imputer(strategy='median')
>>> imp.fit_transform(data)
array([[ 1. , 3.5, 2. ],
[ 2. , 3. , 2. ],
[-1. , 4. , 2. ]])
>>> imp = Imputer(strategy='most_frequent')
>>> imp.fit_transform(data)
array([[ 1., 3., 2.],
[ 2., 3., 2.],
[-1., 4., 2.]])
- Google Flutter Mobile Development Quick Start Guide
- 深度學習經典案例解析:基于MATLAB
- Power Up Your PowToon Studio Project
- arc42 by Example
- Twilio Best Practices
- Mastering Spring MVC 4
- Learning Apache Kafka(Second Edition)
- 深度強化學習算法與實踐:基于PyTorch的實現
- Oracle BAM 11gR1 Handbook
- MongoDB,Express,Angular,and Node.js Fundamentals
- Mastering React
- Internet of Things with ESP8266
- Flink技術內幕:架構設計與實現原理
- Node.js從入門到精通
- Building Apple Watch Projects