官术网_书友最值得收藏!

Data-Driven Feature Engineering

The previous section dealt with business-driven feature engineering. In addition to features we can derive from the business perspective, it would also be imperative to transform data through feature engineering from the perspective of data structures. We will look into different methods of identifying data structures and take a peek into some data transformation techniques.

A Quick Peek at Data Types and a Descriptive Summary

Looking at the data types such as categorical or numeric and then deriving summary statistics is a good way to take a quick peek into data before you do some of the downstream feature engineering steps. Let's take a look at an example from our dataset:

# Looking at Data types

print(bankData.dtypes)

# Looking at descriptive statistics

print(bankData.describe())

You should get the following output:

Figure 3.28: Output showing the different data types in the dataset

In the preceding output, you see the different types of information in the dataset and its corresponding data types. For instance, age is an integer and so is day.

The following output is that of a descriptive summary statistic, which displays some of the basic measures such as mean, standard deviation, count, and the quantile values of the respective features:

Figure 3.29: Data types and a descriptive summary

The purpose of a descriptive summary is to get a quick feel of the data with respect to the distribution and some basic statistics such as mean and standard deviation. Getting a perspective on the summary statistics is critical for thinking about what kind of transformations are required for each variable.

For instance, in the earlier exercises, we converted the numerical data into categorical variables based on the quantile values. Intuitions for transforming variables would come from the quick summary statistics that we can derive from the dataset.

In the following sections, we will be looking at the correlation matrix and visualization.

主站蜘蛛池模板: 惠安县| 大英县| 南靖县| 平凉市| 菏泽市| 惠安县| 大港区| 湟中县| 土默特左旗| 鄂尔多斯市| 犍为县| 绥棱县| 泰安市| 化隆| 楚雄市| 阿城市| 毕节市| 微博| 哈尔滨市| 海盐县| 汤原县| 阿城市| 彰武县| 临沧市| 南郑县| 积石山| 灵寿县| 五寨县| 云林县| 城固县| 砚山县| 通山县| 汉寿县| 蓬莱市| 霍州市| 合阳县| 石渠县| 揭东县| 巴东县| 大关县| 沂南县|