官术网_书友最值得收藏!

The dataset

Upon releasing their findings to the scientific community in 2012, researchers later made the data public from the LHC experiments where they observed - and identified - a signal which is indicative of the Higgs-Boson particle. However, amidst the positive findings is a lot of background noise which causes an imbalance within the dataset. Our task as data scientist is to build a machine learning model which can accurately identify the Higgs-Boson particle from background noise. Already, you should be thinking about how this question is phrased which would be indicative of binary classification (that is, is this example the Higgs-Boson versus background noise?).

You can download the dataset from  https://archive.ics.uci.edu/ml/datasets/HIGGS or use the script getdata.sh located in the   bin folder of this chapter.

This file is 2.6 gigs (uncompressed) and contains 11 million examples that have been labeled as 0 - background noise and 1 - Higgs-Boson. First, you will need to uncompress this file and then we will begin loading the data into Spark for processing and analysis. There are 29 total fields which make up the dataset:

  • Field 1: Class label (1 = signal for Higgs-Boson, 2 = background noise)
  • Fields 2-22: 21 "low-level" features that come from the collision detectors
  • Fields 23-29: seven "high-level" features that have been hand-derived by particle physicists to help classify the particle into its appropriate class (Higgs or background noise)

Later in this chapter, we cover a Deep Neural Network (DNN) example that will attempt to learn these hand-derived features through layers of non-linear transformations to the input data.

Note that for the purposes of this chapter, we will work with a subset of the data, the first 100,000 rows, but all the code we show would also work on the original dataset.

主站蜘蛛池模板: 昌乐县| 延津县| 梅州市| 虞城县| 珲春市| 长岛县| 于田县| 兴化市| 贺兰县| 禹城市| 久治县| 库车县| 房产| 南乐县| 增城市| 金川县| 平定县| 东源县| 革吉县| 武宣县| 浏阳市| 保康县| 京山县| 蓬莱市| 焦作市| 瑞金市| 安陆市| 绍兴县| 睢宁县| 靖江市| 沁水县| 托里县| 福建省| 宁陵县| 涿鹿县| 板桥市| 成都市| 原阳县| 横山县| 巫山县| 丰台区|