官术网_书友最值得收藏!

Downloading Hadoop

Once you have completed the prerequisites and SSH keyless entry with all the necessary nodes, you are good to download the Hadoop release. You can download Apache Hadoop from http://www.apache.org/dyn/closer.cgi/hadoop/common/. Hadoop provides two options for downloading—you can either download the source code of Apache Hadoop or you can download binaries. If you download the source code, you need to compile it and create binaries out of it. We will proceed with downloading binaries.

One important question that often arises while downloading Hadoop involves which version to choose. You will find many alpha and beta versions, as well as stable versions. Currently, the stable Hadoop version is 2.9.1, however this may change by the time you read this book. The answer to such a question depends upon usage. For example, if you are evaluating Hadoop for the first time, you may choose to go with the latest Hadoop version (3.1.0) with all-new features, so as to keep yourself updated with the latest trends and skills.

However, if you are looking to set up a production-based cluster, you may need to choose a version of Hadoop that is stable (such as 2.9.1), as well as established, to ensure peaceful project execution. In our case, we will download Hadoop 3.1.0, as shown in the following screenshot:

You can download the binary (tar.gz) from Apache's website, and you can untar it with following command:

hadoop@base0:/$ tar xvzf <hadoop-downloaded-file>.tar.gz

The preceding command will extract the file in a given location. When you list the directory, you should see the following folders:

  • The bin/ folder contains all executable for Hadoop
  • sbin/ contains all scripts to start or stop clusters
  • etc/ contains all configuration pertaining to Hadoop
  • share/ contains all the documentation and examples
  • Other folders such as include/, lib/, and libexec/ contain libraries and other dependencies
主站蜘蛛池模板: 新余市| 南澳县| 元谋县| 鄱阳县| 曲沃县| 小金县| 汝阳县| 攀枝花市| 宿迁市| 广南县| 东乌珠穆沁旗| 柯坪县| 乐清市| 乌鲁木齐市| 高要市| 临夏县| 彩票| 海门市| 瑞安市| 偃师市| 满洲里市| 布拖县| 红原县| 临安市| 泾川县| 噶尔县| 绥芬河市| 四平市| 枣强县| 湟中县| 璧山县| 丹寨县| 鸡东县| 桃园市| 云南省| 义马市| 永安市| 苗栗市| 建瓯市| 临漳县| 浦县|