- Hadoop MapReduce v2 Cookbook（Second Edition）
- Thilina Gunarathne
- 275字
- 2021-07-23 20:32:52
Setting up Hadoop v2 on your local machine
This recipe describes how to set up Hadoop v2 on your local machine using the local mode. Local mode is a non-distributed mode that can be used for testing and debugging your Hadoop applications. When running a Hadoop application in local mode, all the required Hadoop components and your applications execute inside a single Java Virtual Machine (JVM) process.
Getting ready
Download and install JDK 1.6 or a higher version, preferably the Oracle JDK 1.7. Oracle JDK can be downloaded from http://www.oracle.com/technetwork/java/javase/downloads/index.html.
How to do it...
Now let's start the Hadoop v2 installation:
- Download the most recent Hadoop v2 branch distribution (Hadoop 2.2.0 or later) from http://hadoop.apache.org/releases.html.
- Unzip the Hadoop distribution using the following command. You will have to change the
x.x.in the filename to the actual release you have downloaded. From this point onward, we will call the unpacked Hadoop directory{HADOOP_HOME}:$ tar -zxvf hadoop-2.x.x.tar.gz - Now, you can run Hadoop jobs through the
{HADOOP_HOME}/bin/hadoopcommand, and we will elaborate on that further in the next recipe.
How it works...
Hadoop local mode does not start any servers but does all the work within a single JVM. When you submit a job to Hadoop in local mode, Hadoop starts a JVM to execute the job. The output and the behavior of the job is the same as a distributed Hadoop job, except for the fact that the job only uses the current node to run the tasks and the local filesystem is used for the data storage. In the next recipe, we will discover how to run a MapReduce program using the Hadoop local mode.
- Docker進階與實戰(zhàn)
- ASP.NET Core Essentials
- 實戰(zhàn)Java程序設計
- Java面向對象程序開發(fā)及實戰(zhàn)
- 零基礎入門學習Python
- Learning Unity 2D Game Development by Example
- MySQL入門很輕松（微課超值版）
- Python：Deeper Insights into Machine Learning
- QGIS 2 Cookbook
- Django Design Patterns and Best Practices
- Greenplum構建實時數(shù)據(jù)倉庫實踐
- Learning Kotlin by building Android Applications
- Visual Basic程序設計基礎
- 計算機程序的構造和解釋（JavaScript版）
- 軟件開發(fā)中的決策：權衡與取舍