- Hadoop MapReduce v2 Cookbook（Second Edition）
- Thilina Gunarathne
- 275字
- 2021-07-23 20:32:52
Setting up Hadoop v2 on your local machine
This recipe describes how to set up Hadoop v2 on your local machine using the local mode. Local mode is a non-distributed mode that can be used for testing and debugging your Hadoop applications. When running a Hadoop application in local mode, all the required Hadoop components and your applications execute inside a single Java Virtual Machine (JVM) process.
Getting ready
Download and install JDK 1.6 or a higher version, preferably the Oracle JDK 1.7. Oracle JDK can be downloaded from http://www.oracle.com/technetwork/java/javase/downloads/index.html.
How to do it...
Now let's start the Hadoop v2 installation:
- Download the most recent Hadoop v2 branch distribution (Hadoop 2.2.0 or later) from http://hadoop.apache.org/releases.html.
- Unzip the Hadoop distribution using the following command. You will have to change the
x.x.in the filename to the actual release you have downloaded. From this point onward, we will call the unpacked Hadoop directory{HADOOP_HOME}:$ tar -zxvf hadoop-2.x.x.tar.gz - Now, you can run Hadoop jobs through the
{HADOOP_HOME}/bin/hadoopcommand, and we will elaborate on that further in the next recipe.
How it works...
Hadoop local mode does not start any servers but does all the work within a single JVM. When you submit a job to Hadoop in local mode, Hadoop starts a JVM to execute the job. The output and the behavior of the job is the same as a distributed Hadoop job, except for the fact that the job only uses the current node to run the tasks and the local filesystem is used for the data storage. In the next recipe, we will discover how to run a MapReduce program using the Hadoop local mode.
- Learning Neo4j
- Java程序設計與開發
- Learning Java Functional Programming
- Microsoft Exchange Server PowerShell Cookbook（Third Edition）
- 零基礎學C++程序設計
- 趣學Python算法100例
- Spring Boot企業級項目開發實戰
- Building Machine Learning Systems with Python（Second Edition）
- 現代C++編程實戰：132個核心技巧示例（原書第2版）
- Learning Node.js for .NET Developers
- C++從入門到精通（第6版）
- C語言從入門到精通
- Python網絡爬蟲實例教程（視頻講解版）
- 數字媒體技術概論
- Analytics for the Internet of Things（IoT）