舉報 
會員
Hadoop MapReduce v2 Cookbook（Second Edition）
最新章節：
Index
IfyouareaBigDataenthusiastandwishtouseHadoopv2tosolveyourproblems,thenthisbookisforyou.ThisbookisforJavaprogrammerswithlittletomoderateknowledgeofHadoopMapReduce.Thisisalsoaone-stopreferencefordevelopersandsystemadminswhowanttoquicklygetuptospeedwithusingHadoopv2.ItwouldbehelpfultohaveabasicknowledgeofsoftwaredevelopmentusingJavaandabasicworkingknowledgeofLinux.
目錄(129章)
倒序
- coverpage
- Hadoop MapReduce v2 Cookbook Second Edition
- Credits
- About the Author
- Acknowledgments
- About the Author
- About the Reviewers
- www.PacktPub.com
- Support files eBooks discount offers and more
- Preface
- What this book covers
- What you need for this book
- Who this book is for
- Conventions
- Reader feedback
- Customer support
- Chapter 1. Getting Started with Hadoop v2
- Introduction
- Setting up Hadoop v2 on your local machine
- Writing a WordCount MapReduce application bundling it and running it using the Hadoop local mode
- Adding a combiner step to the WordCount MapReduce program
- Setting up HDFS
- Setting up Hadoop YARN in a distributed cluster environment using Hadoop v2
- Setting up Hadoop ecosystem in a distributed cluster environment using a Hadoop distribution
- HDFS command-line file operations
- Running the WordCount program in a distributed cluster environment
- Benchmarking HDFS using DFSIO
- Benchmarking Hadoop MapReduce using TeraSort
- Chapter 2. Cloud Deployments – Using Hadoop YARN on Cloud Environments
- Introduction
- Running Hadoop MapReduce v2 computations using Amazon Elastic MapReduce
- Saving money using Amazon EC2 Spot Instances to execute EMR job flows
- Executing a Pig script using EMR
- Executing a Hive script using EMR
- Creating an Amazon EMR job flow using the AWS Command Line Interface
- Deploying an Apache HBase cluster on Amazon EC2 using EMR
- Using EMR bootstrap actions to configure VMs for the Amazon EMR jobs
- Using Apache Whirr to deploy an Apache Hadoop cluster in a cloud environment
- Chapter 3. Hadoop Essentials – Configurations Unit Tests and Other APIs
- Introduction
- Optimizing Hadoop YARN and MapReduce configurations for cluster deployments
- Shared user Hadoop clusters – using Fair and Capacity schedulers
- Setting classpath precedence to user-provided JARs
- Speculative execution of straggling tasks
- Unit testing Hadoop MapReduce applications using MRUnit
- Integration testing Hadoop MapReduce applications using MiniYarnCluster
- Adding a new DataNode
- Decommissioning DataNodes
- Using multiple disks/volumes and limiting HDFS disk usage
- Setting the HDFS block size
- Setting the file replication factor
- Using the HDFS Java API
- Chapter 4. Developing Complex Hadoop MapReduce Applications
- Introduction
- Choosing appropriate Hadoop data types
- Implementing a custom Hadoop Writable data type
- Implementing a custom Hadoop key type
- Emitting data of different value types from a Mapper
- Choosing a suitable Hadoop InputFormat for your input data format
- Adding support for new input data formats – implementing a custom InputFormat
- Formatting the results of MapReduce computations – using Hadoop OutputFormats
- Writing multiple outputs from a MapReduce computation
- Hadoop intermediate data partitioning
- Secondary sorting – sorting Reduce input values
- Broadcasting and distributing shared resources to tasks in a MapReduce job – Hadoop DistributedCache
- Using Hadoop with legacy applications – Hadoop streaming
- Adding dependencies between MapReduce jobs
- Hadoop counters to report custom metrics
- Chapter 5. Analytics
- Introduction
- Simple analytics using MapReduce
- Performing GROUP BY using MapReduce
- Calculating frequency distributions and sorting using MapReduce
- Plotting the Hadoop MapReduce results using gnuplot
- Calculating histograms using MapReduce
- Calculating Scatter plots using MapReduce
- Parsing a complex dataset with Hadoop
- Joining two datasets using MapReduce
- Chapter 6. Hadoop Ecosystem – Apache Hive
- Introduction
- Getting started with Apache Hive
- Creating databases and tables using Hive CLI
- Simple SQL-style data querying using Apache Hive
- Creating and populating Hive tables and views using Hive query results
- Utilizing different storage formats in Hive - storing table data using ORC files
- Using Hive built-in functions
- Hive batch mode - using a query file
- Performing a join with Hive
- Creating partitioned Hive tables
- Writing Hive User-defined Functions (UDF)
- HCatalog – performing Java MapReduce computations on data mapped to Hive tables
- HCatalog – writing data to Hive tables from Java MapReduce computations
- Chapter 7. Hadoop Ecosystem II – Pig HBase Mahout and Sqoop
- Introduction
- Getting started with Apache Pig
- Joining two datasets using Pig
- Accessing a Hive table data in Pig using HCatalog
- Getting started with Apache HBase
- Data random access using Java client APIs
- Running MapReduce jobs on HBase
- Using Hive to insert data into HBase tables
- Getting started with Apache Mahout
- Running K-means with Mahout
- Importing data to HDFS from a relational database using Apache Sqoop
- Exporting data from HDFS to a relational database using Apache Sqoop
- Chapter 8. Searching and Indexing
- Introduction
- Generating an inverted index using Hadoop MapReduce
- Intradomain web crawling using Apache Nutch
- Indexing and searching web documents using Apache Solr
- Configuring Apache HBase as the backend data store for Apache Nutch
- Whole web crawling with Apache Nutch using a Hadoop/HBase cluster
- Elasticsearch for indexing and searching
- Generating the in-links graph for crawled web pages
- Chapter 9. Classifications Recommendations and Finding Relationships
- Introduction
- Performing content-based recommendations
- Classification using the na?ve Bayes classifier
- Assigning advertisements to keywords using the Adwords balance algorithm
- Chapter 10. Mass Text Data Processing
- Introduction
- Data preprocessing using Hadoop streaming and Python
- De-duplicating data using Hadoop streaming
- Loading large datasets to an Apache HBase data store – importtsv and bulkload
- Creating TF and TF-IDF vectors for the text data
- Clustering text data using Apache Mahout
- Topic discovery using Latent Dirichlet Allocation (LDA)
- Document classification using Mahout Naive Bayes Classifier
- Index 更新時間：2021-07-23 20:33:18
推薦閱讀
- GitLab Cookbook
- C語言程序設計（第3版）
- Bootstrap Essentials
- TypeScript實戰指南
- Kinect for Windows SDK Programming Guide
- Mastering RStudio：Develop，Communicate，and Collaborate with R
- R Deep Learning Cookbook
- Access 2010數據庫應用技術（第2版）
- Kotlin編程實戰：創建優雅、富于表現力和高性能的JVM與Android應用程序
- Go語言精進之路：從新手到高手的編程思想、方法和技巧（2）
- Python圖形化編程（微課版）
- GameMaker Essentials
- Unity Character Animation with Mecanim
- PostgreSQL Developer's Guide
- Selenium WebDriver Practical Guide
- Java服務端研發知識圖譜
- Android熱門應用開發詳解
- Puppet Cookbook（Third Edition）
- Java無難事：詳解Java編程核心思想與技術
- Mastering iOS Game Development
- JavaScript啟示錄
- 新時期的Node.js入門
- Android設計模式與最佳實踐
- iOS6應用開發實戰
- Learning Python
- Tkinter GUI Application Development Cookbook
- UML 建模、設計與分析：從新手到高手
- Robot Operating System Cookbook
- Articulate Storyline Essentials
- 零基礎快速入行入職軟件測試工程師（第2版）
