- Hadoop MapReduce v2 Cookbook(Second Edition)
- Thilina Gunarathne
- 92字
- 2021-07-23 20:32:56
Chapter 3. Hadoop Essentials – Configurations, Unit Tests, and Other APIs
In this chapter, we will cover:
- Optimizing Hadoop YARN and MapReduce configurations for cluster deployments
- Shared user Hadoop clusters – using Fair and Capacity schedulers
- Setting classpath precedence to user-provided JARs
- Speculative execution of straggling tasks
- Unit testing Hadoop MapReduce applications using MRUnit
- Integration testing Hadoop MapReduce applications using MiniYarnCluster
- Adding a new DataNode
- Decommissioning DataNodes
- Using multiple disks/volumes and limiting HDFS disk usage
- Setting the HDFS block size
- Setting the file replication factor
- Using the HDFS Java API
推薦閱讀
- 密碼學原理與Java實現
- Mastering Ember.js
- Raspberry Pi Networking Cookbook(Second Edition)
- 看透JavaScript:原理、方法與實踐
- Getting Started with CreateJS
- 深入淺出DPDK
- 假如C語言是我發明的:講給孩子聽的大師編程課
- ArcGIS By Example
- 劍指大數據:企業級數據倉庫項目實戰(在線教育版)
- 持續集成與持續交付實戰:用Jenkins、Travis CI和CircleCI構建和發布大規模高質量軟件
- Beginning C++ Game Programming
- Xcode 6 Essentials
- OpenCV with Python Blueprints
- SFML Game Development
- Ionic3與CodePush初探:支持跨平臺與熱更新的App開發技術