- Hadoop MapReduce v2 Cookbook(Second Edition)
- Thilina Gunarathne
- 92字
- 2021-07-23 20:32:56
Chapter 3. Hadoop Essentials – Configurations, Unit Tests, and Other APIs
In this chapter, we will cover:
- Optimizing Hadoop YARN and MapReduce configurations for cluster deployments
- Shared user Hadoop clusters – using Fair and Capacity schedulers
- Setting classpath precedence to user-provided JARs
- Speculative execution of straggling tasks
- Unit testing Hadoop MapReduce applications using MRUnit
- Integration testing Hadoop MapReduce applications using MiniYarnCluster
- Adding a new DataNode
- Decommissioning DataNodes
- Using multiple disks/volumes and limiting HDFS disk usage
- Setting the HDFS block size
- Setting the file replication factor
- Using the HDFS Java API
推薦閱讀
- The Complete Rust Programming Reference Guide
- C語言程序設計(第2 版)
- Power Up Your PowToon Studio Project
- 單片機C語言程序設計實訓100例:基于STC8051+Proteus仿真與實戰
- 64位匯編語言的編程藝術
- 單片機應用技術
- Troubleshooting PostgreSQL
- Quarkus實踐指南:構建新一代的Kubernetes原生Java微服務
- 重學Java設計模式
- C語言程序設計學習指導與習題解答
- C語言程序設計
- Visual C++程序設計與項目實踐
- JavaScript Concurrency
- Python計算機視覺與深度學習實戰
- 一步一步學Spring Boot:微服務項目實戰(第2版)