官术网_书友最值得收藏!

Chapter 3. Hadoop Essentials – Configurations, Unit Tests, and Other APIs

In this chapter, we will cover:

  • Optimizing Hadoop YARN and MapReduce configurations for cluster deployments
  • Shared user Hadoop clusters – using Fair and Capacity schedulers
  • Setting classpath precedence to user-provided JARs
  • Speculative execution of straggling tasks
  • Unit testing Hadoop MapReduce applications using MRUnit
  • Integration testing Hadoop MapReduce applications using MiniYarnCluster
  • Adding a new DataNode
  • Decommissioning DataNodes
  • Using multiple disks/volumes and limiting HDFS disk usage
  • Setting the HDFS block size
  • Setting the file replication factor
  • Using the HDFS Java API
主站蜘蛛池模板: 金阳县| 嘉荫县| 绩溪县| 缙云县| 凤阳县| 山阴县| 邹城市| 从江县| 新兴县| 攀枝花市| 航空| 曲水县| 甘洛县| 山东省| 南陵县| 和顺县| 尼木县| 义马市| 淮南市| 莎车县| 开原市| 察哈| 丹寨县| 沂水县| 嵊泗县| 辛集市| 曲靖市| 宝清县| 和田市| 庐江县| 商洛市| 卢湾区| 合川市| 望都县| 济南市| 海城市| 兖州市| 红原县| 沁源县| 宁德市| 来宾市|