官术网_书友最值得收藏!

Chapter 3. Hadoop Essentials – Configurations, Unit Tests, and Other APIs

In this chapter, we will cover:

  • Optimizing Hadoop YARN and MapReduce configurations for cluster deployments
  • Shared user Hadoop clusters – using Fair and Capacity schedulers
  • Setting classpath precedence to user-provided JARs
  • Speculative execution of straggling tasks
  • Unit testing Hadoop MapReduce applications using MRUnit
  • Integration testing Hadoop MapReduce applications using MiniYarnCluster
  • Adding a new DataNode
  • Decommissioning DataNodes
  • Using multiple disks/volumes and limiting HDFS disk usage
  • Setting the HDFS block size
  • Setting the file replication factor
  • Using the HDFS Java API
主站蜘蛛池模板: 晋中市| 松滋市| 房产| 遂平县| 兰坪| 什邡市| 孙吴县| 遂川县| 凤翔县| 郯城县| 象州县| 会东县| 阳春市| 仁寿县| 咸阳市| 册亨县| 桐乡市| 瑞安市| 陵水| 松潘县| 三江| 延寿县| 金秀| 五莲县| 平江县| 仁寿县| 安塞县| 即墨市| 荃湾区| 平陆县| 盘锦市| 龙海市| 丰镇市| 浦县| 永年县| 肥东县| 邹平县| 五莲县| 青州市| 齐齐哈尔市| 望江县|