- Hands-On Big Data Modeling
- James Lee Tao Wei Suresh Kumar Mukhiya
- 180字
- 2021-06-10 18:58:53
Yet Another Resource Negotiator
Yet Another Resource Negotiator (YARN) is an example of an extension of the MapReduce framework. YARN is the architectural center of Hadoop and permits multiple data processing engines, such as interactive SQL, batch processing, and real-time streaming, to handle data stored in a single platform. It is known as the new generation of Hadoop.
YARN improves a Hadoop cluster in many ways. Some important features that are improved in YARN are listed as follows:
- Scalability: YARN has a ResourceManger, which has two components: a scheduler and an application manager. As the name suggests, the scheduler is responsible for allocating resources to the running application. The application manager is responsible for starting application masters and for monitoring and restarting them on different nodes, in the case of failures.
- Compatibility: YARN can run applications developed for Hadoop 1.x, without going through the modification process.
- Cluster utilization: YARN allocates clusters dynamically, over most static MapReduce rules.
- Multi-tenancy: YARN permits accessing engines, to use Hadoop as the common standard for each batch.