- Real-time Analytics with Storm and Cassandra
- Shilpi Saxena
- 283字
- 2021-07-23 19:52:07
A high-level view of various components of Storm
In this section, we will get you acquainted with various components of Storm, their role, and their distribution in a Storm cluster.
A Storm cluster has three sets of nodes (which could be co-located, but are generally distributed in clusters), which are as follows:
- Nimbus
- Zookeeper
- Supervisor
The following figure shows the integration hierarchy of these nodes:

The detailed explanation of the integration hierarchy is as follows:
- Nimbus node (master node, similar to Hadoop-JobTracker): This is the heart of the Storm cluster. You can say that this is the master daemon process that is responsible for the following:
- Uploading and distributing various tasks across the cluster
- Uploading and distributing the topology jars jobs across various supervisors
- Launching workers as per ports allocated on the supervisor nodes
- Monitoring the topology execution and reallocating workers whenever necessary
- Storm UI is also executed on the same node
- Zookeeper nodes: Zookeepers can be designated as the bookkeepers in the Storm cluster. Once the topology job is submitted and distributed from the Nimbus nodes, then even if Nimbus dies the topology would continue to execute because as long as Zookeepers are alive, the workable state is maintained and logged by them. The main responsibility of this component is to maintain the operational state of the cluster and restore the operational state if recovery is required from some failure. It's the coordinator for the Storm cluster.
- Supervisor nodes: These are the main processing chambers in the Storm topology; all the action happens in here. These are daemon processes that listen and manage the work assigned. These communicates with Nimbus through Zookeeper and starts and stops workers according to signals from Nimbus.
推薦閱讀
- Web應用系統開發實踐(C#)
- Visual C++程序設計學習筆記
- Spring 5.0 By Example
- Java 開發從入門到精通(第2版)
- C#完全自學教程
- PHP 7底層設計與源碼實現
- Learning Laravel 4 Application Development
- Visual Basic程序設計實驗指導(第4版)
- KnockoutJS Starter
- Python數據分析從0到1
- FPGA Verilog開發實戰指南:基于Intel Cyclone IV(進階篇)
- 深入淺出React和Redux
- Node Cookbook(Second Edition)
- Processing開發實戰
- Practical Time Series Analysis