- Machine Learning with Spark（Second Edition）
- Rajdeep Dua Manpreet Singh Ghotra Nick Pentreath
- 125字
- 2021-07-09 21:07:44
UI in Spark
Spark provides a web interface which can be used to monitor jobs, see the environment, and run SQL commands.
SparkContext launches a web UI on port 4040 that displays useful information about the application. This includes the following:
- A list of scheduler stages and tasks
- A summary of RDD sizes and memory usage
- Environmental information
- Information about the running executors
This interface can be accessed by going to http://<driver-node>:4040 in a web browser. If multiple SparkContexts are running on the same host, they will bind to ports beginning with port 4040 (4041, 4042, and so on).
The following screenshots display some of the information provided by the Web UI:
UI showing the Environment of the Spark Content
UI table showing Executors available
推薦閱讀
- 輕輕松松自動化測試
- AutoCAD繪圖實用速查通典
- Practical Ansible 2
- Java實用組件集
- 信息物理系統（CPS）測試與評價技術
- 基于神經網絡的監督和半監督學習方法與遙感圖像智能解譯
- 經典Java EE企業應用實戰
- 會聲會影X4中文版從入門到精通
- 工業機器人入門實用教程
- Machine Learning in Java
- Hands-On Geospatial Analysis with R and QGIS
- 網絡設備規劃、配置與管理大全（Cisco版）
- 三維動畫制作（3ds max7.0）
- 深度剖析：硬盤固件級數據恢復
- Building Virtual Pentesting Labs for Advanced Penetration Testing（Second Edition）