- Mastering Machine Learning with Spark 2.x
- Alex Tellez Max Pumperla Michal Malohlava
- 276字
- 2021-07-02 18:46:05
Inside the box
So, you have downloaded the latest version of Spark (depending on how you plan on launching Spark) and you have run the standard Hello, World! example....what now?!
Spark comes equipped with five libraries, which can be used separately--or in unison--depending on the task we are trying to solve. Note that in this book, we plan on using a variety of different libraries, all within the same application so that you will have the maximum exposure to the Spark platform and better understand the benefits (and limitations) of each library. These five libraries are as follows:
- Core: This is the Spark core infrastructure, providing primitives to represent and store data called Resilient Distributed Dataset (RDDs) and manipulate data with tasks and jobs.
- SQL : This library provides user-friendly API over core RDDs by introducing DataFrames and SQL to manipulate with the data stored.
- MLlib (Machine Learning Library) : This is Spark's very own machine learning library of algorithms developed in-house that can be used within your Spark application.
- Graphx : This is used for graphs and graph-calculations; we will explore this particular library in depth in a later chapter.
- Streaming : This library allows real-time streaming of data from various sources, such as Kafka, Twitter, Flume, and TCP sockets, to name a few. Many of the applications we will build in this book will leverage the MLlib and Streaming libraries to build our applications.

The Spark platform can also be extended by third-party packages. There are many of them, for example, support for reading CSV or Avro files, integration with Redshift, and Sparkling Water, which encapsulates the H2O machine learning library.
- UI設計基礎培訓教程
- LabVIEW Graphical Programming Cookbook
- Windows系統管理與服務配置
- Mastering QGIS
- PHP+MySQL+Dreamweaver動態網站開發實例教程
- Oracle Database 12c Security Cookbook
- Visual Basic學習手冊
- Go語言開發實戰(慕課版)
- JBoss:Developer's Guide
- Illustrator CS6設計與應用任務教程
- 從零開始學UI:概念解析、實戰提高、突破規則
- 信息學奧林匹克競賽初賽精講精練
- Python繪圖指南:分形與數據可視化(全彩)
- 3D Printing Designs:Design an SD Card Holder
- Scala編程(第4版)