- Mastering Apache Spark 2.x(Second Edition)
- Romeo Kienzler
- 199字
- 2021-07-02 18:55:32
How to go from Unresolved Logical Execution Plan to Resolved Logical Execution Plan
The ULEP basically reflects the structure of an AST. So again, the AST is generated from the user's code implemented either on top of the relational API of DataFrames and Datasets or using SQL, or all three. This AST can be easily transformed into a ULEP. But, of course, a ULEP can't be executed. The first thing that is checked is if the referred relations exist in the catalog. This means all table names and fields expressed in the SQL statement or relational API have to exist. If the table (or relation) exists, the column names are verified. In addition, the column names that are referred to multiple times are given an alias in order to read them only once. This is already a first stage optimization taking place here. Finally, the data types of the columns are determined in order to check if the operations expressed on top of the columns are valid. So for example taking the sum of a string doesn't work and this error is already caught at this stage. The result of this operation is a Resolved Logical Execution Plan (LEP).
- Dynamics 365 for Finance and Operations Development Cookbook(Fourth Edition)
- Mastering ServiceStack
- Testing with JUnit
- Building a Game with Unity and Blender
- NumPy Essentials
- DevOps Automation Cookbook
- R語言編程指南
- 新編Premiere Pro CC從入門到精通
- 用Python實現深度學習框架
- QGIS By Example
- 學習正則表達式
- Visual Studio Code 權威指南
- MATLAB GUI純代碼編寫從入門到實戰
- Spring 5 Design Patterns
- Building Clouds with Windows Azure Pack