- Mastering Apache Spark 2.x(Second Edition)
- Romeo Kienzler
- 69字
- 2021-07-02 18:55:33
How to optimize the Resolved Logical Execution Plan
The resolved LEP can now be optimized. This is done using a set of transformation rules.
Since a LEP is just a tree, the rules transform from one tree to another. This is done iteratively until no rule fires anymore and keeps the LEP stable and the process is finished. The result of this step is an Optimized Logical Execution Plan.