ARTS - 2019 Week 8-1¶
There are a growing set of optimization mechanisms that allow you to achieve competitive SQL performance. Spark has extension points that help third parties to add customizations and optimizations without needing these optimizations to be merged into Apache Spark. This is very powerful and helps extensibility. We have added some enhancements to the existing extension points framework to enable some fine grained control. This talk will be a deep dive at the extension points that is available in Spark today. We will also talk about the enhancements to this API that we developed to help make this API more powerful. This talk will be of benefit to developers who are looking to customize Spark in their deployments.
扩展接口（Extension Points API）
- Spark 2.2 in SPARK-18127，SPARK-26249: API Enhancements
- 通过 SparkSessionExtensions，扩展 SparkSession
- Spark SQL：解析、分析、优化、策略、函数
- 通过 withExtensions 或
HBase Rowkey 设计¶