

Work & Practices

ETL & DW

Tuning

Spark

• Spark 性能调优总结

Optimizer

• RBO(Rule)
• CBO(Cost)
• HBO(History)
• ABO(Adaptive)

Data Governance（Table & Column -> Lineage & Impact -> Data Graph）

• Atlas
• Sentry
• WhereHows
• Spline

Performance（Metrics、Heuristics）

• Dr. Elephant
• Sparklint
• SparkOscope
• Sparklens
• SparkMeasure
• DRIVEN

Reference