Adaptive Query Execution(AQE) in Spark 3.0

Spark 3.0 released while ago. A bunch of new features are added in this new version of spark. One of the interesting features added is Adaptive Query Execution. Let’s look into AQE optimizations in this post. Dynamic Join Strategy Handling Skew Data Adaptive shuffle partitions Let’s look into each feature in detail. Dynamic Join Strategy: […]
Source: Imaginea

Leave a Reply

Your email address will not be published.