CR for adding bucket join support to V2 Datasources

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

CR for adding bucket join support to V2 Datasources

Long, Andrew-2

Hey Friends,

 

I recently created a pull request to add an optional support for bucket joins to V2 Datasources, via a concrete class representing the Spark Style ash Partitioning. If anyone has some free time Id appreciate a code review.  This also adds a concrete implementation of V2 ClusteredDistribution to make specifying Clustered Distributionseasier.

 

https://github.com/apache/spark/pull/26511

 

Cheers Andrew