Fw: A question about skew join hint

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Fw: A question about skew join hint

Mayank Pradhan-2
watch this thread folks. 

[hidden email] if you recall this is the same question I was asking you earlier.


From: zhangliyun <[hidden email]>
Sent: Monday, November 4, 2019 5:21 PM
To: Spark Dev List <[hidden email]>; [hidden email] <[hidden email]>
Subject: A question about skew join hint

Hi all:
  i saw skewed join hint optimization in  https://docs.azuredatabricks.net/delta/join-performance/skew-join.html.

it  is a great feature to help users to avoid the problem brought from skewed data. My question
1. which version we will have this ? i have not found the feature in the master branch by key word "+SKEW" 
2. the article is under Documentation -> Delta Lake->  Optimizations->  Optimize Join Performance -> Skew Join Optimization,
   is this feature  only in delta lake?

Best Regards
Kelly  Zhang