GROUPING SETS as Dataset operator? Ordinals support?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
Report Content as Inappropriate

GROUPING SETS as Dataset operator? Ordinals support?

Jacek Laskowski

I've been learning myself GROUPING SETS in Spark SQL and noticed it's
only supported in SQL mode. I _think_ it could be reasonably easy to
add support as Dataset operator. Has this been ever considered? Would
it be considered a part of Spark 2.2+?

I also noticed there's support for ordinals in groupBy and orderBy,
but doesn't seem supported in GROUPING SETS.

What do you think about adding the features to Spark SQL?

Jacek Laskowski
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

To unsubscribe e-mail: [hidden email]