New metrics for WindowExec with number of partitions and frames?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

New metrics for WindowExec with number of partitions and frames?

Jacek Laskowski
Hi,

Currently WindowExec gives no metrics in the web UI's Details for Query page.

What do you think about adding the number of partitions and frames?
That could certainly be super useful, but am unsure if that's the kind
of metrics Spark SQL shows in the details.

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: New metrics for WindowExec with number of partitions and frames?

rxin
That would be useful (number of partitions).

On Fri, May 26, 2017 at 3:24 PM Jacek Laskowski <[hidden email]> wrote:
Hi,

Currently WindowExec gives no metrics in the web UI's Details for Query page.

What do you think about adding the number of partitions and frames?
That could certainly be super useful, but am unsure if that's the kind
of metrics Spark SQL shows in the details.

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Loading...