To me, this is a bug. In a parallel system, the duration of a stage is often
determined by the slowest task/executor. To monitor/debug a skew issue, the
maximal value (or 100% percentile value) is more useful than the 95%
percentile value. I am happy to see that we do it right with Web UI. For
REST API, it should be consistent with Web UI.
--
Sent from:
http://apache-spark-developers-list.1001551.n3.nabble.com/---------------------------------------------------------------------
To unsubscribe e-mail:
[hidden email]