How can I test the expense of serialization and deserialization in spark?

classic Classic list List threaded Threaded
1 message Options
163
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

How can I test the expense of serialization and deserialization in spark?

163
Hi, 
       How can I get the total expense of serialization and deserialization in spark?
       When I run an application, I only find “Task and Result Serialization Time” within Summary Metrics for ….Tasks   on Spark WebUI.
    Thank you.

wendy
2017.8.9
Loading...