Control stderr file size in Standalone Cluster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Control stderr file size in Standalone Cluster

fattahsafa
hi,

Is there any way to control the stderr file max size when running Spark in Standalone Cluster mode? The file size becomes huge for every workers and makes the disk run out of space.
If there is no way to do that, can I disable it?

Thanks,
Abed.
Loading...