Write to same hdfs dir from multiple spark jobs

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Write to same hdfs dir from multiple spark jobs

Deepak Sharma
Hi
Is there any design pattern around writing to the same hdfs directory from multiple spark jobs?

--
Thanks
Deepak
www.bigdatabig.com