Need to clean up temporary files created post dataframe deletion.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Need to clean up temporary files created post dataframe deletion.

Nasrulla Khan Haris

HI All,

 

I am new to apache spark core, I have custom datasource v2 connector for spark and I am looking for some suggestions deleting temp files created by the connector.

 

Any ideas would helpful.

 

Thanks for your help in advance.

Nasrulla