SPIP: Catalog API for view metadata

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

SPIP: Catalog API for view metadata

John Zhuge
Hi everyone,

In order to disassociate view metadata from Hive Metastore and support different storage backends, I am proposing a new view catalog API to load, create, alter, and drop views.

WIP PR: https://github.com/apache/spark/pull/28147

As part of a project to support common views across query engines like Spark and Presto, my team used the view catalog API in Spark implementation. The project has been in production over three months.

Thanks,
John Zhuge