DataSourceV2 documentation & tutorial

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

DataSourceV2 documentation & tutorial

assaf.mendelson
Hi all,

I have been working on a legacy datasource integration with data source V2
for the last couple of week including upgrading it to the Spark 2.4.0 RC.

During this process I wrote a tutorial with explanation on how to create a
new datasource (it can be found in
https://github.com/assafmendelson/DataSourceV2).
It is still a work in progress (still a lot of TODOs in it), however, I
figured others might find it useful.

I was wondering if there is some place in the spark documentation where we
can put something like this so this would continually update with the
ongoing changes to the API.

Of course, if I have mistakes in it (which I probably do), I would be happy
to learn of them…

Thanks,
        Assaf




--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]