I have been working on a legacy datasource integration with data source V2
for the last couple of week including upgrading it to the Spark 2.4.0 RC.
During this process I wrote a tutorial with explanation on how to create a
new datasource (it can be found in
It is still a work in progress (still a lot of TODOs in it), however, I
figured others might find it useful.
I was wondering if there is some place in the spark documentation where we
can put something like this so this would continually update with the
ongoing changes to the API.
Of course, if I have mistakes in it (which I probably do), I would be happy
to learn of them…