Could you please suggest me, what is best approach.
As HDP doesn't have Spark 2.4.2 available so I can't change the infrastructure, Is there any way to use Delta.io on Spark 2.3.1 as I have existing codebase written for last year and half in Scala 2.11 which also I don't want to break with Scala 2.12.
I don't need versioning, transaction log at parquet. So if anything else fits to my use case. Please do advise.