FYI: SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

FYI: SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

Dongjoon Hyun-2
Hi, All.

I want to share the following change to the community.

    SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

This is merged today and now Spark's `CREATE TABLE` is using Spark's default data sources instead of `hive` provider. This is a good and big improvement for Apache Spark 3.0, but this might surprise someone. (Please note that there is a fallback option for them.)

Thank you, Yi, Wenchen, Xiao.

Cheers,
Dongjoon.
Reply | Threaded
Open this post in threaded view
|

Re: FYI: SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

Takeshi Yamamuro
Oh, looks nice. Thanks for the sharing, Dongjoon

Bests,
Takeshi

On Sat, Dec 7, 2019 at 3:35 AM Dongjoon Hyun <[hidden email]> wrote:
Hi, All.

I want to share the following change to the community.

    SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

This is merged today and now Spark's `CREATE TABLE` is using Spark's default data sources instead of `hive` provider. This is a good and big improvement for Apache Spark 3.0, but this might surprise someone. (Please note that there is a fallback option for them.)

Thank you, Yi, Wenchen, Xiao.

Cheers,
Dongjoon.


--
---
Takeshi Yamamuro