Apache Spark Developers List

This forum is an archive for the mailing list dev@spark.apache.org (more options) Messages posted here will be sent to this mailing list.

New Topic

People

12345 ... 193

Topics (6723)

Replies

Last Post

Views

[UPDATE] Apache Spark 3.1.0 Release Window by Dongjoon Hyun-2

by Michel Sumbul

Unit test failure in spark-core by Stephen Coy

by Stephen Coy

Official support of CREATE EXTERNAL TABLE by cloud0fan

by beliefer

[OSS DIGEST] The major changes of Apache Spark from July 1 to July 28 by Yuanjian Li

by Yuanjian Li

Mu-L/spark Github actions emails by Sean Owen-2

by Hyukjin Kwon

Broken rlang installation on AppVeyor by zero323

by Hyukjin Kwon

SQL DDL statements with replacing default catalog with custom catalog by Jungtaek Lim-2

by Jungtaek Lim-2

[Spark Docs]: Question about building docs including docs of internal packages by Omer Ozarslan

by Omer Ozarslan

Re: Apache Spark 3.1 Preparation Status (Oct. 2020) by Hyukjin Kwon

by Dongjoon Hyun-2

[FYI] Removing `spark-3.1.0-bin-hadoop2.7-hive1.2.tgz` from Apache Spark 3.1 distribution by Dongjoon Hyun-2

by Dongjoon Hyun-2

New ASF guidelines for docker images by Holden Karau

by Holden Karau

[FYI] Kubernetes GA Preparation (SPARK-33005) by Dongjoon Hyun-2

by Dongjoon Hyun-2

Spark 3.1 first RC date by Igor Dvorzhak

by Dongjoon Hyun-2

[DISCUSS][R] Adding magrittr as a dependency for SparkR by zero323

by zero323

AQE effectiveness by Koert Kuipers

by Koert Kuipers

[DISCUSS] "latestFirst" option and metadata growing issue in File stream source by Jungtaek Lim-2

by Jungtaek Lim-2

Output mode in Structured Streaming and DSv1 sink/DSv2 table by Jungtaek Lim-2

by Jungtaek Lim-2

get method guid prefix for file parts for write by gpongracz

by gpongracz

Running K8s integration tests for changes in core? by Holden Karau

by Hyukjin Kwon

[build system] downtime due to SSL cert errors by shane knapp ☠

by shane knapp ☠

Supporting Row and DataFrame level metadata? by Jeff Evans

by Jeff Evans

Test Failures on macOS 10.15.4 by EveLiao

by EveLiao

A common naming policy for third-party packages/modules under org.apache.spark? by Steve Loughran-2

by Sean Owen-2

Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter by JOAQUIN GUANTER GONZ...

by Cheng Su-2

Automatically mount the user-specific configurations on K8s cluster, using a config map. by Prashant Sharma

by Prashant Sharma

[RESULT] [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency by Mridul Muralidharan

by Mridul Muralidharan

[VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency by Mridul Muralidharan

by Mridul Muralidharan

Inconsistencies with how catalyst optimizer handles non-deterministic expressions by tanelk

by tanelk

Spark-Locality: Hinting Spark location of the executor does not take effect. by Nasrulla Khan Haris

by Nasrulla Khan Haris

Incorrect Scala version for Spark 2.4.x releases in the docs? by Jacek Laskowski

by Jacek Laskowski

Performance of VectorizedRleValuesReader by Chang Chen

by Mark Daniels

[DISCUSS] Time to evaluate "continuous mode" in SS? by Jungtaek Lim-2

by Cheng Su-2

Spark-Locality: Hinting Spark location of the executor does not take effect by Priyanka Gomatam

by Priyanka Gomatam

Query /Bug Spark Streaming / Context Cleaner/ GC question by Tarun

by Tarun

How to clear spark Shuffle files by lsn248

by lsn248

12345 ... 193