Apache Spark Developers List

This forum is an archive for the mailing list dev@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
12345 ... 193
Topics (6723)
Replies Last Post Views
[UPDATE] Apache Spark 3.1.0 Release Window by Dongjoon Hyun-2
2
by Michel Sumbul
Unit test failure in spark-core by Stephen Coy
1
by Stephen Coy
Official support of CREATE EXTERNAL TABLE by cloud0fan
12
by beliefer
[OSS DIGEST] The major changes of Apache Spark from July 1 to July 28 by Yuanjian Li
0
by Yuanjian Li
Mu-L/spark Github actions emails by Sean Owen-2
1
by Hyukjin Kwon
Broken rlang installation on AppVeyor by zero323
3
by Hyukjin Kwon
SQL DDL statements with replacing default catalog with custom catalog by Jungtaek Lim-2
9
by Jungtaek Lim-2
[Spark Docs]: Question about building docs including docs of internal packages by Omer Ozarslan
3
by Omer Ozarslan
Re: Apache Spark 3.1 Preparation Status (Oct. 2020) by Hyukjin Kwon
6
by Dongjoon Hyun-2
[FYI] Removing `spark-3.1.0-bin-hadoop2.7-hive1.2.tgz` from Apache Spark 3.1 distribution by Dongjoon Hyun-2
2
by Dongjoon Hyun-2
New ASF guidelines for docker images by Holden Karau
0
by Holden Karau
[FYI] Kubernetes GA Preparation (SPARK-33005) by Dongjoon Hyun-2
4
by Dongjoon Hyun-2
Spark 3.1 first RC date by Igor Dvorzhak
1
by Dongjoon Hyun-2
[DISCUSS][R] Adding magrittr as a dependency for SparkR by zero323
0
by zero323
AQE effectiveness by Koert Kuipers
5
by Koert Kuipers
[DISCUSS] "latestFirst" option and metadata growing issue in File stream source by Jungtaek Lim-2
9
by Jungtaek Lim-2
Output mode in Structured Streaming and DSv1 sink/DSv2 table by Jungtaek Lim-2
1
by Jungtaek Lim-2
get method guid prefix for file parts for write by gpongracz
4
by gpongracz
Running K8s integration tests for changes in core? by Holden Karau
10
by Hyukjin Kwon
[build system] downtime due to SSL cert errors by shane knapp ☠
1
by shane knapp ☠
Supporting Row and DataFrame level metadata? by Jeff Evans
0
by Jeff Evans
Test Failures on macOS 10.15.4 by EveLiao
0
by EveLiao
A common naming policy for third-party packages/modules under org.apache.spark? by Steve Loughran-2
4
by Sean Owen-2
Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter by JOAQUIN GUANTER GONZ...
8
by Cheng Su-2
Automatically mount the user-specific configurations on K8s cluster, using a config map. by Prashant Sharma
0
by Prashant Sharma
[RESULT] [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency by Mridul Muralidharan
0
by Mridul Muralidharan
[VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency by Mridul Muralidharan
16
by Mridul Muralidharan
Inconsistencies with how catalyst optimizer handles non-deterministic expressions by tanelk
0
by tanelk
Spark-Locality: Hinting Spark location of the executor does not take effect. by Nasrulla Khan Haris
5
by Nasrulla Khan Haris
Incorrect Scala version for Spark 2.4.x releases in the docs? by Jacek Laskowski
2
by Jacek Laskowski
Performance of VectorizedRleValuesReader by Chang Chen
6
by Mark Daniels
[DISCUSS] Time to evaluate "continuous mode" in SS? by Jungtaek Lim-2
8
by Cheng Su-2
Spark-Locality: Hinting Spark location of the executor does not take effect by Priyanka Gomatam
0
by Priyanka Gomatam
Query /Bug Spark Streaming / Context Cleaner/ GC question by Tarun
0
by Tarun
How to clear spark Shuffle files by lsn248
3
by lsn248
12345 ... 193