Apache Spark Developers List

This forum is an archive for the mailing list dev@spark.apache.org (more options) Messages posted here will be sent to this mailing list.

New Topic

People

12345 ... 192

Topics (6706)

Replies

Last Post

Views

Running K8s integration tests for changes in core? by Holden Karau

by Hyukjin Kwon

[build system] downtime due to SSL cert errors by shane knapp ☠

by shane knapp ☠

Supporting Row and DataFrame level metadata? by Jeff Evans

by Jeff Evans

Test Failures on macOS 10.15.4 by EveLiao

by EveLiao

A common naming policy for third-party packages/modules under org.apache.spark? by Steve Loughran-2

by Sean Owen-2

Avoiding unnnecessary sort in FileFormatWriter/DynamicPartitionDataWriter by JOAQUIN GUANTER GONZ...

by Cheng Su-2

Automatically mount the user-specific configurations on K8s cluster, using a config map. by Prashant Sharma

by Prashant Sharma

[RESULT] [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency by Mridul Muralidharan

by Mridul Muralidharan

[VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency by Mridul Muralidharan

by Mridul Muralidharan

Inconsistencies with how catalyst optimizer handles non-deterministic expressions by tanelk

by tanelk

Spark-Locality: Hinting Spark location of the executor does not take effect. by Nasrulla Khan Haris

by Nasrulla Khan Haris

Incorrect Scala version for Spark 2.4.x releases in the docs? by Jacek Laskowski

by Jacek Laskowski

Performance of VectorizedRleValuesReader by Chang Chen

by Mark Daniels

[DISCUSS] Time to evaluate "continuous mode" in SS? by Jungtaek Lim-2

by Cheng Su-2

Spark-Locality: Hinting Spark location of the executor does not take effect by Priyanka Gomatam

by Priyanka Gomatam

Query /Bug Spark Streaming / Context Cleaner/ GC question by Tarun

by Tarun

How to clear spark Shuffle files by lsn248

by lsn248

[SPARK SQL] Make max multi table join limit configurable in OptimizeSkewedJoin by Alfie Davidson

by Alfie Davidson

[VOTE][RESULT] Release Spark 2.4.7 (RC3) by Prashant Sharma

by Prashant Sharma

[ANNOUNCE] Announcing Apache Spark 2.4.7 by Prashant Sharma

by Prashant Sharma

[VOTE] Release Spark 2.4.7 (RC3) by Prashant Sharma

by Dongjoon Hyun-2

Re: [ANNOUNCE] Announcing Apache Spark 3.0.1 by Dongjoon Hyun-2

by Takeshi Yamamuro

[DISCUSS] Spark cannot identify the problem executor by 陈晓宇

by 陈晓宇

Contributing to JIRA Maintenance by Hyukjin Kwon

by EveLiao

Migrating BinaryFileFormat to DSv2? by Chao Sun

by Chao Sun

[DISCUSS] Reducing memory usage of toPandas with Arrow "self_destruct" option by David Li

by David Li

leveldbjni dependency by mundaym

by Sean Owen-2

For the same data source in two SQLs, how to read it once？ by Gang Li

by Gang Li

Question about differences between batch and streaming training of LogisticRegression Algorithm in Spark3.0 by cfangmac

by Sean Owen-2

SPIP: Catalog API for view metadata by John Zhuge

by John Zhuge

[VOTE] Release Spark 2.4.7 (RC1) by Prashant Sharma

by Micah Kornfield

[VOTE][RESULT] Release Spark 3.0.1 (RC3) by ruifengz

by ruifengz

[VOTE] Release Spark 3.0.1 (RC3) by ruifengz

by Dongjoon Hyun-2

is it possible to apply AQE rules only on some of nodes? by CodingCat

by CodingCat

pip/conda distribution headless mode by geoHeil

by Hyukjin Kwon

12345 ... 192