Re: [ANNOUNCE] Announcing Apache Spark 2.4.0

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Announcing Apache Spark 2.4.0

cloud0fan
resend

On Thu, Nov 8, 2018 at 11:02 PM Wenchen Fan <[hidden email]> wrote:


---------- Forwarded message ---------
From: Wenchen Fan <[hidden email]>
Date: Thu, Nov 8, 2018 at 10:55 PM
Subject: [ANNOUNCE] Announcing Apache Spark 2.4.0
To: Spark dev list <[hidden email]>


Hi all,

Apache Spark 2.4.0 is the fifth release in the 2.x line. This release adds Barrier Execution Mode for better integration with deep learning frameworks, introduces 30+ built-in and higher-order functions to deal with complex data type easier, improves the K8s integration, along with experimental Scala 2.12 support. Other major updates include the built-in Avro data source, Image data source, flexible streaming sinks, elimination of the 2GB block size limitation during transfer, Pandas UDF improvements. In addition, this release continues to focus on usability, stability, and polish while resolving around 1100 tickets.

We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have been possible without you.

To download Spark 2.4.0, head over to the download page: http://spark.apache.org/downloads.html


Thanks,
Wenchen

PS: If you see any issues with the release notes, webpage or published artifacts, please contact me directly off-list.
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Announcing Apache Spark 2.4.0

cloud0fan
+ user list

On Fri, Nov 9, 2018 at 2:20 AM Wenchen Fan <[hidden email]> wrote:
resend

On Thu, Nov 8, 2018 at 11:02 PM Wenchen Fan <[hidden email]> wrote:


---------- Forwarded message ---------
From: Wenchen Fan <[hidden email]>
Date: Thu, Nov 8, 2018 at 10:55 PM
Subject: [ANNOUNCE] Announcing Apache Spark 2.4.0
To: Spark dev list <[hidden email]>


Hi all,

Apache Spark 2.4.0 is the fifth release in the 2.x line. This release adds Barrier Execution Mode for better integration with deep learning frameworks, introduces 30+ built-in and higher-order functions to deal with complex data type easier, improves the K8s integration, along with experimental Scala 2.12 support. Other major updates include the built-in Avro data source, Image data source, flexible streaming sinks, elimination of the 2GB block size limitation during transfer, Pandas UDF improvements. In addition, this release continues to focus on usability, stability, and polish while resolving around 1100 tickets.

We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have been possible without you.

To download Spark 2.4.0, head over to the download page: http://spark.apache.org/downloads.html


Thanks,
Wenchen

PS: If you see any issues with the release notes, webpage or published artifacts, please contact me directly off-list.
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Announcing Apache Spark 2.4.0

Dongjoon Hyun-2
Finally, thank you all. Especially, thanks to the release manager, Wenchen!

Bests,
Dongjoon.


On Thu, Nov 8, 2018 at 11:24 AM Wenchen Fan <[hidden email]> wrote:
+ user list

On Fri, Nov 9, 2018 at 2:20 AM Wenchen Fan <[hidden email]> wrote:
resend

On Thu, Nov 8, 2018 at 11:02 PM Wenchen Fan <[hidden email]> wrote:


---------- Forwarded message ---------
From: Wenchen Fan <[hidden email]>
Date: Thu, Nov 8, 2018 at 10:55 PM
Subject: [ANNOUNCE] Announcing Apache Spark 2.4.0
To: Spark dev list <[hidden email]>


Hi all,

Apache Spark 2.4.0 is the fifth release in the 2.x line. This release adds Barrier Execution Mode for better integration with deep learning frameworks, introduces 30+ built-in and higher-order functions to deal with complex data type easier, improves the K8s integration, along with experimental Scala 2.12 support. Other major updates include the built-in Avro data source, Image data source, flexible streaming sinks, elimination of the 2GB block size limitation during transfer, Pandas UDF improvements. In addition, this release continues to focus on usability, stability, and polish while resolving around 1100 tickets.

We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have been possible without you.

To download Spark 2.4.0, head over to the download page: http://spark.apache.org/downloads.html


Thanks,
Wenchen

PS: If you see any issues with the release notes, webpage or published artifacts, please contact me directly off-list.
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Announcing Apache Spark 2.4.0

Jules Damji-2
Indeed! 

Sent from my iPhone
Pardon the dumb thumb typos :)

On Nov 8, 2018, at 11:31 AM, Dongjoon Hyun <[hidden email]> wrote:

Finally, thank you all. Especially, thanks to the release manager, Wenchen!

Bests,
Dongjoon.


On Thu, Nov 8, 2018 at 11:24 AM Wenchen Fan <[hidden email]> wrote:
+ user list

On Fri, Nov 9, 2018 at 2:20 AM Wenchen Fan <[hidden email]> wrote:
resend

On Thu, Nov 8, 2018 at 11:02 PM Wenchen Fan <[hidden email]> wrote:


---------- Forwarded message ---------
From: Wenchen Fan <[hidden email]>
Date: Thu, Nov 8, 2018 at 10:55 PM
Subject: [ANNOUNCE] Announcing Apache Spark 2.4.0
To: Spark dev list <[hidden email]>


Hi all,

Apache Spark 2.4.0 is the fifth release in the 2.x line. This release adds Barrier Execution Mode for better integration with deep learning frameworks, introduces 30+ built-in and higher-order functions to deal with complex data type easier, improves the K8s integration, along with experimental Scala 2.12 support. Other major updates include the built-in Avro data source, Image data source, flexible streaming sinks, elimination of the 2GB block size limitation during transfer, Pandas UDF improvements. In addition, this release continues to focus on usability, stability, and polish while resolving around 1100 tickets.

We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have been possible without you.

To download Spark 2.4.0, head over to the download page: http://spark.apache.org/downloads.html


Thanks,
Wenchen

PS: If you see any issues with the release notes, webpage or published artifacts, please contact me directly off-list.
Reply | Threaded
Open this post in threaded view
|

Re: [ANNOUNCE] Announcing Apache Spark 2.4.0

Stavros Kontopoulos-3
Awesome!

On Thu, Nov 8, 2018 at 9:36 PM, Jules Damji <[hidden email]> wrote:
Indeed! 

Sent from my iPhone
Pardon the dumb thumb typos :)

On Nov 8, 2018, at 11:31 AM, Dongjoon Hyun <[hidden email]> wrote:

Finally, thank you all. Especially, thanks to the release manager, Wenchen!

Bests,
Dongjoon.


On Thu, Nov 8, 2018 at 11:24 AM Wenchen Fan <[hidden email]> wrote:
+ user list

On Fri, Nov 9, 2018 at 2:20 AM Wenchen Fan <[hidden email]> wrote:
resend

On Thu, Nov 8, 2018 at 11:02 PM Wenchen Fan <[hidden email]> wrote:


---------- Forwarded message ---------
From: Wenchen Fan <[hidden email]>
Date: Thu, Nov 8, 2018 at 10:55 PM
Subject: [ANNOUNCE] Announcing Apache Spark 2.4.0
To: Spark dev list <[hidden email]>


Hi all,

Apache Spark 2.4.0 is the fifth release in the 2.x line. This release adds Barrier Execution Mode for better integration with deep learning frameworks, introduces 30+ built-in and higher-order functions to deal with complex data type easier, improves the K8s integration, along with experimental Scala 2.12 support. Other major updates include the built-in Avro data source, Image data source, flexible streaming sinks, elimination of the 2GB block size limitation during transfer, Pandas UDF improvements. In addition, this release continues to focus on usability, stability, and polish while resolving around 1100 tickets.

We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have been possible without you.

To download Spark 2.4.0, head over to the download page: http://spark.apache.org/downloads.html


Thanks,
Wenchen

PS: If you see any issues with the release notes, webpage or published artifacts, please contact me directly off-list.