Release Apache Spark 2.4.4

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

Release Apache Spark 2.4.4

Dongjoon Hyun-2
Hi, All.

Spark 2.4.3 was released three months ago (8th May).
As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.

It would be great if we can have Spark 2.4.4.
Shall we start `2.4.4 RC1` next Monday (19th August)?

Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
Please let me know if there is another issue.

Thanks,
Dongjoon.
Reply | Threaded
Open this post in threaded view
|

Re: Release Apache Spark 2.4.4

DB Tsai-6
+1

On Tue, Aug 13, 2019 at 4:16 PM Dongjoon Hyun <[hidden email]> wrote:

>
> Hi, All.
>
> Spark 2.4.3 was released three months ago (8th May).
> As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.
>
> It would be great if we can have Spark 2.4.4.
> Shall we start `2.4.4 RC1` next Monday (19th August)?
>
> Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
> Please let me know if there is another issue.
>
> Thanks,
> Dongjoon.

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Release Apache Spark 2.4.4

Sean Owen-2
In reply to this post by Dongjoon Hyun-2
Seems fine to me if there are enough valuable fixes to justify another
release. If there are any other important fixes imminent, it's fine to
wait for those.


On Tue, Aug 13, 2019 at 6:16 PM Dongjoon Hyun <[hidden email]> wrote:

>
> Hi, All.
>
> Spark 2.4.3 was released three months ago (8th May).
> As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.
>
> It would be great if we can have Spark 2.4.4.
> Shall we start `2.4.4 RC1` next Monday (19th August)?
>
> Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
> Please let me know if there is another issue.
>
> Thanks,
> Dongjoon.

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Release Apache Spark 2.4.4

Dongjoon Hyun-2
Thank you, DB, Takeshi, Hyukjin, Sean, Kazuaki, Holden, Wenchen!
I'll create tag for 2.4.4-rc1 next Monday.

For SPARK-27234, it looks like that to me, too.

Thanks,
Dongjoon.


On Wed, Aug 14, 2019 at 9:13 AM Holden Karau <[hidden email]> wrote:
That looks like more of a feature than a bug fix unless I’m missing something?

On Tue, Aug 13, 2019 at 11:58 PM Hyukjin Kwon <[hidden email]> wrote:
Adding Shixiong

WDYT?

2019년 8월 14일 (수) 오후 2:30, Terry Kim <[hidden email]>님이 작성:

On Tue, Aug 13, 2019 at 10:24 PM Wenchen Fan <[hidden email]> wrote:
+1

On Wed, Aug 14, 2019 at 12:52 PM Holden Karau <[hidden email]> wrote:
+1
Does anyone have any critical fixes they’d like to see in 2.4.4?

On Tue, Aug 13, 2019 at 5:22 PM Sean Owen <[hidden email]> wrote:
Seems fine to me if there are enough valuable fixes to justify another
release. If there are any other important fixes imminent, it's fine to
wait for those.


On Tue, Aug 13, 2019 at 6:16 PM Dongjoon Hyun <[hidden email]> wrote:
>
> Hi, All.
>
> Spark 2.4.3 was released three months ago (8th May).
> As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.
>
> It would be great if we can have Spark 2.4.4.
> Shall we start `2.4.4 RC1` next Monday (19th August)?
>
> Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
> Please let me know if there is another issue.
>
> Thanks,
> Dongjoon.

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 
--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 
Reply | Threaded
Open this post in threaded view
|

Re: Release Apache Spark 2.4.4

Sean Owen-2
In reply to this post by Dongjoon Hyun-2
While we're on the topic:

In theory, branch 2.3 is meant to be unsupported as of right about now.

There are 69 fixes in branch 2.3 since 2.3.3 was released in Februrary:
https://issues.apache.org/jira/projects/SPARK/versions/12344844

Some look moderately important.

Should we also, or first, cut 2.3.4 to end the 2.3.x line?

On Tue, Aug 13, 2019 at 6:16 PM Dongjoon Hyun <[hidden email]> wrote:

>
> Hi, All.
>
> Spark 2.4.3 was released three months ago (8th May).
> As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.
>
> It would be great if we can have Spark 2.4.4.
> Shall we start `2.4.4 RC1` next Monday (19th August)?
>
> Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
> Please let me know if there is another issue.
>
> Thanks,
> Dongjoon.

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Release Apache Spark 2.4.4

Dongjoon Hyun-2
+1 for that.

Kazuaki volunteered for 2.3.4 release last month. AFAIK, he has been preparing that.


I believe we can handle them after 2.4.4 RC1 (or concurrently.)

Hi, Kazuaki.
Could you start a separate email thread for 2.3.4 release?

Bests,
Dongjoon.


On Thu, Aug 15, 2019 at 8:43 AM Sean Owen <[hidden email]> wrote:
While we're on the topic:

In theory, branch 2.3 is meant to be unsupported as of right about now.

There are 69 fixes in branch 2.3 since 2.3.3 was released in Februrary:
https://issues.apache.org/jira/projects/SPARK/versions/12344844

Some look moderately important.

Should we also, or first, cut 2.3.4 to end the 2.3.x line?

On Tue, Aug 13, 2019 at 6:16 PM Dongjoon Hyun <[hidden email]> wrote:
>
> Hi, All.
>
> Spark 2.4.3 was released three months ago (8th May).
> As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.
>
> It would be great if we can have Spark 2.4.4.
> Shall we start `2.4.4 RC1` next Monday (19th August)?
>
> Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
> Please let me know if there is another issue.
>
> Thanks,
> Dongjoon.
Reply | Threaded
Open this post in threaded view
|

Re: Release Apache Spark 2.4.4

Kazuaki Ishizaki
Sure, I will launch a separate e-mail thread for discussing 2.3.4 later.

Regards,

Kazuaki Ishizaki, Ph.D.



From:        Dongjoon Hyun <[hidden email]>
To:        Sean Owen <[hidden email]>, Kazuaki Ishizaki <[hidden email]>
Cc:        dev <[hidden email]>
Date:        2019/08/16 05:10
Subject:        [EXTERNAL] Re: Release Apache Spark 2.4.4




+1 for that.

Kazuaki volunteered for 2.3.4 release last month. AFAIK, he has been preparing that.

    - https://lists.apache.org/thread.html/6fafeefb7715e8764ccfe5d30c90d7444378b5f4f383ec95e2f1d7de@%3Cdev.spark.apache.org%3E

I believe we can handle them after 2.4.4 RC1 (or concurrently.)

Hi, Kazuaki.
Could you start a separate email thread for 2.3.4 release?

Bests,
Dongjoon.


On Thu, Aug 15, 2019 at 8:43 AM Sean Owen <[hidden email]> wrote:
While we're on the topic:

In theory, branch 2.3 is meant to be unsupported as of right about now.

There are 69 fixes in branch 2.3 since 2.3.3 was released in Februrary:

https://issues.apache.org/jira/projects/SPARK/versions/12344844

Some look moderately important.

Should we also, or first, cut 2.3.4 to end the 2.3.x line?

On Tue, Aug 13, 2019 at 6:16 PM Dongjoon Hyun <
[hidden email]> wrote:

>
> Hi, All.
>
> Spark 2.4.3 was released three months ago (8th May).
> As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.
>
> It would be great if we can have Spark 2.4.4.
> Shall we start `2.4.4 RC1` next Monday (19th August)?
>
> Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
> Please let me know if there is another issue.
>
> Thanks,
> Dongjoon.

Reply | Threaded
Open this post in threaded view
|

Re: Release Apache Spark 2.4.4

Dongjoon Hyun-2
Thank you, Kazuaki.

Bests,
Dongjoon.

On Fri, Aug 16, 2019 at 3:10 AM Kazuaki Ishizaki <[hidden email]> wrote:
Sure, I will launch a separate e-mail thread for discussing 2.3.4 later.

Regards,

Kazuaki Ishizaki, Ph.D.



From:        Dongjoon Hyun <[hidden email]>
To:        Sean Owen <[hidden email]>, Kazuaki Ishizaki <[hidden email]>
Cc:        dev <[hidden email]>
Date:        2019/08/16 05:10
Subject:        [EXTERNAL] Re: Release Apache Spark 2.4.4




+1 for that.

Kazuaki volunteered for 2.3.4 release last month. AFAIK, he has been preparing that.

    - https://lists.apache.org/thread.html/6fafeefb7715e8764ccfe5d30c90d7444378b5f4f383ec95e2f1d7de@%3Cdev.spark.apache.org%3E

I believe we can handle them after 2.4.4 RC1 (or concurrently.)

Hi, Kazuaki.
Could you start a separate email thread for 2.3.4 release?

Bests,
Dongjoon.


On Thu, Aug 15, 2019 at 8:43 AM Sean Owen <[hidden email]> wrote:
While we're on the topic:

In theory, branch 2.3 is meant to be unsupported as of right about now.

There are 69 fixes in branch 2.3 since 2.3.3 was released in Februrary:

https://issues.apache.org/jira/projects/SPARK/versions/12344844

Some look moderately important.

Should we also, or first, cut 2.3.4 to end the 2.3.x line?

On Tue, Aug 13, 2019 at 6:16 PM Dongjoon Hyun <
[hidden email]> wrote:

>
> Hi, All.
>
> Spark 2.4.3 was released three months ago (8th May).
> As of today (13th August), there are 112 commits (75 JIRAs) in `branch-24` since 2.4.3.
>
> It would be great if we can have Spark 2.4.4.
> Shall we start `2.4.4 RC1` next Monday (19th August)?
>
> Last time, there was a request for K8s issue and now I'm waiting for SPARK-27900.
> Please let me know if there is another issue.
>
> Thanks,
> Dongjoon.