[VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

Xiangrui Meng-2
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

Jiang Xingbo
+1

2018-06-01 9:21 GMT-07:00 Xiangrui Meng <[hidden email]>:
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com


Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

Xiao Li
+1

2018-06-01 15:41 GMT-07:00 Xingbo Jiang <[hidden email]>:
+1

2018-06-01 9:21 GMT-07:00 Xiangrui Meng <[hidden email]>:
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com



Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

Weichen Xu
+1

On Fri, Jun 1, 2018 at 3:41 PM, Xiao Li <[hidden email]> wrote:
+1

2018-06-01 15:41 GMT-07:00 Xingbo Jiang <[hidden email]>:
+1

2018-06-01 9:21 GMT-07:00 Xiangrui Meng <[hidden email]>:
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com




Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

Joseph Bradley
+1

On Sun, Jun 3, 2018 at 9:59 AM, Weichen Xu <[hidden email]> wrote:
+1

On Fri, Jun 1, 2018 at 3:41 PM, Xiao Li <[hidden email]> wrote:
+1

2018-06-01 15:41 GMT-07:00 Xingbo Jiang <[hidden email]>:
+1

2018-06-01 9:21 GMT-07:00 Xiangrui Meng <[hidden email]>:
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com







--

Joseph Bradley

Software Engineer - Machine Learning

Databricks, Inc.

http://databricks.com

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

Henry Robinson
+1

(I hope there will be a fuller design document to review, since the SPIP is really light on details). 

On 4 June 2018 at 10:17, Joseph Bradley <[hidden email]> wrote:
+1

On Sun, Jun 3, 2018 at 9:59 AM, Weichen Xu <[hidden email]> wrote:
+1

On Fri, Jun 1, 2018 at 3:41 PM, Xiao Li <[hidden email]> wrote:
+1

2018-06-01 15:41 GMT-07:00 Xingbo Jiang <[hidden email]>:
+1

2018-06-01 9:21 GMT-07:00 Xiangrui Meng <[hidden email]>:
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com







--

Joseph Bradley

Software Engineer - Machine Learning

Databricks, Inc.

http://databricks.com


Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

cloud0fan
+1

On Tue, Jun 5, 2018 at 1:20 AM, Henry Robinson <[hidden email]> wrote:
+1

(I hope there will be a fuller design document to review, since the SPIP is really light on details). 

On 4 June 2018 at 10:17, Joseph Bradley <[hidden email]> wrote:
+1

On Sun, Jun 3, 2018 at 9:59 AM, Weichen Xu <[hidden email]> wrote:
+1

On Fri, Jun 1, 2018 at 3:41 PM, Xiao Li <[hidden email]> wrote:
+1

2018-06-01 15:41 GMT-07:00 Xingbo Jiang <[hidden email]>:
+1

2018-06-01 9:21 GMT-07:00 Xiangrui Meng <[hidden email]>:
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com







--

Joseph Bradley

Software Engineer - Machine Learning

Databricks, Inc.

http://databricks.com



Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] [SPARK-24374] SPIP: Support Barrier Scheduling in Apache Spark

Xiangrui Meng-2
+1 from myself.

The vote passed with the following +1s:

Susham kumar reddy Yerabolu
* Xingbo Jiang
* Xiao Li*
* Weichen Xu
* Joseph Bradley*
* Henry Robinson
* Xiangrui Meng*
* Wenchen Fan*

Henry, you can find a design sketch at https://issues.apache.org/jira/browse/SPARK-24375. To help discuss the design, Xingbo submitted a prototype PR today at https://github.com/apache/spark/pull/21494.

Best,
Xiangrui 

On Mon, Jun 4, 2018 at 12:41 PM Wenchen Fan <[hidden email]> wrote:
+1

On Tue, Jun 5, 2018 at 1:20 AM, Henry Robinson <[hidden email]> wrote:
+1

(I hope there will be a fuller design document to review, since the SPIP is really light on details). 

On 4 June 2018 at 10:17, Joseph Bradley <[hidden email]> wrote:
+1

On Sun, Jun 3, 2018 at 9:59 AM, Weichen Xu <[hidden email]> wrote:
+1

On Fri, Jun 1, 2018 at 3:41 PM, Xiao Li <[hidden email]> wrote:
+1

2018-06-01 15:41 GMT-07:00 Xingbo Jiang <[hidden email]>:
+1

2018-06-01 9:21 GMT-07:00 Xiangrui Meng <[hidden email]>:
Hi all,

I want to call for a vote of SPARK-24374. It introduces a new execution mode to Spark, which would help both integration with external DL/AI frameworks and MLlib algorithm performance. This is one of the follow-ups from a previous discussion on dev@.

The vote will be up for the next 72 hours. Please reply with your vote:

+1: Yeah, let's go forward and implement the SPIP.
+0: Don't really care.
-1: I don't think this is a good idea because of the following technical reasons.

Best,
Xiangrui
--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com







--

Joseph Bradley

Software Engineer - Machine Learning

Databricks, Inc.

http://databricks.com



--

Xiangrui Meng

Software Engineer

Databricks Inc. http://databricks.com