When will spark 2.0 support dataset python API?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

When will spark 2.0 support dataset python API?

Cyanny LIANG
Hi,
Since DataSet API has become a common way to process structured data in spark 2.0, and Scala , Java API support dataset now, and When will python dataset API release? or are there some plans?
Consider that, in our production environment, many users love to use python API, which has many machine learning tools, so python DataSet API will be very helpful for us. Really looking forward to it.
I searched some jira issues about this:

it said, python API will be supported in spark 2.0

--
Best & Regards
Cyanny LIANG
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: When will spark 2.0 support dataset python API?

cloud0fan
We tried but didn’t get much benefits from Python Dataset, as Python is dynamic typed and there is not much we can do to optimize running python functions.

On 31 May 2017, at 3:36 AM, Cyanny LIANG <[hidden email]> wrote:

Hi,
Since DataSet API has become a common way to process structured data in spark 2.0, and Scala , Java API support dataset now, and When will python dataset API release? or are there some plans?
Consider that, in our production environment, many users love to use python API, which has many machine learning tools, so python DataSet API will be very helpful for us. Really looking forward to it.
I searched some jira issues about this:

it said, python API will be supported in spark 2.0

--
Best & Regards
Cyanny LIANG

Loading...