It’s time to submit our quarterly report to the ASF board again this Wednesday. Here is my draft about what’s new — feel free to suggest changes.
Apache Spark is a fast and general engine for large-scale data processing. It offers high-level APIs in Java, Scala, Python and R as well as a rich set of libraries including stream processing, machine learning, and graph analytics.
- Discussions are continuing about our next feature release, which will likely be Spark 3.0, on the dev and user mailing lists. Some key questions include whether to remove various deprecated APIs, and which minimum versions of Java, Python, Scala, etc to support. There are also a number of new features targeting this release. We encourage everyone in the community to give feedback on these discussions through our mailing lists or issue tracker.
- We announced a plan to stop supporting Python 2 in our next major release,
as many other projects in the Python ecosystem are now dropping support