[DISCUSS][SQL] Improve Performance of AggregationIterator

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[DISCUSS][SQL] Improve Performance of AggregationIterator

Chang Chen
Hi Spark Developers

We are implementing a new TypedImperativeAggregate which will benefit from batch to batch update or merge. And at least, in the Sort based aggregation,  we can process inputs batch to batch.

Does anyone do the same optimization?