Is CBO broken?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Is CBO broken?

emlyn
I was trying to enable CBO on one of our jobs (using Spark 2.3.1 with
partitioned parquet data) but it seemed that the rowCount statistics were
being ignored. I found this JIRA which seems to describe the same issue:
https://issues.apache.org/jira/browse/SPARK-25185, but it has no response so
far.

Does CBO work with partitioned parquet data, or is this a known issue? Is
there a workaround?

Thanks,
Emlyn



--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]