I was trying to enable CBO on one of our jobs (using Spark 2.3.1 with
partitioned parquet data) but it seemed that the rowCount statistics were
being ignored. I found this JIRA which seems to describe the same issue:
https://issues.apache.org/jira/browse/SPARK-25185, but it has no response so
Does CBO work with partitioned parquet data, or is this a known issue? Is
there a workaround?