Is SPARK-9961 is still relevant?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Is SPARK-9961 is still relevant?


Hi everyone,

I just encountered SPARK-9961 which seems to be largely outdated today.

In the latest releases majority of models computes different evaluation metrics exposed later through corresponding summaries.  At the same time such defaultEvaluator has little potential of being integrated with Spark ML tuning tools, which depend on  input and output columns, not input estimator.

Assuming that the answer is negative, and this ticket can be closed, should DeveloperApi annotations removed? If I understand this ticket correctly, planned defaultEvaluator was the primary reason to use such annotation there.

Best regards,