When we release a new version and we have some change in the Scala API, things start to randomly break for some users. For example, in version 0.44 we had a class DateUtils (used by class Utils, which is used by class FV in method add) that was dropped in version 0.45. When version 0.45 was released and a user called the method add in python API we got
java.lang.NoClassDefFoundError: Could not initialize class DateUtils
Basically, the python API is running the method add which contains a reference to class DateUtils(v0.44) but when it is actually going to load the needed class it doesn't find it, because the loaded jar is the v0.45 (as the ivy log shows when starting up the shell)
Do you have any idea of what the problem might be? Does maybe py4j cache something so that when upgrading the classes we get this error?