davidyuan1223 commented on PR #6980: URL: https://github.com/apache/kyuubi/pull/6980#issuecomment-2748374165
> @davidyuan1223 I don't understand what the exact issue is, we use Paimon spark 3-3 artifacts for testing, why ClassNotFoundException `org.apache.spark.sql.connector.catalog.Column`(introduced in Spark 3.5) is thrown? can you elaborate more about what the underlying happened? it's Kyuubi authz side issue or Paimon issue? this is the error trace(we only talk about spark3.3 ``` Cause: java.lang.ClassNotFoundException: org.apache.spark.sql.connector.catalog.Column at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2701) at java.lang.Class.getDeclaredMethod(Class.java:2128) at org.apache.kyuubi.util.reflect.DynMethods$Builder.hiddenImpl(DynMethods.java:408) at org.apache.kyuubi.util.reflect.DynMethods$Builder.hiddenImpl(DynMethods.java:429) at org.apache.kyuubi.util.reflect.ReflectUtils$.invokeAs(ReflectUtils.scala:81) ``` this question, i think the root case is the ReflectUtils,which will execute reflect to find targetClass's method instance, in the moment, the code env is from our spark3.3 version, when call XXX.properties method, which need Column class, but in spark3.3 env, the Column not exists. Just like classLoader will first use the bootstrapClassLoader? i'm not sure, but i think the root cause may be the ReflectUtils -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org For additional commands, e-mail: notifications-h...@kyuubi.apache.org