davidyuan1223 commented on PR #6980:
URL: https://github.com/apache/kyuubi/pull/6980#issuecomment-2748374165

   > @davidyuan1223 I don't understand what the exact issue is, we use Paimon 
spark 3-3 artifacts for testing, why ClassNotFoundException 
`org.apache.spark.sql.connector.catalog.Column`(introduced in Spark 3.5) is 
thrown? can you elaborate more about what the underlying happened? it's Kyuubi 
authz side issue or Paimon issue?
   
   this is the error trace(we only talk about spark3.3
   ```
     Cause: java.lang.ClassNotFoundException: 
org.apache.spark.sql.connector.catalog.Column
     at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
     at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
     at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
     at java.lang.Class.getDeclaredMethods0(Native Method)
     at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
     at java.lang.Class.getDeclaredMethod(Class.java:2128)
     at 
org.apache.kyuubi.util.reflect.DynMethods$Builder.hiddenImpl(DynMethods.java:408)
     at 
org.apache.kyuubi.util.reflect.DynMethods$Builder.hiddenImpl(DynMethods.java:429)
     at 
org.apache.kyuubi.util.reflect.ReflectUtils$.invokeAs(ReflectUtils.scala:81)
   ```
   this question, i think the root case is the ReflectUtils,which will execute 
reflect to find targetClass's method instance, in the moment, the code env is 
from our spark3.3 version, when call XXX.properties method, which need Column 
class, but in spark3.3 env, the Column not exists. Just like classLoader will 
first use the bootstrapClassLoader? i'm not sure, but i think the root cause 
may be the ReflectUtils


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org
For additional commands, e-mail: notifications-h...@kyuubi.apache.org

Reply via email to