chinaboyll commented on issue #2344: URL: https://github.com/apache/iceberg/issues/2344#issuecomment-801594486
> That looks like an actual Spark Class is not missing, are you sure your deployment is setup correctly? > > The method is introduced here > [apache/spark@7cfd589](https://github.com/apache/spark/commit/7cfd589868b8430bc79e28e4d547008b222781a5) - Which is in 3.0.0 > > https://github.com/apache/spark/blob/v3.0.2/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala#L356 > > So unless v2Commands's generated classes were not on your classpath I wouldn't expect to see this error. Is it possible you have multiple competing Spark libraries on the classpath? i don't think Spark libraries is conflict，and demo is from http://iceberg.apache.org/spark-writes/#merge-into I have already run : use zdm to V2 , and i can use insert/overwrite, but merge and call is error. I thought SQL Extensions was wrong,It didn't load successfully, but i look yarn-ui-application-Environment- Spark Properties-spark.sql.extensions is org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions。it's load successfully。 阿西吧~ ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
