[
https://issues.apache.org/jira/browse/HUDI-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kate Huber updated HUDI-8404:
-----------------------------
Sprint: Hudi 1.0 Blockers+Bugs Sprint
> Drop table is broken for 1.0.0-beta2 with spark 3.5 minor release upgrade
> -------------------------------------------------------------------------
>
> Key: HUDI-8404
> URL: https://issues.apache.org/jira/browse/HUDI-8404
> Project: Apache Hudi
> Issue Type: Bug
> Components: spark-sql
> Reporter: Aditya Goenka
> Priority: Blocker
> Fix For: 1.0.0
>
>
> When we use DROP table SQL with spark 3.5.3, it fails with Exception -
> ```
> py4j.protocol.Py4JJavaError: An error occurred while calling o39.sql.
> : java.lang.NoSuchMethodError:
> org.apache.spark.sql.catalyst.catalog.SessionCatalog.invalidateCachedTable(Lorg/apache/spark/sql/catalyst/QualifiedTableName;)V
> at
> org.apache.spark.sql.hudi.command.DropHoodieTableCommand.run(DropHoodieTableCommand.scala:51)
> at
> org.apache.spark.sql.hudi.catalog.HoodieCatalog.dropTable(HoodieCatalog.scala:180)
> at
> org.apache.spark.sql.execution.datasources.v2.DropTableExec.run(DropTableExec.scala:38)
> at
> org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result$lzycompute(V2CommandExec.scala:43)
> at
> org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result(V2CommandExec.scala:43)
> at
> org.apache.spark.sql.execution.datasources.v2.V2CommandExec.executeCollect(V2CommandExec.scala:49)
> at
> org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.$anonfun$applyOrElse$1(QueryExecution.scala:107)
> ```
> The same thing works with spark 3.5.1
>
> Refer -
> https://github.com/apache/hudi/issues/12099
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
