Aditya Goenka created HUDI-8404:
-----------------------------------
Summary: Drop table is broken for 1.0.0-beta2 with spark 3.5 minor
release upgrade
Key: HUDI-8404
URL: https://issues.apache.org/jira/browse/HUDI-8404
Project: Apache Hudi
Issue Type: Bug
Components: spark-sql
Reporter: Aditya Goenka
Fix For: 1.0.0
When we use DROP table SQL with spark 3.5.3, it fails with Exception -
```
py4j.protocol.Py4JJavaError: An error occurred while calling o39.sql.
: java.lang.NoSuchMethodError:
org.apache.spark.sql.catalyst.catalog.SessionCatalog.invalidateCachedTable(Lorg/apache/spark/sql/catalyst/QualifiedTableName;)V
at
org.apache.spark.sql.hudi.command.DropHoodieTableCommand.run(DropHoodieTableCommand.scala:51)
at
org.apache.spark.sql.hudi.catalog.HoodieCatalog.dropTable(HoodieCatalog.scala:180)
at
org.apache.spark.sql.execution.datasources.v2.DropTableExec.run(DropTableExec.scala:38)
at
org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result$lzycompute(V2CommandExec.scala:43)
at
org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result(V2CommandExec.scala:43)
at
org.apache.spark.sql.execution.datasources.v2.V2CommandExec.executeCollect(V2CommandExec.scala:49)
at
org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.$anonfun$applyOrElse$1(QueryExecution.scala:107)
```
The same thing works with spark 3.5.1
Refer -
https://github.com/apache/hudi/issues/12099
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
