sachinmn2010 commented on PR #7088:
URL: https://github.com/apache/hudi/pull/7088#issuecomment-1438401766
@yihua I was also facing the issue HUDI-5092 while reading hudi table from
databricks using hudi bundle 0.11.1. I tried using the same databricks version
you mentioned above with hudi 12.2, but its still failing, could you please
help me with it?
Databricks Runtime : `11.3 LTS (includes Apache Spark 3.3.0, Scala 2.12)`
Hudi Spark bundle : `org.apache.hudi:hudi-spark3.3-bundle_2.12:0.12.2`
Error :
```
Py4JJavaError: An error occurred while calling o776.showString.
: java.lang.NoSuchMethodError:
org.apache.spark.sql.internal.SQLConf.parquetFilterPushDownStringStartWith()Z
at
org.apache.spark.sql.execution.datasources.parquet.Spark32PlusHoodieParquetFileFormat.buildReaderWithPartitionValues(Spark32PlusHoodieParquetFileFormat.scala:129)
at
org.apache.spark.sql.execution.datasources.parquet.HoodieParquetFileFormat.buildReaderWithPartitionValues(HoodieParquetFileFormat.scala:50)
at
org.apache.spark.sql.execution.FileSourceScanExec.inputRDD$lzycompute(DataSourceScanExec.scala:1914)
at
org.apache.spark.sql.execution.FileSourceScanExec.inputRDD(DataSourceScanExec.scala:1895)
at
org.apache.spark.sql.execution.FileSourceScanExec.doExecuteColumnar(DataSourceScanExec.scala:1970)
at
org.apache.spark.sql.execution.SparkPlan.$anonfun$executeColumnar$1(SparkPlan.scala:254)
at
org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:271)
at
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:165)
at
org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:267)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
