[
https://issues.apache.org/jira/browse/HUDI-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464516#comment-17464516
]
Forward Xu edited comment on HUDI-2661 at 12/24/21, 2:12 AM:
-------------------------------------------------------------
hi [~wordcount] [[email protected]] This problem, I also encountered in
the company's internal version, is caused by inconsistent Spark CatalogTable
parameters. You need to change the spark in hudi to be consistent with the
spark version used in your company's environment, and then compile it to solve
the problem. I found that the problem is spark2.4.6.
was (Author: x1q1j1):
hi [~wordcount] [[email protected]] This problem, I also encountered in
the company's internal version, is caused by inconsistent Spark CatalogTable
parameters. You need to change the spark in hudi to be consistent with the
spark version used in your company's environment, and then compile it to solve
the problem.
> java.lang.NoSuchMethodError:
> org.apache.spark.sql.catalyst.catalog.CatalogTable.copy
> ------------------------------------------------------------------------------------
>
> Key: HUDI-2661
> URL: https://issues.apache.org/jira/browse/HUDI-2661
> Project: Apache Hudi
> Issue Type: Bug
> Components: Spark Integration
> Affects Versions: 0.10.0
> Reporter: Changjun Zhang
> Assignee: Yann Byron
> Priority: Critical
> Fix For: 0.11.0
>
> Attachments: image-2021-11-01-21-47-44-538.png,
> image-2021-11-01-21-48-22-765.png
>
>
> Hudi Integrate with Spark SQL :
> when I add :
> {code:sh}
> // Some comments here
> spark-sql --conf
> 'spark.serializer=org.apache.spark.serializer.KryoSerializer' \
> --conf
> 'spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension'
> {code}
> to create a table on an existing hudi table:
> {code:sql}
> create table testdb.tb_hudi_operation_test using hudi
> location '/tmp/flinkdb/datas/tb_hudi_operation';
> {code}
> then throw Exception :
> !image-2021-11-01-21-47-44-538.png|thumbnail!
> !image-2021-11-01-21-48-22-765.png|thumbnail!
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
