Yann Byron created HUDI-3131:
--------------------------------

             Summary: Spark3.1.1 CTAS error
                 Key: HUDI-3131
                 URL: https://issues.apache.org/jira/browse/HUDI-3131
             Project: Apache Hudi
          Issue Type: Bug
          Components: Spark Integration
            Reporter: Yann Byron
             Fix For: 0.11.0, 0.10.1


Fail to run CTAS with Hudi0.10.0 and Spark3.1.1.

 

Sql:
{code:java}
create table h1_p using hudi partitioned by(dt) options(type = 'cow', 
primaryKey = 'id') as select '2021-05-07' as dt, 1 as id, 'a1' as name, 10 as 
price; {code}
Error:
{code:java}
java.lang.NoSuchMethodError: 
org.apache.spark.sql.catalyst.plans.logical.Command.producedAttributes$(Lorg/apache/spark/sql/catalyst/plans/logical/Command;)Lorg/apache/spark/sql/catalyst/expressions/AttributeSet;
    at 
org.apache.spark.sql.hudi.command.CreateHoodieTableAsSelectCommand.producedAttributes(CreateHoodieTableAsSelectCommand.scala:39)
 {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to