viirya edited a comment on pull request #30657:
URL: https://github.com/apache/spark/pull/30657#issuecomment-741476895


   > @wangyum @viirya yes I was able to reproduce the same issue. I think it 
could be cause we have `RelCollationImpl` included in both `hive-exec` jar and 
`calcite-core` jar. Perhaps we should exclude the latter from the Hive binary 
distribution and classpath.
   > 
   > I'll update the release vote email thread and start a new RC once this is 
fixed.
   
   We have included `org.apache.calcite:*` in Hive shaded jar. The following 
error looks like there is other calcite jar in the classpath so it conflicts 
with the shaded calcite.
   
   ```
   Caused by: java.lang.NoSuchMethodError: 
org.apache.calcite.rel.RelCollationImpl.<init>(Lorg/apache/hive/com/google/common/collect/ImmutableList;)V
        at 
org.apache.hadoop.hive.ql.optimizer.calcite.HiveRelCollation.<init>(HiveRelCollation.java:29)
        at 
org.apache.hadoop.hive.ql.optimizer.calcite.RelOptHiveTable.getCollationList(RelOptHiveTable.java:181)
        at 
org.apache.calcite.rel.metadata.RelMdCollation.table(RelMdCollation.java:175)
   ```
   
   Do we know where it comes from?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to