marton-bod edited a comment on pull request #1478: URL: https://github.com/apache/iceberg/pull/1478#issuecomment-695824861
In order to build iceberg-mr/iceberg-mr-hive3, we need to build the other iceberg subprojects with Hive3/Hadoop3 as well which mr depends on, such as hive-metastore, core, parquet, etc. For example, there is an HMSHandler API change between Hive2 and Hive3, therefore if we didn't build the hive-metastore module with Hive3, mr (with Hive3) would not be able to communicate with it. However, just to reiterate, the idea is that for the 'normal' gradle build, all modules will continue to be built using Hive2/Hadoop2 just as before, with no changes. Only when specifying the `-Dhive3` flag to the build, will Hive3/Hadoop3 dependencies be used (and when this flag's enabled, only those modules are included that are ready for the Hive3-build - i.e. Spark and Flink excluded for now, although they can also be added by the community whenever suitable) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
