marton-bod commented on pull request #1478: URL: https://github.com/apache/iceberg/pull/1478#issuecomment-695824861
In order to build `iceberg-mr`/`iceberg-mr-hive3`, we need to build the other iceberg subprojects with Hive3/Hadoop3 as well which `mr` depends on, such as `hive-metastore`, `core`, `parquet`, etc. For example, there is a metastore client API change between Hive2 and Hive3, therefore if we didn't build the `hive-metastore` module with Hive3, `mr` (with Hive3) would not be able to communicate with it. However, just to reiterate, the idea is that for the 'normal' gradle build, all modules will continue to be built using Hive2 just as before, with no changes. Only when specifying the `-Dhive3` flag to the build, will Hive3/Hadoop3 dependencies be used (and only a subset of modules will be built when this flag is enabled, only those modules that are ready for the Hive3-build - i.e. Spark and Flink excluded for now, although both Spark3 and Flink could be included at any point if the community agreed, since they pass all the tests) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
