rdsr commented on a change in pull request #843: [WIP] InputFormat support for
Iceberg
URL: https://github.com/apache/incubator-iceberg/pull/843#discussion_r396172831
##########
File path: build.gradle
##########
@@ -219,6 +219,58 @@ project(':iceberg-hive') {
}
}
+project(':iceberg-mr') {
+ dependencies {
+ compile project(':iceberg-api')
+ compile project(':iceberg-core')
+ compile project(':iceberg-orc')
+ compile project(':iceberg-parquet')
+ compile project(':iceberg-data')
+
+ compileOnly("org.apache.hadoop:hadoop-client") {
+ exclude group: 'org.apache.avro', module: 'avro'
+ }
+
+ testCompile project(':iceberg-hive')
+ testCompile project(path: ':iceberg-data', configuration: 'testArtifacts')
+ testCompile project(path: ':iceberg-hive', configuration: 'testArtifacts')
+ testCompile project(path: ':iceberg-api', configuration: 'testArtifacts')
+ testCompile project(path: ':iceberg-core', configuration: 'testArtifacts')
+
+ // By default, hive-exec is a fat/uber jar and it exports a guava library
+ // that's really old. We use the core classifier to be able to override
our guava
+ // version. Luckily, hive-exec seems to work okay so far with this version
of guava
+ // See: https://github.com/apache/hive/blob/master/ql/pom.xml#L911 for
more context.
+ testCompile("org.apache.hive:hive-exec::core") {
Review comment:
I'l also worried that iceberg-hive in test scope can create a circular dep.
Maybe we can just test with `HadoopCatalog` ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
