massdosage commented on issue #170: Add support for Iceberg MR / InputFormat and OutputFormat APIs URL: https://github.com/apache/incubator-iceberg/issues/170#issuecomment-594028819 Hey there, along with @teabot and @cmathiesen we've started working on this and have managed to get the read path working from Hive on an Iceberg table using an InputFormat. We had to make quite a few changes to the original patch as it was using a different Hive API to that one that appears to be in use in Hive 2.x. Maybe it was targetting Hive 3.x? We have run into a number of issues with version conflicts between Hive, Spark, Iceberg, Guava and Avro but managed to get it working as a separate (Maven) project. We attempted to integrate it with Iceberg as a new module (although maybe adding it to the existing iceberg-hive would be better) but couldn't get Gradle to isolate the versions for just the new subproject. We'd be happy to share what we've done so far, we just need to figure out where best to put it so others can take a look.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
