massdosage commented on issue #170: Add support for Iceberg MR / InputFormat and OutputFormat APIs URL: https://github.com/apache/incubator-iceberg/issues/170#issuecomment-594579042 Sure, we have some tickets indicating next steps and the Avro tie-in is something we're aware of and would like to sort out. @cmathiesen is working on https://github.com/ExpediaGroup/hiveberg/issues/3 right now, we would love input from others on this (and anything else in the current implementation). As for a `mapreduce` version, I'm not sure that's even possible with Hive 2? (see https://snippetessay.wordpress.com/2017/10/20/mapred-vs-mapreduce-the-api-question-of-hadoop-and-impact-on-the-ecosystem/). We tried that first and it didn't work so went for `mapred`, maybe `mapreduce` works with Hive 3? But yes, having the common logic somewhere and then wrappers for `mapred` and `mapreduce` sounds like a good idea. We don't currently have a SerDe but have a ticket for what we've thought of there so far - https://github.com/ExpediaGroup/hiveberg/issues/2
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
