teabot commented on issue #170: Add support for Iceberg MR / InputFormat and OutputFormat APIs URL: https://github.com/apache/incubator-iceberg/issues/170#issuecomment-594589426 > Sure, we have some tickets indicating next steps and the Avro tie-in is something we're aware of and would like to sort out. @cmathiesen is working on [ExpediaGroup/hiveberg#3](https://github.com/ExpediaGroup/hiveberg/issues/3) right now, we would love input from others on this (and anything else in the current implementation). > > As for a `mapreduce` version, I'm not sure that's even possible with Hive 2? (see https://snippetessay.wordpress.com/2017/10/20/mapred-vs-mapreduce-the-api-question-of-hadoop-and-impact-on-the-ecosystem/). We tried that first and it didn't work so went for `mapred`, maybe `mapreduce` works with Hive 3? But yes, having the common logic somewhere and then wrappers for `mapred` and `mapreduce` sounds like a good idea. > > We don't currently have a SerDe but have a ticket for what we've thought of there so far - [ExpediaGroup/hiveberg#2](https://github.com/ExpediaGroup/hiveberg/issues/2) To be clear, we currently use the standard `AvroSerDe` as we could start with this 'out of the box', however we will clearly need to implement an Iceberg specific SerDe.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
