[ https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750620#comment-13750620 ]
Sushanth Sowmyan commented on HIVE-4331: ---------------------------------------- [~ashutoshc] : The mapreduce->mapred transition is not a tough one by itself(apart from losing abort/commit semantics, which need to be emulated). The Outputcommitter concept is quite a bit more involved though. For now, I'm still +1 on this patch(the hive side) because it moves us one step closer to that goal. I don't think we should require the OC concept being brought in as well for it to be committed, I brought that up because I wanted to highlight that we aren't done with this patch, and more work is required past it, and this patch alone does not make generic OFs workable from within Hive. > Integrated StorageHandler for Hive and HCat using the HiveStorageHandler > ------------------------------------------------------------------------ > > Key: HIVE-4331 > URL: https://issues.apache.org/jira/browse/HIVE-4331 > Project: Hive > Issue Type: Task > Components: HCatalog > Affects Versions: 0.11.0, 0.12.0 > Reporter: Ashutosh Chauhan > Assignee: Viraj Bhat > Attachments: HIVE4331_07-17.patch, StorageHandlerDesign_HIVE4331.pdf > > > 1) Deprecate the HCatHBaseStorageHandler and "RevisionManager" from HCatalog. > These will now continue to function but internally they will use the > "DefaultStorageHandler" from Hive. They will be removed in future release of > Hive. > 2) Design a HivePassThroughFormat so that any new StorageHandler in Hive will > bypass the HiveOutputFormat. We will use this class in Hive's > "HBaseStorageHandler" instead of the "HiveHBaseTableOutputFormat". > 3) Write new unit tests in the HCat's "storagehandler" so that systems such > as Pig and Map Reduce can use the Hive's "HBaseStorageHandler" instead of the > "HCatHBaseStorageHandler". > 4) Make sure all the old and new unit tests pass without backward > compatibility (except known issues as described in the Design Document). > 5) Replace all instances of the HCat source code, which point to > "HCatStorageHandler" to use the"HiveStorageHandler" including the > "FosterStorageHandler". > I have attached the design document for the same and will attach a patch to > this Jira. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira