[ 
https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750620#comment-13750620
 ] 

Sushanth Sowmyan commented on HIVE-4331:
----------------------------------------

[~ashutoshc] : The mapreduce->mapred transition is not a tough one by 
itself(apart from losing abort/commit semantics, which need to be emulated). 
The Outputcommitter concept is quite a bit more involved though.

For now, I'm still +1 on this patch(the hive side) because it moves us one step 
closer to that goal. I don't think we should require the OC concept being 
brought in as well for it to be committed, I brought that up because I wanted 
to highlight that we aren't done with this patch, and more work is required 
past it, and this patch alone does not make generic OFs workable from within 
Hive.

                
> Integrated StorageHandler for Hive and HCat using the HiveStorageHandler
> ------------------------------------------------------------------------
>
>                 Key: HIVE-4331
>                 URL: https://issues.apache.org/jira/browse/HIVE-4331
>             Project: Hive
>          Issue Type: Task
>          Components: HCatalog
>    Affects Versions: 0.11.0, 0.12.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Viraj Bhat
>         Attachments: HIVE4331_07-17.patch, StorageHandlerDesign_HIVE4331.pdf
>
>
> 1) Deprecate the HCatHBaseStorageHandler and "RevisionManager" from HCatalog. 
> These will now continue to function but internally they will use the 
> "DefaultStorageHandler" from Hive. They will be removed in future release of 
> Hive.
> 2) Design a HivePassThroughFormat so that any new StorageHandler in Hive will 
> bypass the HiveOutputFormat. We will use this class in Hive's 
> "HBaseStorageHandler" instead of the "HiveHBaseTableOutputFormat".
> 3) Write new unit tests in the HCat's "storagehandler" so that systems such 
> as Pig and Map Reduce can use the Hive's "HBaseStorageHandler" instead of the 
> "HCatHBaseStorageHandler".
> 4) Make sure all the old and new unit tests pass without backward 
> compatibility (except known issues as described in the Design Document).
> 5) Replace all instances of the HCat source code, which point to 
> "HCatStorageHandler" to use the"HiveStorageHandler" including the 
> "FosterStorageHandler".
> I have attached the design document for the same and will attach a patch to 
> this Jira.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to