[
https://issues.apache.org/jira/browse/FLUME-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299585#comment-14299585
]
Roshan Naik edited comment on FLUME-1734 at 1/31/15 2:37 AM:
-------------------------------------------------------------
[~hshreedharan] .. uploading patch v10b - rebased with flume-1.6 branch
was (Author: roshan_naik):
upload patch v10b - rebased with flume-1.6 branch
> Create a Hive Sink based on the new Hive Streaming support
> ----------------------------------------------------------
>
> Key: FLUME-1734
> URL: https://issues.apache.org/jira/browse/FLUME-1734
> Project: Flume
> Issue Type: New Feature
> Components: Sinks+Sources
> Affects Versions: v1.2.0
> Reporter: Roshan Naik
> Assignee: Roshan Naik
> Labels: features
> Attachments: FLUME-1734.draft.1.patch, FLUME-1734.draft.2.patch,
> FLUME-1734.v1.patch, FLUME-1734.v10.patch, FLUME-1734.v10b.patch,
> FLUME-1734.v2.patch, FLUME-1734.v4.patch, FLUME-1734.v5.patch,
> FLUME-1734.v6.patch, FLUME-1734.v7.patch, FLUME-1734.v8.patch,
> FLUME-1734.v9.patch
>
>
> Hive 0.13 has introduced Streaming support which is itself transactional in
> nature and fits well with Flume's transaction model.
> Short overview of Hive's Streaming support on which this sink is based can
> be found here:
> http://hive.apache.org/javadocs/r0.13.1/api/hcatalog/streaming/index.html
> This jira is for creating a sink that would continuously stream data into
> Hive tables using the above APIs. The primary goal being that the data
> streamed by the sink should be instantly queryable (using say Hive or Pig)
> without requiring additional post-processing steps on behalf of the users.
> Sink should manage the creation of new partitions periodically if needed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
