Chris Rasmussen created FLUME-2563:
--------------------------------------
Summary: HDFS Sink & Hive SequenceFile Format
Key: FLUME-2563
URL: https://issues.apache.org/jira/browse/FLUME-2563
Project: Flume
Issue Type: Wish
Components: Sinks+Sources
Affects Versions: v1.5.0
Environment: Linux Redhat, Cloudera 5.2 (and earlier)
Reporter: Chris Rasmussen
Priority: Minor
HDFS Sinks defined as a SequenceFile emit LongWritable as the output key
format. Hive emits ByteWritable as the output key format for sequence files.
If a MR job spans splits from Flume and Hive, it fails with a LongInteger
conversion error. Suggest creating a HDFS Sink property the allows setting
SequenceFile Key format in much the same way as hdfs.writeFormat allows setting
the value format.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
