Hi all,

When i use Flume-OG, hdfs sink will get full event like follow text.

head -1 varnishncsa.log | python -mjson.tool
{
    "body": "xxxxxxxxx",
    "fields": {
        "rolltag": "20120427-234205010-0400.418723114906325.00004966",
        "tailSrcFile": "varnishncsa.log"
    },
    "host": "ip-10-170-147-62.compute.internal",
    "nanos": 5164871621338860,
    "pri": "INFO",
    "timestamp": 1335584717134
}
But when i using flume-NG. If i’m use a logger sink, it will give me full 
event, like bellow.

collector config:

agent.sinks.hdfs-write.type = logger
agent config:

agent.sources.exec-agent.interceptors.hostname.type = 
org.apache.flume.interceptor.HostInterceptor$Builder
agent.sources.exec-agent.interceptors.hostname.preserveExisting = true
agent.sources.exec-agent.interceptors.hostname.useIP = false
12/09/01 07:51:41 INFO sink.LoggerSink: Event: { 
headers:{timestamp=1346485898919, host=ip-10-34-4-55.ec2.internal} body: 61 61 
61 61 61 61 61 61 61 61 61 61 61 61 61 61 aaaaaaaaaaaaaaaa }

But when i use hdfs sink, i can’t get the full event, thanks in advance for any 
help.

Thanks, 
- Kevin

Reply via email to