Hi,
I facing an issue with bucketing in NG, anyone an advice for?
config
======
agent.sources = syslogSource
agent.channels = memoryChannel
agent.sinks = hdfsSink
agent.sources.syslogSource.type = syslogtcp
agent.sources.syslogSource.port = 5140
agent.sources.syslogSource.host = HOST
agent.sources.syslogSource.channels = memoryChannel
agent.sinks.hdfsSink.type = hdfs
agent.sinks.hdfsSink.channel = memoryChannel
agent.sinks.hdfsSink.hdfs.path = hdfs://HOST/user/flume/dtracking/%Y-%m-%d
agent.sinks.hdfsSink.hdfs.filePrefix = '%{host}-'
agent.sinks.hdfsSink.hdfs.codeC = gzip
agent.channels.memoryChannel.type = memory
agent.channels.memoryChannel.capacity = 100
Exception:
========
2012-05-22 17:29:18,373 ERROR hdfs.HDFSEventSink: process failed
java.lang.NumberFormatException: null
at java.lang.Long.parseLong(Long.java:404)
at java.lang.Long.valueOf(Long.java:540)
at
org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:185)
at
org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:219)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:344)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:722)
2012-05-22 17:29:18,374 ERROR flume.SinkRunner: Unable to deliver event.
Exception follows.
org.apache.flume.EventDeliveryException: java.lang.NumberFormatException: null
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:407)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.NumberFormatException: null
at java.lang.Long.parseLong(Long.java:404)
at java.lang.Long.valueOf(Long.java:540)
at
org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:185)
at
org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:219)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:344)
... 3 more
best,
Alex
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
