Hi,
I am trying to run flume after compiling from the trunk. I was able to
setup the master node and collector system. When I try to create a
channel for data flow I get the following error on the collector side.
-----------------------------
2011-12-31 14:01:09,844 [pool-2-thread-6] ERROR
server.TSaneThreadPoolServer: Error occurred during processing of
message.
java.lang.NullPointerException
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:34)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
at
org.apache.thrift.server.TSaneThreadPoolServer$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Xephyr [INFO Sat Dec 31 14:01:09 IST 2011] { AckChecksum :
(long)1325320259830 (string) ' ' (double)6.547952101194E-312 } {
AckTag : 20111231-140059828+0530.18934067081178.00000025 } { AckType :
end }
----------------------------------------
On my Agent Node I get the following log
---------------------------------------------
2011-12-31 14:03:53,873 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink on port 35880 closed
2011-12-31 14:03:53,873 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink to localhost:35880 opened
2011-12-31 14:03:53,873 [naive file wal consumer-26] INFO
debug.InsistentOpenDecorator: Opened ThriftEventSink on try 0
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
agent.WALAckManager: Ack for
20111231-140139864+0530.18974103299247.00000025 is queued to be
checked
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
durability.WALSource: end of file NaiveFileWALManager
(dir=/tmp/flume-ankul/agent/Xephyr )
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
durability.NaiveFileWALManager: opening log file
20111231-135939762+0530.18854000963959.00000025
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
debug.StubbornAppendSink: append failed on event 'Xephyr [INFO Sat Dec
31 13:59:39 IST 2011] { AckChecksum : (long)1325320179764 (string)
' ' (double)6.547951705615E-312 } { AckTag :
20111231-135939762+0530.18854000963959.00000025 } { AckType : beg } '
with error: Append failed java.net.SocketException: Connection reset
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink on port 35880 closed
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink to localhost:35880 opened
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
debug.InsistentOpenDecorator: Opened ThriftEventSink on try 0
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
agent.WALAckManager: Ack for
20111231-135939762+0530.18854000963959.00000025 is queued to be
checked
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
durability.WALSource: end of file NaiveFileWALManager
(dir=/tmp/flume-ankul/agent/Xephyr )
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
durability.NaiveFileWALManager: opening log file
20111231-134539034+0530.18013273061228.00000019
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
debug.StubbornAppendSink: append failed on event 'Xephyr [INFO Sat Dec
31 13:45:39 IST 2011] { AckChecksum : (long)1325319339036 (string)
' ' (double)6.547947551867E-312 } { AckTag :
20111231-134539034+0530.18013273061228.00000019 } { AckType : beg } '
with error: Append failed java.net.SocketException: Connection reset
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink on port 35880 closed
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink to localhost:35880 opened
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
debug.InsistentOpenDecorator: Opened ThriftEventSink on try 0
2011-12-31 14:03:53,876 [naive file wal consumer-26] INFO
agent.WALAckManager: Ack for
20111231-134539034+0530.18013273061228.00000019 is queued to be
checked
2011-12-31 14:03:53,876 [naive file wal consumer-26] INFO
durability.WALSource: end of file NaiveFileWALManager
(dir=/tmp/flume-ankul/agent/Xephyr )
-------------------------------------------------
Steps Followed -
1. Started master by flume master_nowatch
2. Started node using flume node_nowatch
3. Started collector using flume node_nowatch -n trial
4. Code checkout path - http://svn.apache.org/repos/asf/incubator/flume/trunk
In my master->config ,set the data flow as
host : console | agentSink("localhost",35880) ;
trial : collectorSource(35880) | console ;
The port of my collector is 35863 but the TransportService for
collectorSource() was not able to bind itself to that port as it was
used by internal Jetty, so specified a random port 35880.
I am not sure of the reason for NPE Exception. Can someone please
throw some light.
Thanks
Ankul..!!!
