Hi,
I am trying to run flume after compiling from the trunk. I was able to
setup the master node and collector system. When I try to create a
channel for data flow I get the following error on the collector side.
-----------------------------
2011-12-31 14:01:09,844 [pool-2-thread-6] ERROR
server.TSaneThreadPoolServer: Error occurred during processing of
message.
java.lang.NullPointerException
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:34)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
at
org.apache.thrift.server.TSaneThreadPoolServer$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Xephyr [INFO Sat Dec 31 14:01:09 IST 2011] { AckChecksum :
(long)1325320259830 (string) '4�>H�' (double)6.547952101194E-312 } {
AckTag : 20111231-140059828+0530.18934067081178.00000025 } { AckType :
end }
----------------------------------------
On my Agent Node I get the following log
---------------------------------------------
2011-12-31 14:03:53,873 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink on port 35880 closed
2011-12-31 14:03:53,873 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink to localhost:35880 opened
2011-12-31 14:03:53,873 [naive file wal consumer-26] INFO
debug.InsistentOpenDecorator: Opened ThriftEventSink on try 0
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
agent.WALAckManager: Ack for
20111231-140139864+0530.18974103299247.00000025 is queued to be
checked
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
durability.WALSource: end of file NaiveFileWALManager
(dir=/tmp/flume-ankul/agent/Xephyr )
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
durability.NaiveFileWALManager: opening log file
20111231-135939762+0530.18854000963959.00000025
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
debug.StubbornAppendSink: append failed on event 'Xephyr [INFO Sat Dec
31 13:59:39 IST 2011] { AckChecksum : (long)1325320179764 (string)
'4�=4' (double)6.547951705615E-312 } { AckTag :
20111231-135939762+0530.18854000963959.00000025 } { AckType : beg } '
with error: Append failed java.net.SocketException: Connection reset
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink on port 35880 closed
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink to localhost:35880 opened
2011-12-31 14:03:53,874 [naive file wal consumer-26] INFO
debug.InsistentOpenDecorator: Opened ThriftEventSink on try 0
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
agent.WALAckManager: Ack for
20111231-135939762+0530.18854000963959.00000025 is queued to be
checked
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
durability.WALSource: end of file NaiveFileWALManager
(dir=/tmp/flume-ankul/agent/Xephyr )
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
durability.NaiveFileWALManager: opening log file
20111231-134539034+0530.18013273061228.00000019
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
debug.StubbornAppendSink: append failed on event 'Xephyr [INFO Sat Dec
31 13:45:39 IST 2011] { AckChecksum : (long)1325319339036 (string)
'4�0< ' (double)6.547947551867E-312 } { AckTag :
20111231-134539034+0530.18013273061228.00000019 } { AckType : beg } '
with error: Append failed java.net.SocketException: Connection reset
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink on port 35880 closed
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
thrift.ThriftEventSink: ThriftEventSink to localhost:35880 opened
2011-12-31 14:03:53,875 [naive file wal consumer-26] INFO
debug.InsistentOpenDecorator: Opened ThriftEventSink on try 0
2011-12-31 14:03:53,876 [naive file wal consumer-26] INFO
agent.WALAckManager: Ack for
20111231-134539034+0530.18013273061228.00000019 is queued to be
checked
2011-12-31 14:03:53,876 [naive file wal consumer-26] INFO
durability.WALSource: end of file NaiveFileWALManager
(dir=/tmp/flume-ankul/agent/Xephyr )
-------------------------------------------------
Steps Followed -
1. Started master by flume master_nowatch
2. Started node using flume node_nowatch
3. Started collector using flume node_nowatch -n trial
4. Code checkout path - http://svn.apache.org/repos/asf/incubator/flume/trunk
In my master->config ,set the data flow as
host : console | agentSink("localhost",35880) ;
trial : collectorSource(35880) | console ;
The port number of my collector is 35863 but the TransportService for
collectorSource() was not able to bind itself to that port as it was
used by internal Jetty, so specified a random port 35880.
I am not sure of the reason for NPE Exception. Can someone please
throw some light.
Thanks
Ankul..!!!
