Thanks Azuryy. I will try . From: Azuryy Yu <[email protected]> Reply-To: <[email protected]> Date: Sat, 29 Dec 2012 07:11:39 +0800 To: <[email protected]> Subject: Re: Please help me with errors met in Flume 1.3
please keep hbase and zk the same version under hbase and flume. then it works. On Dec 28, 2012 5:48 PM, "GuoWei" <[email protected]> wrote: > Dear all, > > In my project, I use flume 1.3 to collect log. But when I want to use > HBaseSync to store data into HBASE. I got the following error message. > > 12/12/28 17:45:55 INFO zookeeper.ClientCnxn: Opening socket connection to > server DataNode1/192.168.1.186:2181 <http://192.168.1.186:2181> . Will not > attempt to authenticate using SASL (unknown error) > 12/12/28 17:45:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java: > 350) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to > server DataNode2/192.168.1.187:2181 <http://192.168.1.187:2181> . Will not > attempt to authenticate using SASL (unknown error) > 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java: > 350) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to > server NameNode/192.168.1.185:2181 <http://192.168.1.185:2181> . Will not > attempt to authenticate using SASL (unknown error) > 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java: > 350) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to > server DataNode1/192.168.1.186:2181 <http://192.168.1.186:2181> . Will not > attempt to authenticate using SASL (unknown error) > > And my configuration is: > > host1.sources = r1 > host1.sinks = sink1 > host1.channels = c1 > > # Describe/configure the source > host1.sources.r1.type = netcat > host1.sources.r1.bind = 0.0.0.0 > host1.sources.r1.port = 44444 > # Use a channel which buffers events in memory > host1.channels.c1.type = memory > host1.channels.c1.capacity = 1000 > host1.channels.c1.transactionCapacity = 100 > > host1.sources.r1.channels = c1 > > #e the AsyncHBaseSink > host1.sinks.sink1.type = org.apache.flume.sink.hbase.AsyncHBaseSink > > #Use the HBaseSink > #host1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink > host1.sinks.sink1.channel = c1 > host1.sinks.sink1.table = cobub_razor_clientdata > host1.sinks.sink1.columnFamily = clientdata > > #host1.sinks.sink1.column = charges > host1.sinks.sink1.batchSize = 5000 > > #Use the SimpleAsyncHbaseEventSerializer that comes with Flume > host1.sinks.sink1.serializer = > org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer > > #Use the SimpleHbaseEventSerializer that comes with Flume > #host1.sinks.sink1.serializer = > org.apache.flume.sink.hbase.SimpleHbaseEventSerializer > > host1.sinks.sink1.serializer.incrementColumn = icol > host1.channels.c1.type=memory > > > Thanks for your help. > Best Regards / 商祺 > 郭伟 Guo Wei > ----------------------------------------------------- > 南京西桥科技有限公司 > Western Bridge Tech Ltd., Nanjing > 南京市玄武区花园路8号一号楼511 > No. 511, Building 1, No. 8, Hua Yuan Road > Xuanwu District, Nanjing, PR China > Email: [email protected] <mailto:[email protected]> > Tel: +86 25 8528 4900 (Operator) > Mobile: +86 138 1589 8257 > Fax: +86 25 8528 4980 > Web: http://www.wbkit.com <http://www.wbkit.com/> > ----------------------------------------------------- > WesternBridge Tech: Professional software service provider. Professional is > MANNER as well CAPABILITY. >
