folks,
i am not sure whether anyone else is facing this or i am missing something
here. Here are some observations -
1. checkout flume trunk
2. provide the following config
# Define a memory channel called ch1 on agent1
agent1.channels.ch1.type = memory
# Define an Avro source called avro-source1 on agent1 and tell it
# to bind to 0.0.0.0:41414. Connect it to channel ch1.
agent1.sources.avro-source1.type = avro
agent1.sources.avro-source1.bind = 0.0.0.0
agent1.sources.avro-source1.port = 41414
agent1.sources.avro-source1.channels = ch1
# Define a logger sink that simply logs all events it receives
# and connect it to the other end of the same channel.
agent1.sinks.log-sink1.type = hdfs
agent1.sinks.log-sink1.channel = ch1
agent1.sinks.log-sink1.hdfs.path = hdfs://localhost
# Finally, now that we've defined all of our components, tell
# agent1 which ones we want to activate.
agent1.sources = avro-source1
agent1.sinks = log-sink1
agent1.channels = ch1
flume.cfg (END)
3. start agent - ./flume-ng agent --conf ../conf/ -f flume.cfg -n agent1
4. start client - ./flume-ng avro-client --conf ../conf/ -H localhost -p
41414 -F ~/.bash_history
exception in logs
------------------------
ERROR api.NettyAvroRpcClient: RPC connection error :
java.io.IOException: Error connecting to localhost/127.0.0.1:41414
at
org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:250)
at
org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:199)
at
org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:148)
at
org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:116)
at
org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:120)
at
org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:109)
at
org.apache.flume.api.NettyAvroRpcClient.<init>(NettyAvroRpcClient.java:94)
at
org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:131)
at
org.apache.flume.client.avro.AvroCLIClient.run(AvroCLIClient.java:120)
at
org.apache.flume.client.avro.AvroCLIClient.main(AvroCLIClient.java:64)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
this used to work for me a while back....Any help is appreciated.
--
Thanks,
- Inder
Tech Platforms @Inmobi
Linkedin - http://goo.gl/eR4Ub
