On Mon, Mar 22, 2010 at 7:00 PM, Vinicius Carvalho <[email protected]> wrote: > Thanks Claus. I was just hoping someone from the camel-hadoop would be > around this list :) > > The HDFSProducer do extend DefaultProducer, but I was debugging the > code, and the doStart is not invoked. Any reason for this? >
No it ought to call start on the producer when its created. I think its David Grecko who created the Hadoop component. He may be around to help out. > Regards > > On Mon, Mar 22, 2010 at 2:40 PM, Claus Ibsen <[email protected]> wrote: >> Hi >> >> Camel Hadoop is hosted outside Apache and thus not officially >> supported by Apache etc. >> I think you gotta dig into it yourself to see the issue. >> >> Normally doStart should be invoked on a Producer/Consumer if it >> extends the DefaultProducer/DefaultConsumer etc. >> >> And I am sure patches etc is welcome on the Camel Hadop project. >> >> >> On Mon, Mar 22, 2010 at 5:57 PM, Vinicius Carvalho >> <[email protected]> wrote: >>> Hello there! I'm trying the Camel Hadoop integration (using >>> camel-2.3-Snapshot), and using this producer: >>> >>> @Produce(uri="hdfs://localhost/temp/tweets?splitStrategy=BYTES:200000") >>> protected TweeterProducer producer; >>> >>> The problem is that I get a NPE: >>> >>> Exception in thread "Twitter Stream Handling Thread[receiving stream]" >>> org.apache.camel.RuntimeCamelException: java.lang.NullPointerException >>> at >>> org.apache.camel.component.hdfs.HdfsProducer.process(HdfsProducer.java:176) >>> at >>> org.apache.camel.component.bean.CamelInvocationHandler.invoke(CamelInvocationHandler.java:64) >>> at $Proxy32.broadcast(Unknown Source) >>> at >>> com.acme.tweet.TwitterBroadcaster.onStatus(TwitterBroadcaster.java:39) >>> at twitter4j.StatusStream.next(StatusStream.java:78) >>> at >>> twitter4j.TwitterStream$StreamHandlingThread.run(TwitterStream.java:357) >>> >>> Checking the HdfsProducer code, I can verify that it seems that when >>> process is called, the variable >>> >>> HdfsOutputStream ostream is not set. I do not know the internals of >>> camel, but it seems that this component does not get the doStart() >>> called prior to the process method. And it seems thats how it should >>> happen. >>> >>> Any ideas? >>> >>> Regards >>> >> >> >> >> -- >> Claus Ibsen >> Apache Camel Committer >> >> Author of Camel in Action: http://www.manning.com/ibsen/ >> Open Source Integration: http://fusesource.com >> Blog: http://davsclaus.blogspot.com/ >> Twitter: http://twitter.com/davsclaus >> > -- Claus Ibsen Apache Camel Committer Author of Camel in Action: http://www.manning.com/ibsen/ Open Source Integration: http://fusesource.com Blog: http://davsclaus.blogspot.com/ Twitter: http://twitter.com/davsclaus
