Spark Streaming uses twitter4j 3.0.3. 3.0.6 should probably work fine. The exception that you are seeing is something that should be looked into. Can you give us more logs (specially executor logs) with stack traces that has the error.
TD On Thu, Jul 10, 2014 at 2:42 PM, Nick Chammas <nicholas.cham...@gmail.com> wrote: > Looks like twitter4j <http://twitter4j.org/archive/> 2.2.6 is what works, > but I don’t believe it’s documented anywhere. > > Using 3.0.6 works for a while, but then causes the following error: > > 14/07/10 18:34:13 WARN ReceiverTracker: Error reported by receiver for stream > 0: Error in block pushing thread - java.io.NotSerializableException: > twitter4j.internal.json.ScopesImpl > > 4.0.2 doesn’t work at all and complains about not finding a StatusListener > class. > > Nick > > > ------------------------------ > View this message in context: What version of twitter4j should I use with > Spark Streaming? > <http://apache-spark-user-list.1001560.n3.nabble.com/What-version-of-twitter4j-should-I-use-with-Spark-Streaming-tp9352.html> > Sent from the Apache Spark User List mailing list archive > <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com. >
