Hi, What Spark version do you use? it looks like a problem of configuration recovery, not sure is it a twitter streaming specific problem, I tried Kafka streaming with checkpoint enabled in my local machine, seems no such issue. Did you try to set these configurations in somewhere?
Thanks Saisai On Wed, Aug 5, 2015 at 8:34 PM, Sadaf <sa...@platalytics.com> wrote: > Hi > i've done the twitter streaming using twitter's streaming user api and > spark > streaming. this runs successfully on my local machine. but when i run this > program on cluster in local mode. it just run successfully for the very > first time. later on it gives the following exception. > > "Exception in thread "main" org.apache.spark.SparkException: Found both > spark.executor.extraClassPath and SPARK_CLASSPATH. Use only the former." > > and spark class path is unset already!! > I have to make a new checkpoint directory each time to make it run > successfully. otherwise it shows above exception. > > Can anyone help me to resolve this issue? > Thanks :) > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-CheckPointing-issue-tp24139.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
