Re: SparkStream saveAsTextFiles()

2015-05-04 Thread anavidad
Structure seems fine. Only need to type at the end of your program: ssc.start(); ssc.awaitTermination(); Check method arguments. I advise you to check the spark java api streaming. https://spark.apache.org/docs/1.3.0/api/java/ Regards. -- View this message in context: http://apache-spark-u

Re: SparkStream saveAsTextFiles()

2015-05-04 Thread anavidad
Hi, What kind of "can't find symbol" are you receiving? On the other hand, I would try to change guava dependency version to 14.0.1. In Spark 1.3.0, guava version is 14.0.1 but is not included inside spark artifact because it's marked like provided. http://repo1.maven.org/maven2/org/apache/spar

Re: SparkStream saveAsTextFiles()

2015-04-30 Thread anavidad
JavaDStream.saveAsTextFiles not exists in Spark Java Api. If you want to persist every RDD in your JavaDStream you should do something like this: words.foreachRDD(new Function2, Time, Void>() { @Override public Void call(JavaRDD rddWords, Time arg1) throws Exception { rddWords.