Hello,
How should I write a text file stream DStream to HDFS.
I tried the the following
val lines = ssc.textFileStream("hdfs:/user/hadoop/spark/streaming/input/")
lines.saveAsTextFile("hdfs:/user/hadoop/output1")
val lines = ssc.textFileStream("hdfs:/user/hadoop/spark/streaming/input/")
lines.saveAsHadoopFiles("hdfs:/user/hadoop/output1","out")
in both cases i received compile errors saying:
is not a member of org.apache.spark.streaming.dstream.DStream[String]
Thanks in advance for help.
