It looks like saveAsTextFiles doesn't support the compression parameter of RDD.saveAsTextFile. Is there a way to add the functionality in my client code without patching Spark? I tried making my own saveFunc function and calling DStream.foreachRDD but ran into trouble with invoking rddToFileName and making the RDD type parameter work properly. It's probably just do to my lack of Scala knowledge. Can anyone give me a hand?
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Saving-compressed-textFiles-from-a-DStream-in-Scala-tp23177.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
