There was already a thread around it if i understood your question correctly, you can go through this https://mail-archives.apache.org/mod_mbox/spark-user/201502.mbox/%3ccannjawtrp0nd3odz-5-_ya351rin81q-9+f2u-qn+vruqy+...@mail.gmail.com%3E
Thanks Best Regards On Thu, Feb 19, 2015 at 8:16 PM, Chico Qi <[email protected]> wrote: > Hi all, > > In Spark Streaming I want use the Dstream.saveAsTextFiles by bulk writing > because of the normal saveAsTextFiles cannot during the batch interval of > setting. > May be a common pool of writing or another assigned worker for bulk > writing? > > Thanks! > > B/R > Jichao >
