Re: Reading kafka stream and writing to hdfs
Like: counts.saveAsTestFiles("hdfs://host:port/some/location") Thanks Best Regards On Tue, Sep 29, 2015 at 2:15 AM, Chengi Liu wrote: > Hi, > I am going thru this example here: > > https://github.com/apache/spark/blob/master/examples/src/main/python/streaming/kafka_wordcount.py > If I want to write this data on hdfs. > Whats the right way to do this? > Thanks >
Reading kafka stream and writing to hdfs
Hi, I am going thru this example here: https://github.com/apache/spark/blob/master/examples/src/main/python/streaming/kafka_wordcount.py If I want to write this data on hdfs. Whats the right way to do this? Thanks