Re: Python Spark Streaming example with textFileStream does not work. Why?

2015-09-08 Thread Tathagata Das
quot;1g")) >>> > sc = SparkContext(conf = conf) >>> > ssc = StreamingContext(sc, 1) >>> > lines = ssc.textFileStream('../inputs/2.txt') >>> > counts = lines.flat

Re: Python Spark Streaming example with textFileStream does not work. Why?

2015-09-07 Thread Kamil Khadiev
> .reduceByKey(lambda a, b: a+b) >> > counts.pprint() >> > ssc.start() >> > ssc.awaitTermination() >> > >> > >> > content of 2.txt file is following: >> > >> > a1 b1 c1 d1

Re: Python Spark Streaming example with textFileStream does not work. Why?

2015-09-06 Thread Kamil Khadiev
t; > > I expect that something related to file content will be in console, but > > there are nothing. Nothing except text like this each second: > > > > ----------- > > Time: 2015-09-03 15:08:18 > > -

Re: Python Spark Streaming example with textFileStream does not work. Why?

2015-09-04 Thread Davies Liu
18 > --- > > and Spark's logs. > > Do I do some thing wrong? Otherwise why it does not work? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Python-Spark-Streaming-

Python Spark Streaming example with textFileStream does not work. Why?

2015-09-04 Thread Kamilbek
s logs. Do I do some thing wrong? Otherwise why it does not work? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Python-Spark-Streaming-example-with-textFileStream-does-not-work-Why-tp24579.html Sent f