problem with a very simple word count program

2015-09-16 Thread huajun
file) keep = result.union(keep); } keep = keep.reduceByKey( (x,y) => (x+y) ) keep.saveAsTextFile("results") Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/problem-with-a-very-simple-word-count-p

Re: problem with a very simple word count program

2015-09-16 Thread Shawn Carroll
".xml" > else "medline15n00" + i + ".xml" > > val result = process(file) > keep = result.union(keep); > } > keep = keep.reduceByKey( (x,y) => (x+y) ) > keep.saveAsTextFile("results&quo

Re: problem with a very simple word count program

2015-09-16 Thread Alexander Krasheninnikov
gt; >> val file = "medline15n0001.xml" >> var keep = process(file) >> >> for (i <- 2 to 28) { >> val file = if (i < 10) "medline15n000" + i + ".xml" >> else "medline15n00" + i + ".xml&q