Re: Different Sorting RDD methods in Apache Spark

2015-06-09 Thread Mark Hamstra
"/data.txt",32); >>>> //parallelize(l, >>>> 8); >>>> long start = System.currentTimeMillis(); >>>> JavaRDD>> rdd3 = >>>> rdd.mapPartitions(new FlatMapFunction, >>>> LinkedList>>

Re: Different Sorting RDD methods in Apache Spark

2015-06-09 Thread Raghav Shankar
vaRDD>> rdd3 = >>> rdd.mapPartitions(new FlatMapFunction, >>> LinkedList>>(){ >>> >>> @Override >>> public Iterable>> >>> call(Iterator t) >>> throws

Re: Different Sorting RDD methods in Apache Spark

2015-06-09 Thread Mark Hamstra
erride >> public Iterable>> >> call(Iterator t) >> throws Exception { >> // TODO Auto-generated method stub >> LinkedList> lines = new >> LinkedList>(); >> while(t.hasNext()){ >>

Re: Different Sorting RDD methods in Apache Spark

2015-06-09 Thread Daniel Darabos
List>(); > while(t.hasNext()){ > String s = t.next(); > String arr1[] = s.split(","); > Tuple2 t1 = new Tuple2 String>(Double.parseDouble(arr1[24]),s); > lines.add(t1); > } > Colle

Different Sorting RDD methods in Apache Spark

2015-06-08 Thread raggy
} -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Different-Sorting-RDD-methods-in-Apache-Spark-tp23214.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To