Re: Pair RDD

[Yanbo Liang]

val node = textFile.map(line => {
      val fileds = line.split("\\s+")
      (fileds(1),fileds(2))
    })

then you can manipulate node RDD with PairRDD function.


2014-08-26 12:55 GMT+08:00 Deep Pradhan <pradhandeep1...@gmail.com>:

> Hi,
> I have an input file of a graph in the format <source_node   dest_node>
> When I use sc.textFile, it will change the entire text file into an RDD.
> How can I transform the file into key, value pair and then eventually into
> paired RDDs.
> Thank You
>