PairRDD from SQL

2015-11-04 Thread pratik khadloya
Hello,

Is it possible to have a pair RDD from the below SQL query.
The pair being ((item_id, flight_id), metric1)

item_id, flight_id  are part of group by.

SELECT
  item_id,
  flight_id,
  SUM(metric1) AS metric1
FROM mytable
GROUP BY
  item_id,
  flight_id


Thanks,
Pratik


Re: PairRDD from SQL

2015-11-04 Thread Stéphane Verlet
sqlContext.sql().map(row=> ((row.getString(0),
row.getString(1)),row.getInt(2)))

On Wed, Nov 4, 2015 at 1:44 PM, pratik khadloya  wrote:

> Hello,
>
> Is it possible to have a pair RDD from the below SQL query.
> The pair being ((item_id, flight_id), metric1)
>
> item_id, flight_id  are part of group by.
>
> SELECT
>   item_id,
>   flight_id,
>   SUM(metric1) AS metric1
> FROM mytable
> GROUP BY
>   item_id,
>   flight_id
>
>
> Thanks,
> Pratik
>