countDistinct is recently added and is in 1.0.2. If you are using that
or the master branch, you could try something like:
r.select('keyword, countDistinct('userId)).groupBy('keyword)
On Thu, Jul 31, 2014 at 12:27 PM, buntu <buntu...@gmail.com> wrote:
> I'm looking to write a select statement to get a distinct count on userId
> grouped by keyword column on a parquet file SchemaRDD equivalent of:
> SELECT keyword, count(distinct(userId)) from table group by keyword
>
> How to write it using the chained select().groupBy() operations?
>
> Thanks!
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/SchemaRDD-select-expression-tp11069.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
