Spark sql UDF for array aggergation

2014-11-25 Thread Barua, Seemanto
Hi, I am looking for some resources/tutorials that will help me achive this: My JavaSchemaRDD is from JSON objects like below. How do I go about writing a UDF aggregate function let's say 'vectorAgg' which I can call from sql that returns one result array that is a positional aggregate across

Re: Spark sql UDF for array aggergation

2014-11-25 Thread Michael Armbrust
We don't support native UDAs at the moment in Spark SQL. You can write a UDA using Hive's API and use that within Spark SQL On Tue, Nov 25, 2014 at 10:10 AM, Barua, Seemanto seemanto.ba...@jpmchase.com.invalid wrote: Hi, I am looking for some resources/tutorials that will help me achive