Re: can udaf's return complex types?

2018-02-13 Thread Matteo Cossu 
Hello,

yes, sure they can return complex types. For example, the functions
collect_list and collect_set return an ArrayType.

On 10 February 2018 at 14:28, kant kodali <kanth...@gmail.com> wrote:

> Hi All,
>
> Can UDAF's return complex types? like say a Map with key as an Integer and
> the value as an Array of strings?
>
> For Example say I have the following *input dataframe*
>
> id | name | amount
> -
> 1 |  foo | 10
> 2 |  bar | 15
> 1 |  car | 20
> 1 |  bus | 20
>
> and my *target/output data frame* is
>
> id | my_sum_along_with_names
> -
> 1  | Map(key -> 50, value -> [foo, car, bus])
> 2  | Map(key -> 15, value -> [bar])
>
> I am looking for a UDAF solution so I can use it in my raw sql query.
>
> Thanks!
>
>
>
>
>
>
>
>
>

can udaf's return complex types?

2018-02-10 Thread kant kodali 
Hi All,

Can UDAF's return complex types? like say a Map with key as an Integer and
the value as an Array of strings?

For Example say I have the following *input dataframe*

id | name | amount
-
1 |  foo | 10
2 |  bar | 15
1 |  car | 20
1 |  bus | 20

and my *target/output data frame* is

id | my_sum_along_with_names
-
1  | Map(key -> 50, value -> [foo, car, bus])
2  | Map(key -> 15, value -> [bar])

I am looking for a UDAF solution so I can use it in my raw sql query.

Thanks!