Hello,

Does Hive currently support arrays, maps, structs while using custom
reduce/map scripts? 'myreduce.py' in the example below produces an
array of structs delimited by \2s and \3s.

CREATE TABLE SS (
                    a INT,
                    b INT,
                    vals ARRAY<STRUCT<x:INT, y:STRING>>
                );

FROM (select * from srcTable DISTRIBUTE BY id SORT BY id) s
    INSERT OVERWRITE TABLE SS
    REDUCE *
        USING 'myreduce.py'
        AS
                (a,b, vals)
        ;

However, the query is failing with the following error message, even
before the script is executed:

FAILED: Error in semantic analysis: line 2:27 Cannot insert into
target table because column number/types are different SS: Cannot
convert column 2 from string to array<struct<x:int,y:string>>.

I saw a discussion about this in
http://www.mail-archive.com/[email protected]/msg00160.html,
dated over a year ago.  Just wondering if there have been any updates.

Thanks,

Dilip

Reply via email to