*-Also it fails as before (unsupported operation) in udf where I'm using JsonReader and ComplexWriter to read json from string.* This sounds a familiar issue reported at [1].
-Hanifi 1: https://issues.apache.org/jira/browse/DRILL-4283 On Mon, Feb 15, 2016 at 8:34 AM, Jinfeng Ni <[email protected]> wrote: > I think union type support is still in beta stage; that's why it's > turned off by default. > > Could you please file a JIRA for the problem you encountered? That > way, we will not lose track of those issues. > > Thanks! > > > > On Mon, Feb 15, 2016 at 4:32 AM, Karol Potocki <[email protected]> wrote: > > Ok, now the query executes succesfully. But now the problem moved to > flatten step. > > > > Trying: > > > > select flatten(feature) from dfs.`tmp/1.json`; > > > > causes: > > > > Error: SYSTEM ERROR: SchemaChangeRuntimeException: Inner vector type > mismatch. Requested type: [minor_type: BIGINT > > mode: OPTIONAL > > ], actual type: [minor_type: UNION > > mode: OPTIONAL > > sub_type: BIGINT > > sub_type: LIST > > ] > > > > Also it fails as before (unsupported operation) in udf where I'm using > JsonReader and ComplexWriter to read json from string. > > Thank you for your support. > > > > > > On Fri, Feb 12, 2016 at 6:10 PM, Jinfeng Ni <[email protected]> > wrote: > > > >> For such use case, you need to turn on union vector type support > >> (https://issues.apache.org/jira/browse/DRILL-3229) > >> > >> > >> 0: jdbc:drill:zk=local> alter session set `exec.enable_union_type` = > true; > >> +-------+----------------------------------+ > >> | ok | summary | > >> +-------+----------------------------------+ > >> | true | exec.enable_union_type updated. | > >> +-------+----------------------------------+ > >> 1 row selected (0.093 seconds) > >> 0: jdbc:drill:zk=local> select * from dfs.`/tmp/1.json`; > >> +----------------------------------------+ > >> | feature | > >> +----------------------------------------+ > >> | [{"foo":[1,2]},{"foo":[[1,2],[1,2]]}] | > >> +----------------------------------------+ > >> > >> On Fri, Feb 12, 2016 at 3:07 AM, Karol Potocki <[email protected]> wrote: > >> > There is a problem querying json files with structure like below: > >> > > >> > { > >> > "feature": [ > >> > { "foo": [1, 2] }, > >> > { "foo": [[1, 2], [1, 2]] } > >> > ] > >> > } > >> > > >> > it fails with: > >> > Error: UNSUPPORTED_OPERATION ERROR: In a list of type BIGINT, > encountered a value of type LIST. Drill does not support lists of different > types. > >> > > >> > File /home/kap/bigdata/test2.json > >> > Record 1 > >> > Line 4 > >> > Column 16 > >> > Field foo > >> > Line 4 > >> > Column 16 > >> > Field foo > >> > Fragment 0:0 > >> > > >> > [Error Id: 549fd777-0cad-4728-af53-9fa988e53d00 on lpoz0775:31010] > (state=,code=0) > >> > > >> > > >> > Such structures often exists in geojson files which contains > geometries of different types i.e. Polygon and MultiPolygon: > >> > > >> > { > >> > "type": "GeometryCollection", > >> > "geometries": > >> > [ > >> > { "type": "Polygon", > >> > "coordinates": [ > >> > [ [100.0, 0.0], [101.0, 0.0], [101.0, 1.0], [100.0, 1.0], [100.0, > 0.0] ] > >> > ] > >> > }, > >> > { "type": "MultiPolygon", > >> > "coordinates": [ > >> > [[[102.0, 2.0], [103.0, 2.0], [103.0, 3.0], [102.0, 3.0], [102.0, > 2.0]]], > >> > [[[100.0, 0.0], [101.0, 0.0], [101.0, 1.0], [100.0, 1.0], [100.0, > 0.0]], > >> > [[100.2, 0.2], [100.8, 0.2], [100.8, 0.8], [100.2, 0.8], [100.2, > 0.2]]] > >> > ] > >> > } > >> > ] > >> > } > >> > > >> > ( which renders to: > http://bl.ocks.org/anonymous/raw/b18e661defbb26df903b/[http://bl.ocks.org/anonymous/raw/b18e661defbb26df903b/][http://bl.ocks.org/anonymous/raw/b18e661defbb26df903b/[http://bl.ocks.org/anonymous/raw/b18e661defbb26df903b/]] > ) > >> > >
