Currently this will fail on a repeated list or repeated map. This function has only been defined for lists of scalars. There is a JIRA open for the enhancement request, the priority on this should probably be bumped up with the use cases we have seen. Currently it is marked "Future".
https://issues.apache.org/jira/browse/DRILL-1650 - Jason On Wed, Jan 21, 2015 at 1:57 PM, Christopher Matta <[email protected]> wrote: > Trying that locally did not work for me (drill 0.7.0): > > 0: jdbc:drill:zk=local> select `id`, `name`, `members` from > `Downloads/test.json` where repeated_count(`members`) > 0; > Query failed: Query stopped., Failure while trying to materialize > incoming schema. Errors: > > Error in expression at index -1. Error: Missing function > implementation: [repeated_count(MAP-REPEATED)]. Full expression: > --UNKNOWN EXPRESSION--.. [ 47142fa4-7e6a-48cb-be6a-676e885ede11 on > bullseye-3:31010 ] > > Error: exception while executing query: Failure while executing query. > (state=,code=0) > > > > Chris Matta > [email protected] > 215-701-3146 > > On Wed, Jan 21, 2015 at 4:50 PM, Aditya <[email protected]> wrote: > > > repeated_count('entities.urls') > 0 > > > > On Wed, Jan 21, 2015 at 1:46 PM, Andries Engelbrecht < > > [email protected]> wrote: > > > > > How do you filter out records with an empty array in drill? > > > i.e some records have "url":[] and some will have an array with data > in > > > it. When trying to read records with data in the array drill fails due > to > > > records missing any data in the array. Trying a filter with/* where > > > "url":[0] is not null */ fails, also fails if applying url is not null. > > > > > > Note some of the arrays contains maps, using twitter data as an example > > > below. Some records have an empty array with “hashtags”:[] and others > > will > > > look similar to what is listed below. > > > > > > "entities": { > > > "trends": [], > > > "symbols": [], > > > "urls": [], > > > "hashtags": [ > > > { > > > "text": "GoPatriots", > > > "indices": [ > > > 83, > > > 94 > > > ] > > > } > > > ], > > > "user_mentions": [] > > > }, > > > > > > > > > Thanks > > > —Andries > > >
