Thanks, I will try it. I realize my mistake now, but the Drill error messages need to be written in such a way that they help users identify where the real problem is.
Bob On Fri, Nov 14, 2014 at 8:49 PM, Neeraja Rentachintala < [email protected]> wrote: > Bob > Categories in yelp dataset is a array. > So your query should look like below > > select name, flatten(categories) as categories from > dfs.yelp.`yelp_academic_dataset_business.json` > where repeated_contains(categories,'Pizza') = true > > Can you try this out. > > On Fri, Nov 14, 2014 at 6:27 PM, Bob Rumsby (JIRA) <[email protected]> > wrote: > > > Bob Rumsby created DRILL-1718: > > --------------------------------- > > > > Summary: FLATTEN query returns "buffer is neither a method, > a > > field, nor a member class..." error > > Key: DRILL-1718 > > URL: https://issues.apache.org/jira/browse/DRILL-1718 > > Project: Apache Drill > > Issue Type: Bug > > Components: Functions - Drill > > Affects Versions: 0.7.0 > > Environment: 0.7.0 snapshot on MacOSX in embedded mode > > Reporter: Bob Rumsby > > > > > > A query with a FLATTEN function and a WHERE clause constraint on the > > flattened column fails. > > > > 0: jdbc:drill:zk=local> select name, flatten(categories) as categories > > from dfs.yelp.`yelp_academic_dataset_business.json` where > > categories='Pizza'; > > Query failed: Failure while running fragment., Line 68, Column 95: > > "buffer" is neither a method, a field, nor a member class of > > "org.apache.drill.exec.expr.holders.RepeatedVarCharHolder" [ > > 67016271-7266-4438-9529-d8330b1e39a4 on 10.250.0.28:31010 ] > > > > > > Error: exception while executing query: Failure while executing query. > > (state=,code=0) > > 0: jdbc:drill:zk=local> explain plan for select name, flatten(categories) > > as categories from dfs.yelp.`yelp_academic_dataset_business.json` where > > categories='Pizza'; > > +------------+------------+ > > | text | json | > > +------------+------------+ > > | 00-00 Screen > > 00-01 Project(name=[$1], categories=[$2]) > > 00-02 Flatten(flattenField=[$2]) > > 00-03 Project(EXPR$0=[$0], EXPR$1=[$1], EXPR$2=[$0]) > > 00-04 SelectionVectorRemover > > 00-05 Filter(condition=[=($0, 'Pizza')]) > > 00-06 Scan(groupscan=[EasyGroupScan > > > [selectionRoot=/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json, > > numFiles=1, columns=[`categories`, `name`], > > > files=[file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json]]]) > > | { > > "head" : { > > "version" : 1, > > "generator" : { > > "type" : "ExplainHandler", > > "info" : "" > > }, > > "type" : "APACHE_DRILL_PHYSICAL", > > "options" : [ ], > > "queue" : 0, > > "resultMode" : "EXEC" > > }, > > "graph" : [ { > > "pop" : "fs-scan", > > "@id" : 6, > > "files" : [ > > > "file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json" > > ], > > "storage" : { > > "type" : "file", > > "enabled" : true, > > "connection" : "file:///", > > "workspaces" : { > > "root" : { > > "location" : "/", > > "writable" : false, > > "defaultInputFormat" : null > > }, > > "yelp" : { > > "location" : > > "/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata", > > "writable" : true, > > "defaultInputFormat" : null > > } > > }, > > "formats" : { > > "psv" : { > > "type" : "text", > > "extensions" : [ "tbl" ], > > "delimiter" : "|" > > }, > > "csv" : { > > "type" : "text", > > "extensions" : [ "csv" ], > > "delimiter" : "," > > }, > > "tsv" : { > > "type" : "text", > > "extensions" : [ "tsv" ], > > "delimiter" : "\t" > > }, > > "parquet" : { > > "type" : "parquet" > > }, > > "json" : { > > "type" : "json" > > } > > } > > }, > > "format" : { > > "type" : "json" > > }, > > "columns" : [ "`categories`", "`name`" ], > > "selectionRoot" : > > > "/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json", > > "cost" : 36382.0 > > }, { > > "pop" : "filter", > > "@id" : 5, > > "child" : 6, > > "expr" : "equal(`categories`, 'Pizza') ", > > "initialAllocation" : 1000000, > > "maxAllocation" : 10000000000, > > "cost" : 5457.3 > > }, { > > "pop" : "selection-vector-remover", > > "@id" : 4, > > "child" : 5, > > "initialAllocation" : 1000000, > > "maxAllocation" : 10000000000, > > "cost" : 5457.3 > > }, { > > "pop" : "project", > > "@id" : 3, > > "exprs" : [ { > > "ref" : "`EXPR$0`", > > "expr" : "`categories`" > > }, { > > "ref" : "`EXPR$1`", > > "expr" : "`name`" > > }, { > > "ref" : "`EXPR$2`", > > "expr" : "`categories`" > > } ], > > "child" : 4, > > "initialAllocation" : 1000000, > > "maxAllocation" : 10000000000, > > "cost" : 5457.3 > > }, { > > "pop" : "flatten", > > "@id" : 2, > > "child" : 3, > > "column" : "`EXPR$2`", > > "initialAllocation" : 1000000, > > "maxAllocation" : 10000000000, > > "cost" : 5457.3 > > }, { > > "pop" : "project", > > "@id" : 1, > > "exprs" : [ { > > "ref" : "`name`", > > "expr" : "`EXPR$1`" > > }, { > > "ref" : "`categories`", > > "expr" : "`EXPR$2`" > > } ], > > "child" : 2, > > "initialAllocation" : 1000000, > > "maxAllocation" : 10000000000, > > "cost" : 5457.3 > > }, { > > "pop" : "screen", > > "@id" : 0, > > "child" : 1, > > "initialAllocation" : 1000000, > > "maxAllocation" : 10000000000, > > "cost" : 5457.3 > > } ] > > } | > > +------------+------------+ > > 1 row selected (0.115 seconds) > > 0: jdbc:drill:zk=local> > > > > > > > > > > -- > > This message was sent by Atlassian JIRA > > (v6.3.4#6332) > > >
