Just to clarify, you run the *exact same query* once and it works, then you remove say the “cool” field from orders/222.json and put it in orders/111.json and the next time the same query returns that error?
Chris Matta [email protected] 215-701-3146 On Mon, Jun 22, 2015 at 9:59 AM, Tugdual Grall <[email protected]> wrote: > Hello, > > In my use case I have several JSON documents that I need to query using a > join. > The structure of each document can vary a lot (some fields a present or not > in documents) > > Sometimes the following exception is raised: > org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: > java.lang.IllegalStateException: Failure while reading vector. Expected > vector class of org.apache.drill.exec.vector.NullableIntVector but was > holding vector class org.apache.drill.exec.vector.NullableVarCharVector. > Fragment 0:0 [Error Id: 35c751bd-3ca0-4e4a-bbac-ad5823ce582f on > 192.168.99.13:31010] > > The queries: > > Following query works: > ----- > SELECT customers.id, orders.demo > FROM dfs.`/Users/tgrall/working/customers/*.json` customers, > dfs.`/Users/tgrall/working/orders/*.json` orders > WHERE customers.id = orders.cust_id > AND customers.country = 'FRANCE' > ----- > > Following query FAILS: > ----- > SELECT customers.id, orders.cool > FROM dfs.`/Users/tgrall/working/customers/*.json` customers, > dfs.`/Users/tgrall/working/orders/*.json` orders > WHERE customers.id = orders.cust_id > AND customers.country = 'FRANCE' > ----- > > > The documents: > > Here the files: > > ./customers/333.json > { > "id" : 333, > "name" : "Dave Smith", > "country" : "FRANCE" > } > > > ./orders/111.json > { > "tax" : 10, > "id" : 111, > "cust_id" : 333, > "total" : 12, > "demo" :10 > } > > ./orders/222.json > { > "cool":20, > "id" : 222, > "cust_id" : 111, > "total" : 12 > } > > > To reproduce the bug you may have to change the document (add/remove cool, > tax fields) > > It looks like the schema is not "updated" on the fly in some case. > > Any idea how to workaround? Is that bug? > > Regards > Tug >
