Alexander, I'm also successfully querying a directory of (compressed) JSON in Drill 1.4.
This is maybe a trivial suggestion, but for sanity what happens when you specify the standard dfs plugin with: dfs.`D:\DataFiles\2015\12\16` ? --Nathan On Fri, Dec 18, 2015 at 1:44 AM, Holy Alexander <[email protected]> wrote: > I've tried every possible combination of > > SELECT * FROM ` D:\DataFiles\2015\12\16` ORDER BY ID LIMIT 10 > SELECT * FROM ` D:\DataFiles\2015\12\16\` ORDER BY ID LIMIT 10 > SELECT * FROM ` D:\DataFiles\2015\12\16\*` ORDER BY ID LIMIT 10 > SELECT * FROM ` D:\DataFiles\2015\12\16\*.gz` ORDER BY ID LIMIT 10 > > All are working in Drill 1.3, > none of the above is working in Drill 1.4 > (Unexpected internal error near index 1 \ ^ [Error Id: > 467e9ccd-3730-4add-aa63-a205a1e16107 on ... ]) > > I also deleted and rebuilt all configuration, tmp contents etc > > At least on my machine (Windows 10 (1511) x64 workstation) it looks like > something is broken in 1.4 > My Java is jdk1.8.0_51 > > The same effect/problem occurs with both .json and .json.gz > In all cases things do work in 1.3 and not in 1.4 > > Thanks, > Alexander > > > -----Original Message----- > From: Nirav Shah [mailto:[email protected]] > Sent: 18 December 2015 05:46 > To: [email protected] > Subject: Re: Querying a directory of json.gz Files in Drill 1.4 > > May be you can try > In Drill 1.4 the same Query > SELECT * FROM ` D:\DataFiles\2015\12\16\*.gz` ORDER BY ID LIMIT 10 > > it's working for me. > Thanks, > Nirav > > On Fri, Dec 18, 2015 at 12:46 AM, Holy Alexander < > [email protected]> wrote: > >> I keep my JSON Files in local File system, such as >> >> D:\DataFiles\2015\12\16\2015-12-16T0000.json.gz >> D:\DataFiles\2015\12\16\2015-12-16T0100.json.gz >> D:\DataFiles\2015\12\16\2015-12-16T0200.json.gz >> (etc.) >> >> Up to Drill 1.3 >> SELECT * FROM ` D:\DataFiles\2015\12\16` ORDER BY ID LIMIT 10 would >> produce the desired result, querying all the files in the directory. >> >> >> In Drill 1.4 the same Query >> SELECT * FROM ` D:\DataFiles\2015\12\16` ORDER BY ID LIMIT 10 >> >> always results in this error: >> org.apache.drill.common.exceptions.UserRemoteException: VALIDATION ERROR: >> Unexpected internal error near index 1 \ ^ [Error Id: >> 467e9ccd-3730-4add-aa63-a205a1e16107 on ... ] >> >> However, >> SELECT * FROM ` D:\DataFiles\2015\12\16\2015-12-16T0000.json.gz ` >> ORDER BY ID LIMIT 10 Still successfully queries a single file in Drill >> 1.4 >> >> I was searching the doc for changes in Drill 1.4 but could not find a >> hint what goes wrong? >> >> Any clues? >> >> Thanks, >> Alexander >> >>
