Paolo, Hanifi created a JIRA for this issue:
https://issues.apache.org/jira/browse/DRILL-4416 A fix is available and should go into master soon. Thanks On Sun, Feb 21, 2016 at 2:52 AM, Paolo Spanevello <[email protected]> wrote: > Dear Hanifi, > > Yes is windows. the data is residing in a folder of my local pc. I'm using > this Storage Plugins as a copy of dfs storage plugins. > I do not know how to use hdfs. > > Any idea? > > Best, > Paolo > > { > "type": "file", > "enabled": true, > "connection": "file:///", > "workspaces": { > "root": { > "location": "/", > "writable": false, > "defaultInputFormat": null > }, > "tmp": { > "location": "/tmp", > "writable": true, > "defaultInputFormat": null > }, > "GC": { > "location": "/Users/user1/AppData/Local/folder", > "writable": true, > "defaultInputFormat": null > } > }, > "formats": { > "psv": { > "type": "text", > "extensions": [ > "tbl" > ], > "delimiter": "|" > }, > "csv": { > "type": "text", > "extensions": [ > "csv" > ], > "delimiter": "," > }, > "tsv": { > "type": "text", > "extensions": [ > "tsv" > ], > "delimiter": "\t" > }, > "parquet": { > "type": "parquet" > }, > "json": { > "type": "json" > }, > "avro": { > "type": "avro" > }, > "sequencefile": { > "type": "sequencefile", > "extensions": [ > "seq" > ] > }, > "csvh": { > "type": "text", > "extensions": [ > "csvh" > ], > "extractHeader": true, > "delimiter": "," > } > } > } > > 2016-02-20 0:15 GMT+01:00 Hanifi Gunes <[email protected]>: > > > Paolo, > > > > I understand that your platform is windows. Where is your data residing > > though? hdfs? > > > > Thanks. > > -Hanifi > > > > On Fri, Feb 19, 2016 at 2:43 PM, Abdel Hakim Deneche < > > [email protected]> > > wrote: > > > > > I think you are hitting the following issue: > > > > > > > > > > > > http://stackoverflow.com/questions/10336293/splitting-filenames-using-system-file-separator-symbol > > > > > > Can you open a JIRA for this, shouldn't take long to fix (hopefully) > > > > > > On Fri, Feb 19, 2016 at 1:38 PM, Paolo Spanevello < > [email protected]> > > > wrote: > > > > > > > Dear all, > > > > > > > > this is the error the occour when i run the query: > > > > > > > > SELECT * FROM > `Performance_Ride_Analytics`.`GC`.`./*/cache/rideDB.json` > > > > > > > > Could you support me? > > > > > > > > Best, > > > > Paolo > > > > > > > > VALIDATION ERROR: Unexpected internal error near index 1 > > > > \ > > > > ^ > > > > > > > > > > > > > > > > (org.apache.calcite.tools.ValidationException) > > > > java.util.regex.PatternSyntaxException: Unexpected internal error > near > > > > index 1 > > > > \ > > > > ^ > > > > org.apache.calcite.prepare.PlannerImpl.validate():189 > > > > org.apache.calcite.prepare.PlannerImpl.validateAndGetType():198 > > > > > > > > > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode():451 > > > > > > > > > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert():198 > > > > > > > > > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():167 > > > > org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():197 > > > > org.apache.drill.exec.work.foreman.Foreman.runSQL():909 > > > > org.apache.drill.exec.work.foreman.Foreman.run():244 > > > > java.util.concurrent.ThreadPoolExecutor.runWorker():1142 > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run():617 > > > > java.lang.Thread.run():745 > > > > Caused By (java.util.regex.PatternSyntaxException) Unexpected > > > > internal error near index 1 > > > > \ > > > > ^ > > > > java.util.regex.Pattern.error():1955 > > > > java.util.regex.Pattern.compile():1702 > > > > java.util.regex.Pattern.():1351 > > > > java.util.regex.Pattern.compile():1028 > > > > java.lang.String.split():2380 > > > > java.lang.String.split():2422 > > > > > > > org.apache.drill.exec.store.dfs.FileSelection.commonPathForFiles():154 > > > > org.apache.drill.exec.store.dfs.FileSelection.commonPath():135 > > > > org.apache.drill.exec.store.dfs.FileSelection.create():222 > > > > org.apache.drill.exec.store.dfs.FileSelection.create():189 > > > > > > > > > > > > > > org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create():569 > > > > > > > > > > > > > > org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create():370 > > > > > > > > > > org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.getNewEntry():96 > > > > org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.get():90 > > > > > > > > > > > > > > org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.getTable():524 > > > > org.apache.calcite.jdbc.SimpleCalciteSchema.getTable():82 > > > > > org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom():119 > > > > org.apache.calcite.prepare.CalciteCatalogReader.getTable():102 > > > > org.apache.calcite.prepare.CalciteCatalogReader.getTable():73 > > > > org.apache.calcite.sql.validate.EmptyScope.getTableNamespace():75 > > > > > > > > org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace():124 > > > > > > > org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():104 > > > > org.apache.calcite.sql.validate.AbstractNamespace.validate():86 > > > > > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():877 > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():863 > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2778 > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2763 > > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():2986 > > > > org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60 > > > > org.apache.calcite.sql.validate.AbstractNamespace.validate():86 > > > > > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():877 > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():863 > > > > org.apache.calcite.sql.SqlSelect.validate():210 > > > > > > > > > > > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():837 > > > > org.apache.calcite.sql.validate.SqlValidatorImpl.validate():551 > > > > org.apache.calcite.prepare.PlannerImpl.validate():187 > > > > org.apache.calcite.prepare.PlannerImpl.validateAndGetType():198 > > > > > > > > > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode():451 > > > > > > > > > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert():198 > > > > > > > > > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():167 > > > > org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():197 > > > > org.apache.drill.exec.work.foreman.Foreman.runSQL():909 > > > > org.apache.drill.exec.work.foreman.Foreman.run():244 > > > > java.util.concurrent.ThreadPoolExecutor.runWorker():1142 > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run():617 > > > > java.lang.Thread.run():745 > > > > > > > > > > > > 2016-02-16 17:35 GMT+01:00 Jinfeng Ni <[email protected]>: > > > > > > > > > Could you please turn on verbose error mode by running the > following > > > > > [1] then re-run the query and post the error message, or copy & > post > > > > > the drillbit log when the query was executed? > > > > > > > > > > ALTER SESSION SET `exec.errors.verbose` = true; > > > > > > > > > > That will give us more information about the error you saw. From > the > > > > > error message you posted, it's not clear whether the JSON data > itself > > > > > is not well formated, or Drill hit an execution bug. > > > > > > > > > > Thanks, > > > > > > > > > > > > > > > [1] > > > https://drill.apache.org/docs/troubleshooting/#enable-verbose-errors > > > > > > > > > > > > > > > > > > > > On Tue, Feb 16, 2016 at 2:45 AM, Paolino <[email protected]> > > wrote: > > > > > > Dear all, > > > > > > Someone could support me with this drill? > > > > > > > > > > > > Best regards, > > > > > > Paolo > > > > > > > > > > > > ----- Messaggio originale ----- > > > > > > Da: "Paolo Spanevello" <[email protected]> > > > > > > Inviato: 12/02/2016 21:15 > > > > > > A: "user" <[email protected]> > > > > > > Oggetto: Re: One single query for more files JSON > > > > > > > > > > > > yes with windows > > > > > > > > > > > > > > > > > > 2016-02-12 17:11 GMT+01:00 Zelaine Fong <[email protected]>: > > > > > > > > > > > > Are you running on Windows? If so, perhaps this is DRILL-4305? > > > > > > > > > > > > -- Zelaine > > > > > > > > > > > > On Fri, Feb 12, 2016 at 8:00 AM, Paolo Spanevello < > > > > [email protected]> > > > > > > > > > > > > wrote: > > > > > > > > > > > >> The schema and the files are the same. This is the error: > > > > > >> > > > > > >> ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the > > > query: > > > > > >> SELECT * FROM > > > > `Performance_Ride_Analytics`.`GC`.`./*/cache/rideDB.json` > > > > > >> [30027]Query execution error. Details:[ > > > > > >> VALIDATION ERROR: Unexpected internal error near index 1 > > > > > >> \ > > > > > >> ^ > > > > > >> > > > > > >> > > > > > >> 2016-02-12 16:43 GMT+01:00 Abdel Hakim Deneche < > > > [email protected] > > > > >: > > > > > >> > > > > > >> > Of course, if the schema changes between files, this will most > > > > likely > > > > > >> cause > > > > > >> > the query to fail > > > > > >> > > > > > > >> > On Fri, Feb 12, 2016 at 7:42 AM, Abdel Hakim Deneche < > > > > > >> > [email protected]> > > > > > >> > wrote: > > > > > >> > > > > > > >> > > Yes, it should work. > > > > > >> > > > > > > > >> > > On Fri, Feb 12, 2016 at 7:31 AM, Paolo Spanevello < > > > > > >> [email protected]> > > > > > >> > > wrote: > > > > > >> > > > > > > > >> > >> Dear All, > > > > > >> > >> > > > > > >> > >> Could i've a single query for more json files ? > > > > > >> > >> > > > > > >> > >> Example: > > > > > >> > >> > > > > > >> > >> - /user/folder1/file1.json > > > > > >> > >> - /user/folder2/file2.json > > > > > >> > >> - /user/folder3/file3.json > > > > > >> > >> > > > > > >> > >> Query: > > > > > >> > >> SELECT * FROM /user/*/file*.json > > > > > >> > >> > > > > > >> > >> Thanks a lot for your support. > > > > > >> > >> > > > > > >> > >> Best, > > > > > >> > >> Paolo > > > > > >> > >> > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > -- > > > > > >> > > > > > > > >> > > Abdelhakim Deneche > > > > > >> > > > > > > > >> > > Software Engineer > > > > > >> > > > > > > > >> > > <http://www.mapr.com/> > > > > > >> > > > > > > > >> > > > > > > > >> > > Now Available - Free Hadoop On-Demand Training > > > > > >> > > < > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > -- > > > > > >> > > > > > > >> > Abdelhakim Deneche > > > > > >> > > > > > > >> > Software Engineer > > > > > >> > > > > > > >> > <http://www.mapr.com/> > > > > > >> > > > > > > >> > > > > > > >> > Now Available - Free Hadoop On-Demand Training > > > > > >> > < > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Abdelhakim Deneche > > > > > > Software Engineer > > > > > > <http://www.mapr.com/> > > > > > > > > > Now Available - Free Hadoop On-Demand Training > > > < > > > > > > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > > > > > > > > > -- Abdelhakim Deneche Software Engineer <http://www.mapr.com/> Now Available - Free Hadoop On-Demand Training <http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
