Dear Hanifi,
Yes is windows. the data is residing in a folder of my local pc. I'm using
this Storage Plugins as a copy of dfs storage plugins.
I do not know how to use hdfs.
Any idea?
Best,
Paolo
{
"type": "file",
"enabled": true,
"connection": "file:///",
"workspaces": {
"root": {
"location": "/",
"writable": false,
"defaultInputFormat": null
},
"tmp": {
"location": "/tmp",
"writable": true,
"defaultInputFormat": null
},
"GC": {
"location": "/Users/user1/AppData/Local/folder",
"writable": true,
"defaultInputFormat": null
}
},
"formats": {
"psv": {
"type": "text",
"extensions": [
"tbl"
],
"delimiter": "|"
},
"csv": {
"type": "text",
"extensions": [
"csv"
],
"delimiter": ","
},
"tsv": {
"type": "text",
"extensions": [
"tsv"
],
"delimiter": "\t"
},
"parquet": {
"type": "parquet"
},
"json": {
"type": "json"
},
"avro": {
"type": "avro"
},
"sequencefile": {
"type": "sequencefile",
"extensions": [
"seq"
]
},
"csvh": {
"type": "text",
"extensions": [
"csvh"
],
"extractHeader": true,
"delimiter": ","
}
}
}
2016-02-20 0:15 GMT+01:00 Hanifi Gunes <[email protected]>:
> Paolo,
>
> I understand that your platform is windows. Where is your data residing
> though? hdfs?
>
> Thanks.
> -Hanifi
>
> On Fri, Feb 19, 2016 at 2:43 PM, Abdel Hakim Deneche <
> [email protected]>
> wrote:
>
> > I think you are hitting the following issue:
> >
> >
> >
> http://stackoverflow.com/questions/10336293/splitting-filenames-using-system-file-separator-symbol
> >
> > Can you open a JIRA for this, shouldn't take long to fix (hopefully)
> >
> > On Fri, Feb 19, 2016 at 1:38 PM, Paolo Spanevello <[email protected]>
> > wrote:
> >
> > > Dear all,
> > >
> > > this is the error the occour when i run the query:
> > >
> > > SELECT * FROM `Performance_Ride_Analytics`.`GC`.`./*/cache/rideDB.json`
> > >
> > > Could you support me?
> > >
> > > Best,
> > > Paolo
> > >
> > > VALIDATION ERROR: Unexpected internal error near index 1
> > > \
> > > ^
> > >
> > >
> > >
> > > (org.apache.calcite.tools.ValidationException)
> > > java.util.regex.PatternSyntaxException: Unexpected internal error near
> > > index 1
> > > \
> > > ^
> > > org.apache.calcite.prepare.PlannerImpl.validate():189
> > > org.apache.calcite.prepare.PlannerImpl.validateAndGetType():198
> > >
> > >
> >
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode():451
> > >
> > >
> >
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert():198
> > >
> > >
> >
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():167
> > > org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():197
> > > org.apache.drill.exec.work.foreman.Foreman.runSQL():909
> > > org.apache.drill.exec.work.foreman.Foreman.run():244
> > > java.util.concurrent.ThreadPoolExecutor.runWorker():1142
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run():617
> > > java.lang.Thread.run():745
> > > Caused By (java.util.regex.PatternSyntaxException) Unexpected
> > > internal error near index 1
> > > \
> > > ^
> > > java.util.regex.Pattern.error():1955
> > > java.util.regex.Pattern.compile():1702
> > > java.util.regex.Pattern.():1351
> > > java.util.regex.Pattern.compile():1028
> > > java.lang.String.split():2380
> > > java.lang.String.split():2422
> > >
> > org.apache.drill.exec.store.dfs.FileSelection.commonPathForFiles():154
> > > org.apache.drill.exec.store.dfs.FileSelection.commonPath():135
> > > org.apache.drill.exec.store.dfs.FileSelection.create():222
> > > org.apache.drill.exec.store.dfs.FileSelection.create():189
> > >
> > >
> >
> org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create():569
> > >
> > >
> >
> org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create():370
> > >
> > >
> org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.getNewEntry():96
> > > org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.get():90
> > >
> > >
> >
> org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.getTable():524
> > > org.apache.calcite.jdbc.SimpleCalciteSchema.getTable():82
> > > org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom():119
> > > org.apache.calcite.prepare.CalciteCatalogReader.getTable():102
> > > org.apache.calcite.prepare.CalciteCatalogReader.getTable():73
> > > org.apache.calcite.sql.validate.EmptyScope.getTableNamespace():75
> > >
> > org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace():124
> > >
> > org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():104
> > > org.apache.calcite.sql.validate.AbstractNamespace.validate():86
> > >
> > >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():877
> > >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():863
> > >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2778
> > >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2763
> > >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():2986
> > > org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
> > > org.apache.calcite.sql.validate.AbstractNamespace.validate():86
> > >
> > >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():877
> > >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():863
> > > org.apache.calcite.sql.SqlSelect.validate():210
> > >
> > >
> >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():837
> > > org.apache.calcite.sql.validate.SqlValidatorImpl.validate():551
> > > org.apache.calcite.prepare.PlannerImpl.validate():187
> > > org.apache.calcite.prepare.PlannerImpl.validateAndGetType():198
> > >
> > >
> >
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode():451
> > >
> > >
> >
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert():198
> > >
> > >
> >
> org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():167
> > > org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():197
> > > org.apache.drill.exec.work.foreman.Foreman.runSQL():909
> > > org.apache.drill.exec.work.foreman.Foreman.run():244
> > > java.util.concurrent.ThreadPoolExecutor.runWorker():1142
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run():617
> > > java.lang.Thread.run():745
> > >
> > >
> > > 2016-02-16 17:35 GMT+01:00 Jinfeng Ni <[email protected]>:
> > >
> > > > Could you please turn on verbose error mode by running the following
> > > > [1] then re-run the query and post the error message, or copy & post
> > > > the drillbit log when the query was executed?
> > > >
> > > > ALTER SESSION SET `exec.errors.verbose` = true;
> > > >
> > > > That will give us more information about the error you saw. From the
> > > > error message you posted, it's not clear whether the JSON data itself
> > > > is not well formated, or Drill hit an execution bug.
> > > >
> > > > Thanks,
> > > >
> > > >
> > > > [1]
> > https://drill.apache.org/docs/troubleshooting/#enable-verbose-errors
> > > >
> > > >
> > > >
> > > > On Tue, Feb 16, 2016 at 2:45 AM, Paolino <[email protected]>
> wrote:
> > > > > Dear all,
> > > > > Someone could support me with this drill?
> > > > >
> > > > > Best regards,
> > > > > Paolo
> > > > >
> > > > > ----- Messaggio originale -----
> > > > > Da: "Paolo Spanevello" <[email protected]>
> > > > > Inviato: 12/02/2016 21:15
> > > > > A: "user" <[email protected]>
> > > > > Oggetto: Re: One single query for more files JSON
> > > > >
> > > > > yes with windows
> > > > >
> > > > >
> > > > > 2016-02-12 17:11 GMT+01:00 Zelaine Fong <[email protected]>:
> > > > >
> > > > > Are you running on Windows? If so, perhaps this is DRILL-4305?
> > > > >
> > > > > -- Zelaine
> > > > >
> > > > > On Fri, Feb 12, 2016 at 8:00 AM, Paolo Spanevello <
> > > [email protected]>
> > > > >
> > > > > wrote:
> > > > >
> > > > >> The schema and the files are the same. This is the error:
> > > > >>
> > > > >> ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the
> > query:
> > > > >> SELECT * FROM
> > > `Performance_Ride_Analytics`.`GC`.`./*/cache/rideDB.json`
> > > > >> [30027]Query execution error. Details:[
> > > > >> VALIDATION ERROR: Unexpected internal error near index 1
> > > > >> \
> > > > >> ^
> > > > >>
> > > > >>
> > > > >> 2016-02-12 16:43 GMT+01:00 Abdel Hakim Deneche <
> > [email protected]
> > > >:
> > > > >>
> > > > >> > Of course, if the schema changes between files, this will most
> > > likely
> > > > >> cause
> > > > >> > the query to fail
> > > > >> >
> > > > >> > On Fri, Feb 12, 2016 at 7:42 AM, Abdel Hakim Deneche <
> > > > >> > [email protected]>
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Yes, it should work.
> > > > >> > >
> > > > >> > > On Fri, Feb 12, 2016 at 7:31 AM, Paolo Spanevello <
> > > > >> [email protected]>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > >> Dear All,
> > > > >> > >>
> > > > >> > >> Could i've a single query for more json files ?
> > > > >> > >>
> > > > >> > >> Example:
> > > > >> > >>
> > > > >> > >> - /user/folder1/file1.json
> > > > >> > >> - /user/folder2/file2.json
> > > > >> > >> - /user/folder3/file3.json
> > > > >> > >>
> > > > >> > >> Query:
> > > > >> > >> SELECT * FROM /user/*/file*.json
> > > > >> > >>
> > > > >> > >> Thanks a lot for your support.
> > > > >> > >>
> > > > >> > >> Best,
> > > > >> > >> Paolo
> > > > >> > >>
> > > > >> > >
> > > > >> > >
> > > > >> > >
> > > > >> > > --
> > > > >> > >
> > > > >> > > Abdelhakim Deneche
> > > > >> > >
> > > > >> > > Software Engineer
> > > > >> > >
> > > > >> > > <http://www.mapr.com/>
> > > > >> > >
> > > > >> > >
> > > > >> > > Now Available - Free Hadoop On-Demand Training
> > > > >> > > <
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > --
> > > > >> >
> > > > >> > Abdelhakim Deneche
> > > > >> >
> > > > >> > Software Engineer
> > > > >> >
> > > > >> > <http://www.mapr.com/>
> > > > >> >
> > > > >> >
> > > > >> > Now Available - Free Hadoop On-Demand Training
> > > > >> > <
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> >
> >
> > --
> >
> > Abdelhakim Deneche
> >
> > Software Engineer
> >
> > <http://www.mapr.com/>
> >
> >
> > Now Available - Free Hadoop On-Demand Training
> > <
> >
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> > >
> >
>
