Daniel Barclay (Drill) created DRILL-3814:
---------------------------------------------
Summary: Directory containing only unrecognized files reported as
not found vs. taken as empty table
Key: DRILL-3814
URL: https://issues.apache.org/jira/browse/DRILL-3814
Project: Apache Drill
Issue Type: Bug
Components: SQL Parser, Storage - Other
Reporter: Daniel Barclay (Drill)
Assignee: Aman Sinha
A directory subtree all of whose descendent files have unrecognized extensions
is reported as non-existent rather treated as a table with zero rows.
Is this intended?
(The error message is the exact same error message that results if the user
gets a directory name wrong and refers to a non-existent directory, making the
message really confusing and misleading.)
For example, for directory {{/tmp/unrecognized_files_directory}} containing
only file {{/tmp/unrecognized_files_directory/junk.junk}}:
{noformat}
0: jdbc:drill:zk=local> SELECT * FROM
`dfs`.`tmp`.`unrecognized_files_directory`;
Sep 20, 2015 11:16:34 PM org.apache.calcite.sql.validate.SqlValidatorException
<init>
SEVERE: org.apache.calcite.sql.validate.SqlValidatorException: Table
'dfs.tmp.unrecognized_files_directory' not found
Sep 20, 2015 11:16:34 PM org.apache.calcite.runtime.CalciteException <init>
SEVERE: org.apache.calcite.runtime.CalciteContextException: From line 1, column
15 to line 1, column 19: Table 'dfs.tmp.unrecognized_files_directory' not found
Error: VALIDATION ERROR: From line 1, column 15 to line 1, column 19: Table
'dfs.tmp.unrecognized_files_directory' not found
[Error Id: 0ce9ba05-7f62-4063-a2c0-7d2b4f1f7967 on dev-linux2:31010]
(state=,code=0)
0: jdbc:drill:zk=local>
{noformat}
Notice how that is the same message as for a non-existent directory:
{noformat}
0: jdbc:drill:zk=local> SELECT * FROM `dfs`.`tmp`.`no_such_directory`;
Sep 20, 2015 11:17:12 PM org.apache.calcite.sql.validate.SqlValidatorException
<init>
SEVERE: org.apache.calcite.sql.validate.SqlValidatorException: Table
'dfs.tmp.no_such_directory' not found
Sep 20, 2015 11:17:12 PM org.apache.calcite.runtime.CalciteException <init>
SEVERE: org.apache.calcite.runtime.CalciteContextException: From line 1, column
15 to line 1, column 19: Table 'dfs.tmp.no_such_directory' not found
Error: VALIDATION ERROR: From line 1, column 15 to line 1, column 19: Table
'dfs.tmp.no_such_directory' not found
[Error Id: 49f423f1-5dfe-4435-8b72-78e0b999980e on dev-linux2:31010]
(state=,code=0)
0: jdbc:drill:zk=local>
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
