[
https://issues.apache.org/jira/browse/DRILL-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16380160#comment-16380160
]
ASF GitHub Bot commented on DRILL-4120:
---------------------------------------
Github user arina-ielchiieva commented on the issue:
https://github.com/apache/drill/pull/1138
You are basically reverting changes done in DRILL-3810 to support schema
validation in Avro.
Avro format is strict and has schema. Should Drill treat it the same way or
do loosen parsing?
We should evaluate the option of leaving schema for avro but adding
implicit columns. Maybe the change won't be as easy as changing
`AvroDrillTable` to `DynamicDrillTable` but it might be more correct.
You can also start mailing thread on dev / user list, asking about treating
avro as dynamic format (listing pros and cons) and get feedback from the users.
[1] https://issues.apache.org/jira/browse/DRILL-3810
> dir0 does not work when the directory structure contains Avro files
> -------------------------------------------------------------------
>
> Key: DRILL-4120
> URL: https://issues.apache.org/jira/browse/DRILL-4120
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 1.3.0
> Reporter: Stefán Baxter
> Assignee: Volodymyr Vysotskyi
> Priority: Major
> Fix For: 1.13.0
>
> Attachments:
> 0001-DRILL-4120-Support-reading-directories-having-avro-f.patch
>
>
> Any select statment containing dirN fails if the target directory structure
> contains Avro files.
> Steps to test:
> 1. create a simple directory structure
> 2. copy an avro file into each directory
> 3. execute a query containing dir0
> outcome:
> Error: VALIDATION ERROR: From line 1, column 117 to line 1, column 120:
> Column 'dir0' not found in any table
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
