[
https://issues.apache.org/jira/browse/DRILL-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498393#comment-16498393
]
ASF GitHub Bot commented on DRILL-5365:
---------------------------------------
ilooner commented on issue #1296: DRILL-5365: Prevent plugin config from
changing default fs. Make DrillFileSystem Immutable.
URL: https://github.com/apache/drill/pull/1296#issuecomment-393973462
@paul-rogers I have added Chun's steps for reproducing the issue to the PR
description. The issue happens when doing a table drop and CTAS. My
understanding is that this would not happen when doing joins.
I agree that we should find the root cause. I will work with Chun to add
extra debugging to his repro to chase down how the information is leaking into
the FileSystem configuration.
However, I would like to keep the changes that enforce the immutability of
DrillFileSystem. It would make things easier moving forward since a developer
only has to remember two things about the DrillFileSystem. 1.) It's immutable.
2.) It's impossible for them to screw up the DrillFileSystem after it's
created. Currently the DrillFileSystem's contract is ambiguous and unclear, and
there are many accidental ways for a developer to corrupt the DrillFileSystem
after it's created. I would rather make all of these things explicit and
enforced.
I'll update the PR with an RCA in a while.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> FileNotFoundException when reading a parquet file
> -------------------------------------------------
>
> Key: DRILL-5365
> URL: https://issues.apache.org/jira/browse/DRILL-5365
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Hive
> Affects Versions: 1.10.0
> Reporter: Chun Chang
> Assignee: Timothy Farkas
> Priority: Major
> Fix For: 1.14.0
>
>
> The parquet file is generated through the following CTAS.
> To reproduce the issue: 1) two or more nodes cluster; 2) enable
> impersonation; 3) set "fs.default.name": "file:///" in hive storage plugin;
> 4) restart drillbits; 5) as a regular user, on node A, drop the table/file;
> 6) ctas from a large enough hive table as source to recreate the table/file;
> 7) query the table from node A should work; 8) query from node B as same user
> should reproduce the issue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
