GitHub user chunhui-shi opened a pull request:
https://github.com/apache/drill/pull/1032
DRILL-5089: Dynamically load schema of storage plugin only when needeâ¦
â¦d for every query
For each query, loading all storage plugins and loading all workspaces
under file system plugins is not needed.
This patch use DynamicRootSchema as the root schema for Drill. Which loads
correspondent storage only when needed.
infoschema to read full schema information and load second level schema
accordingly.
for workspaces under the same Filesyetm, no need to create FileSystem for
each workspace.
use fs.access API to check permission which is available after HDFS 2.6
except for windows + local file system case.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/chunhui-shi/drill DRILL-5089-pull
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/drill/pull/1032.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1032
----
commit a381677c59a7371733bae12ad4896b7cc927da5e
Author: chunhui-shi <c...@maprtech.com>
Date: 2017-11-03T00:06:25Z
DRILL-5089: Dynamically load schema of storage plugin only when needed for
every query
For each query, loading all storage plugins and loading all workspaces
under file system plugins is not needed.
This patch use DynamicRootSchema as the root schema for Drill. Which loads
correspondent storage only when needed.
infoschema to read full schema information and load second level schema
accordingly.
for workspaces under the same Filesyetm, no need to create FileSystem for
each workspace.
use fs.access API to check permission which is available after HDFS 2.6
except for windows + local file system case.
----
---
