[ 
https://issues.apache.org/jira/browse/IGNITE-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15134563#comment-15134563
 ] 

Vladimir Ozerov commented on IGNITE-2568:
-----------------------------------------

Essentially, we need to investigate Drill's code and understand how do they 
pick Hadoop configuration. 

> IGFS cannot be used as Apache Drill data source.
> ------------------------------------------------
>
>                 Key: IGNITE-2568
>                 URL: https://issues.apache.org/jira/browse/IGNITE-2568
>             Project: Ignite
>          Issue Type: Bug
>          Components: IGFS
>    Affects Versions: 1.5.0.final
>            Reporter: Vladimir Ozerov
>            Priority: Critical
>             Fix For: 1.6
>
>
> The problem was reported on user list: 
> http://apache-ignite-users.70518.x6.nabble.com/Apache-Drill-querying-IGFS-accelerated-H-DFS-td2840.html
> Even when IGFS is fully configured and is recognized correctly by installed 
> Hadoop, Apache Drill cannot use it as data source. The following stack trace 
> appears: 
> {code}
> 2016-02-05 13:14:03,507 [294b5fe3-8f63-2134-67e0-42f7111ead44:foreman] ERROR 
> o.a.d.exec.util.ImpersonationUtil - Failed to create DrillFileSystem for 
> proxy user: No FileSystem for scheme: igfs
> java.io.IOException: No FileSystem for scheme: igfs
>       at 
> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2644) 
> ~[hadoop-common-2.7.1.jar:na]
>       at 
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651) 
> ~[hadoop-common-2.7.1.jar:na]
>       at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) 
> ~[hadoop-common-2.7.1.jar:na]
>       at 
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) 
> ~[hadoop-common-2.7.1.jar:na]
>       at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) 
> ~[hadoop-common-2.7.1.jar:na]
>       at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) 
> ~[hadoop-common-2.7.1.jar:na]
>       at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170) 
> ~[hadoop-common-2.7.1.jar:na]
>       at 
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:92)
>  ~[drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.util.ImpersonationUtil$2.run(ImpersonationUtil.java:213)
>  ~[drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.util.ImpersonationUtil$2.run(ImpersonationUtil.java:210)
>  ~[drill-java-exec-1.4.0.jar:1.4.0]
>       at java.security.AccessController.doPrivileged(Native Method) 
> ~[na:1.8.0_40-ea]
>       at javax.security.auth.Subject.doAs(Subject.java:422) ~[na:1.8.0_40-ea]
>       at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>  ~[hadoop-common-2.7.1.jar:na]
>       at 
> org.apache.drill.exec.util.ImpersonationUtil.createFileSystem(ImpersonationUtil.java:210)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.util.ImpersonationUtil.createFileSystem(ImpersonationUtil.java:202)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory.accessible(WorkspaceSchemaFactory.java:150)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.store.dfs.FileSystemSchemaFactory$FileSystemSchema.<init>(FileSystemSchemaFactory.java:78)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.store.dfs.FileSystemSchemaFactory.registerSchemas(FileSystemSchemaFactory.java:65)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.store.dfs.FileSystemPlugin.registerSchemas(FileSystemPlugin.java:131)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.store.StoragePluginRegistry$DrillSchemaFactory.registerSchemas(StoragePluginRegistry.java:403)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.ops.QueryContext.getRootSchema(QueryContext.java:166) 
> [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.ops.QueryContext.getRootSchema(QueryContext.java:155) 
> [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.ops.QueryContext.getRootSchema(QueryContext.java:143) 
> [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.ops.QueryContext.getNewDefaultSchema(QueryContext.java:129)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> org.apache.drill.exec.planner.sql.DrillSqlWorker.<init>(DrillSqlWorker.java:93)
>  [drill-java-exec-1.4.0.jar:1.4.0]
>       at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:907) 
> [drill-java-exec-1.4.0.jar:1.4.0]
>       at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:244) 
> [drill-java-exec-1.4.0.jar:1.4.0]
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  [na:1.8.0_40-ea]
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_40-ea]
>       at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40-ea]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to