Glad that worked ! Not sure why the APIs in 2.7.4+ are not backward compatible, but it needs to be looked into.
Could you file a JIRA ( https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL ) with these details that you've shared? That helps us identify and prioritize issues faced by the community and allocate resources for it. Thanks Kunal -----Original Message----- From: Michele Lamarca [mailto:[email protected]] Sent: Friday, August 18, 2017 12:13 PM To: [email protected] Subject: Re: Unable to SELECT from parquet file with Hadoop 2.7.4 Hi Kunal, That does the trick! I moved nation.parquet to /user/drill/test, then executed SELECT * FROM hdfs.`/user/drill/test`; without errors. Thanks a lot for the suggestion! For completeness, I was able to reproduce the error with: Hadoop 2.7.4 with Drill 1.11 (default pom.xml) Hadoop 2.7.4 with Drill 1.11 (with -Dhadoop.version=2.7.4) Hadoop 2.8.0 with Drill 1.11 (default pom.xml) Hadoop 3.0.0-alpha4 with Drill 1.11 (default pom.xml) Kind regards, Michele On Fri, Aug 18, 2017 at 8:06 PM, Kunal Khatua <[email protected]> wrote: > Interesting. I'm presuming this works if the parquet file is in a directory, > right? > Was Drill built with Hadoop 2.7.4 dependencies or did you use the default > 2.7.1 that is there in the POM.XML ? > > A workaround for now would be to query on an enclosing directory, until > someone looks at the issue in more detail. > > -----Original Message----- > From: Michele Lamarca [mailto:[email protected]] > Sent: Friday, August 18, 2017 1:38 AM > To: [email protected] > Subject: Unable to SELECT from parquet file with Hadoop 2.7.4 > > Hi all, > > I'm currently testing Drill 1.11.0 with Hadoop 2.7.4. The following > select fails with 2.7.4, while it correctly executes with 2.7.3. I > found a possible relevant change here > https://issues.apache.org/jira/browse/HDFS-10673 > > Below you can find the error I get with 2.7.4. > > Thanks in advance! > > Best regards, > Michele > > > > 1/2 SELECT * FROM hdfs.`/user/drill/nation.parquet`; > Error: SYSTEM ERROR: RemoteException: /user/drill/nation.parquet (is not a > directory) > at > org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:272) > at > org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:215) > at > org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:199) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1752) > at > org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:100) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3820) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1012) > at > org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:855) > at > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2217) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2213) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2213)
