Hi Michele Could you also share the entire stack track in the Drillbit log when logging the JIRA?
I think you might have run this through SQLLine, so the entire stack trace might not be showing up. It helps to know where in the Drill code was this stack trace's call originating. Thanks Kunal -----Original Message----- From: Kunal Khatua [mailto:[email protected]] Sent: Friday, August 18, 2017 1:07 PM To: [email protected] Subject: RE: Unable to SELECT from parquet file with Hadoop 2.7.4 Glad that worked ! Not sure why the APIs in 2.7.4+ are not backward compatible, but it needs to be looked into. Could you file a JIRA ( https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=185&projectKey=DRILL ) with these details that you've shared? That helps us identify and prioritize issues faced by the community and allocate resources for it. Thanks Kunal -----Original Message----- From: Michele Lamarca [mailto:[email protected]] Sent: Friday, August 18, 2017 12:13 PM To: [email protected] Subject: Re: Unable to SELECT from parquet file with Hadoop 2.7.4 Hi Kunal, That does the trick! I moved nation.parquet to /user/drill/test, then executed SELECT * FROM hdfs.`/user/drill/test`; without errors. Thanks a lot for the suggestion! For completeness, I was able to reproduce the error with: Hadoop 2.7.4 with Drill 1.11 (default pom.xml) Hadoop 2.7.4 with Drill 1.11 (with -Dhadoop.version=2.7.4) Hadoop 2.8.0 with Drill 1.11 (default pom.xml) Hadoop 3.0.0-alpha4 with Drill 1.11 (default pom.xml) Kind regards, Michele On Fri, Aug 18, 2017 at 8:06 PM, Kunal Khatua <[email protected]> wrote: > Interesting. I'm presuming this works if the parquet file is in a directory, > right? > Was Drill built with Hadoop 2.7.4 dependencies or did you use the default > 2.7.1 that is there in the POM.XML ? > > A workaround for now would be to query on an enclosing directory, until > someone looks at the issue in more detail. > > -----Original Message----- > From: Michele Lamarca [mailto:[email protected]] > Sent: Friday, August 18, 2017 1:38 AM > To: [email protected] > Subject: Unable to SELECT from parquet file with Hadoop 2.7.4 > > Hi all, > > I'm currently testing Drill 1.11.0 with Hadoop 2.7.4. The following > select fails with 2.7.4, while it correctly executes with 2.7.3. I > found a possible relevant change here > https://issues.apache.org/jira/browse/HDFS-10673 > > Below you can find the error I get with 2.7.4. > > Thanks in advance! > > Best regards, > Michele > > > > 1/2 SELECT * FROM hdfs.`/user/drill/nation.parquet`; > Error: SYSTEM ERROR: RemoteException: /user/drill/nation.parquet (is not a > directory) > at > org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:272) > at > org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:215) > at > org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:199) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1752) > at > org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getFileInfo(FSDirStatAndListingOp.java:100) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3820) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1012) > at > org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:855) > at > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2217) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2213) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2213)
