For HDFS, your storage plugin configuration should be something like this:
{
"type": "file",
"enabled": true,
"connection": "hdfs://<IP Address>:<Port>”, // IP address and port number
of name node metadata service
"config": null,
"workspaces": {
"root": {
"location": "/",
"writable": true,
"defaultInputFormat": null
},
"tmp": {
"location": "/tmp",
"writable": true,
"defaultInputFormat": null
}
},
Also, try hadoop dfs -ls command to see if you can list the files.
Thanks,
Padma
On Aug 23, 2017, at 12:18 PM, Lee, David
<[email protected]<mailto:[email protected]>> wrote:
HDFS storage plugin should be set to your HDFS name node url..
-----Original Message-----
From: Zubair, Muhammad [mailto:[email protected]]
Sent: Wednesday, August 23, 2017 11:33 AM
To: [email protected]<mailto:[email protected]>
Subject: Apache Drill unable to read files from HDFS (Resource error: Failed to
create schema tree)
Hello,
After setting up drill on one of the edge nodes of our HDFS cluster, I am
unable to read any hdfs files. I can query data from local files (as long as
they are in a folder that has 777 permissions) but querying data from hdfs
fails with the following error:
Error: RESOURCE ERROR: Failed to create schema tree.
[Error Id: d9f7908c-6c3b-49c0-a11e-71c004d27f46 on server-name:31010]
(state=,code=0)
Query:
0: jdbc:drill:zk=local> select * from hdfs.`/names/city.parquet` limit 2;
Querying from local file works fine:
0: jdbc:drill:zk=local> select * from dfs.`/tmp/city.parquet` limit 2; My HDFS
settings are similar to the DFS settings, except for the connection URL being
the server address instead of file:/// I can't find anything online regarding
this error for drill.
_______________________________________________________________________
If you received this email in error, please advise the sender (by return email
or otherwise) immediately. You have consented to receive the attached
electronically at the above-noted email address; please retain a copy of this
confirmation for future reference.
Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur
immédiatement, par retour de courriel ou par un autre moyen. Vous avez accepté
de recevoir le(s) document(s) ci-joint(s) par voie électronique à l'adresse
courriel indiquée ci-dessus; veuillez conserver une copie de cette confirmation
pour les fins de reference future.
This message may contain information that is confidential or privileged. If you
are not the intended recipient, please advise the sender immediately and delete
this message. See
http://www.blackrock.com/corporate/en-us/compliance/email-disclaimers for
further information. Please refer to
http://www.blackrock.com/corporate/en-us/compliance/privacy-policy for more
information about BlackRock’s Privacy Policy.
For a list of BlackRock's office addresses worldwide, see
http://www.blackrock.com/corporate/en-us/about-us/contacts-locations.
© 2017 BlackRock, Inc. All rights reserved.
