Hi Sorabh,
Please find the attached storage plugin information. I am changing my workspace
correctly which I have verified from web UI before running my query.
I am using the workspace tpcdsView as mentioned in the storage plugin; where I
would like to create the table and the Query user has write permissions to this
path. Here I am trying to write to NFS mount path.
Query that I am running:
create table stk.tpcdsView.`web_returns` as select * from
stk.`/mapr/nscprod01.ericsson.com/NSC-TEST/stk/tpcdsView/web_returns_csv1000`
limit 20;
Best regards,
_________________________
Tilak Surneni
-----Original Message-----
From: Sorabh Hamirwasia [mailto:[email protected]]
Sent: Wednesday, May 30, 2018 10:47 PM
To: [email protected]
Subject: Re: How to Start Drill Service From Linux Non-root user
Hi Surneni,
Can you please share few informations:
1) Please share the query and filesystem storage plugin configuration.
2) What is your current workspace while executing the query ?
Thanks,
Sorabh
________________________________
From: Surneni Tilak <[email protected]>
Sent: Wednesday, May 30, 2018 2:05:22 AM
To: [email protected]
Subject: RE: How to Start Drill Service From Linux Non-root user
Hi Sorabh,
Thanks for your response. I am asking about running queries as Query user and I
have enabled user impersonation. But when I am trying to create a table from
query user in the path where the query user has full permissions it's not
getting created and facing the below error. So I would like to know while
creating tables will drill try to create the tables as process user or logged
in user ?
Error Message While creating Table:
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
IOException: Mkdirs failed to create
/mapr/my.dev.cluster/data/stk/tpcdsParquet/web_returns (exists=false,
cwd=file:/usr/local/drill/bin)
When I browsed regarding the above error message I found other people got
similar kind of error message because of space issue, So I tried to write only
few records even then same error is repeating. Please help.
Best regards,
_________________________
Tilak Surneni
-----Original Message-----
From: Sorabh Hamirwasia [mailto:[email protected]]
Sent: Wednesday, May 30, 2018 12:32 AM
To: [email protected]
Subject: Re: How to Start Drill Service From Linux Non-root user
Hi Surneni,
With respect to using the service specific to a particular user other than
root, do you mean executing queries as a query user rather than Drill process
user ? If yes then you need to enable impersonation for that on Drillbit side
[1]. Later when you connect using client tool (like sqlline) provide the
username with which you want Drill to execute query using user (like
user=testUser) parameter in connection url.
[1]:
https://urldefense.proofpoint.com/v2/url?u=https-3A__drill.apache.org_docs_configuring-2Duser-2Dimpersonation_&d=DwIFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=gRpEl0WzXE3EMrwj0KFbZXGXRyadOthF2jlYxvhTlQg&m=VrfIufa_MkFm_STgyQ6vmPg4Q2t7qg5XJAbl0P81aEc&s=TDtmyeNYPwL2neemZUvA5egF9btnkoH5_jJUoqfu7zQ&e=
Thanks,
Sorabh
________________________________
From: Surneni Tilak <[email protected]>
Sent: Thursday, May 24, 2018 3:01:02 AM
To: [email protected]
Subject: How to Start Drill Service From Linux Non-root user
Hi Team,
May I know how to start drill service from a user which should not be root.
What are the privileges that a non-root user should fulfill to start drill
service. If I start the service as a root user then how to use the service
specific to a particular user other than root.
Best regards,
Tilak
{
"type": "file",
"enabled": true,
"connection": "file:///",
"config": null,
"workspaces": {
"root": {
"location": "/",
"writable": true,
"defaultInputFormat": null,
"allowAccessOutsideWorkspace": false
},
"tpcdsRaw": {
"location": "/mapr/my.dev.cluster/NSC-TEST/stk/tpcdsRaw",
"writable": true,
"defaultInputFormat": "csv",
"allowAccessOutsideWorkspace": true
},
"tpcdsParquet": {
"location": "/mapr/my.dev.cluster/NSC-TEST/stk/tpcdsParquet",
"writable": true,
"defaultInputFormat": "parquet",
"allowAccessOutsideWorkspace": false
},
"tpcdsView": {
"location": "/mapr/my.dev.cluster/NSC-TEST/stk/tpcdsView",
"writable": true,
"defaultInputFormat": "csv",
"allowAccessOutsideWorkspace": true
},
"tmp": {
"location": "/tmp",
"writable": true,
"defaultInputFormat": null,
"allowAccessOutsideWorkspace": true
}
},
"formats": {
"psv": {
"type": "text",
"extensions": [
"tbl"
],
"delimiter": "|"
},
"csv": {
"type": "text",
"extensions": [
"csv"
],
"delimiter": ","
},
"dat": {
"type": "text",
"extensions": [
"dat"
],
"delimiter": "|"
},
"tsv": {
"type": "text",
"extensions": [
"tsv"
],
"delimiter": "\t"
},
"httpd": {
"type": "httpd",
"logFormat": "%h %t \"%r\" %>s %b \"%{Referer}i\""
},
"parquet": {
"type": "parquet"
},
"json": {
"type": "json",
"extensions": [
"json"
]
},
"pcap": {
"type": "pcap"
},
"avro": {
"type": "avro"
},
"sequencefile": {
"type": "sequencefile",
"extensions": [
"seq"
]
},
"csvh": {
"type": "text",
"extensions": [
"csvh"
],
"extractHeader": true,
"delimiter": ","
}
}
}
