[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543474#comment-16543474 ] Jaume M commented on HIVE-20001: We should create the tables according to {{db.getOwnerName}}, not with {{UserGroupInformation.getCurrentUser}} as the latest patch. > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Affects Versions: 3.0.0 >Reporter: Jaume M >Assignee: Jaume M >Priority: Critical > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch, HIVE-20001.5.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,244|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Could not open client transport with JDBC Uri: > jdbc:hive2://ctr-e138-1518143905142-375925-01-04.hwx.site:10001/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit:
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535945#comment-16535945 ] Dongjoon Hyun commented on HIVE-20001: -- This patch has a bug for `non-hive` catalog. For `non-hive` catalog, warehouse/database/tables are owned by non-hive users previously. 1) the warehouse is owned by non-hive users. 2) the tables are created as the table owners (also non-hive users). 3) this patch enforces CREATE DATABASE as a admin, `hive`, and breaks table creations in (2). Could you add a test case for that and fix it? > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch, HIVE-20001.5.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,244|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Could not open client transport with JDBC Uri: >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535744#comment-16535744 ] Hive QA commented on HIVE-20001: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12930536/HIVE-20001.5.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 14635 tests executed *Failed tests:* {noformat} TestAutoPurgeTables - did not produce a TEST-*.xml file (likely timed out) (batchId=240) TestSparkStatistics - did not produce a TEST-*.xml file (likely timed out) (batchId=240) org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druid_timestamptz] (batchId=191) org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_joins] (batchId=191) org.apache.hadoop.hive.cli.TestMiniDruidCliDriver.testCliDriver[druidmini_masking] (batchId=191) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12441/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12441/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12441/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 5 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12930536 - PreCommit-HIVE-Build > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch, HIVE-20001.5.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535737#comment-16535737 ] Hive QA commented on HIVE-20001: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 34s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 58s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 43s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 58s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m 55s{color} | {color:blue} standalone-metastore in master has 217 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 57s{color} | {color:blue} ql in master has 2287 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 46s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 23s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 42s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 42s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 21s{color} | {color:red} standalone-metastore: The patch generated 2 new + 581 unchanged - 0 fixed = 583 total (was 581) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 1s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 7m 1s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 50s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 33m 50s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile xml | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-12441/dev-support/hive-personality.sh | | git revision | master / 8494522 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-12441/yetus/diff-checkstyle-standalone-metastore.txt | | modules | C: standalone-metastore ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-12441/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch, HIVE-20001.5.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534079#comment-16534079 ] ASF GitHub Bot commented on HIVE-20001: --- GitHub user beltran opened a pull request: https://github.com/apache/hive/pull/391 HIVE-20001: With doas set to true, running select query as hrt_qa use… …r on external table fails due to permission denied to read /warehouse/tablespace/managed directory You can merge this pull request into a Git repository by running: $ git pull https://github.com/beltran/hive HIVE-20001-4 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/391.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #391 commit 9de14778b2d7e2eb4e8504cd936fa6d8717f57f9 Author: Jaume Marhuenda Date: 2018-07-01T03:47:15Z HIVE-20001: With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534014#comment-16534014 ] ASF GitHub Bot commented on HIVE-20001: --- Github user beltran closed the pull request at: https://github.com/apache/hive/pull/389 > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,244|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Could not open client transport with JDBC Uri: > jdbc:hive2://ctr-e138-1518143905142-375925-01-04.hwx.site:10001/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit: > Failed to open new session: >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534015#comment-16534015 ] ASF GitHub Bot commented on HIVE-20001: --- Github user beltran closed the pull request at: https://github.com/apache/hive/pull/380 > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,244|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Could not open client transport with JDBC Uri: > jdbc:hive2://ctr-e138-1518143905142-375925-01-04.hwx.site:10001/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit: > Failed to open new session: >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16533312#comment-16533312 ] Hive QA commented on HIVE-20001: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12930227/HIVE-20001.4.patch {color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 14642 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12394/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12394/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12394/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12930227 - PreCommit-HIVE-Build > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16533295#comment-16533295 ] Hive QA commented on HIVE-20001: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 59s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 33s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 50s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 3s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 20s{color} | {color:blue} standalone-metastore in master has 228 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 7s{color} | {color:blue} ql in master has 2287 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 12s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 25s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 26s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 55s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 55s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 1s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 1s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 1s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 7m 53s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 11s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 37m 53s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile xml | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-12394/dev-support/hive-personality.sh | | git revision | master / 5e2a530 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: standalone-metastore ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-12394/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch, HIVE-20001.4.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531414#comment-16531414 ] Hive QA commented on HIVE-20001: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12930012/HIVE-20001.3.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12349/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12349/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12349/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12930012/HIVE-20001.3.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12930012 - PreCommit-HIVE-Build > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530900#comment-16530900 ] Hive QA commented on HIVE-20001: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12930012/HIVE-20001.3.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 14650 tests executed *Failed tests:* {noformat} TestMiniDruidCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=190) [druidmini_dynamic_partition.q,druidmini_expressions.q,druidmini_test_alter.q,druidmini_test1.q,druidmini_test_insert.q] org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[ctas_uses_database_location] (batchId=36) org.apache.hadoop.hive.ql.security.TestStorageBasedMetastoreAuthorizationProvider.testSimplePrivileges (batchId=240) org.apache.hadoop.hive.ql.security.TestStorageBasedMetastoreAuthorizationProviderWithACL.testSimplePrivileges (batchId=254) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12340/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12340/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12340/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 4 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12930012 - PreCommit-HIVE-Build > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530875#comment-16530875 ] Hive QA commented on HIVE-20001: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 51s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 5s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 52s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 56s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m 56s{color} | {color:blue} standalone-metastore in master has 228 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 1s{color} | {color:blue} ql in master has 2286 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 10s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 24s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 44s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 44s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 21s{color} | {color:red} standalone-metastore: The patch generated 8 new + 603 unchanged - 0 fixed = 611 total (was 603) {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 2s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 7m 9s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 9s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 35m 30s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile xml | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-12340/dev-support/hive-personality.sh | | git revision | master / f012691 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-12340/yetus/diff-checkstyle-standalone-metastore.txt | | whitespace | http://104.198.109.242/logs//PreCommit-HIVE-Build-12340/yetus/whitespace-eol.txt | | modules | C: standalone-metastore ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-12340/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530503#comment-16530503 ] ASF GitHub Bot commented on HIVE-20001: --- GitHub user beltran opened a pull request: https://github.com/apache/hive/pull/389 HIVE-20001: With doas set to true, running select query as hrt_qa use… …r on external table fails due to permission denied to read /warehouse/tablespace/managed directory You can merge this pull request into a Git repository by running: $ git pull https://github.com/beltran/hive HIVE-20001-3 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/389.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #389 commit 764d76de31f83b2c5985ad29410135faf4e32998 Author: Jaume Marhuenda Date: 2018-07-01T03:47:15Z HIVE-20001: With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch, HIVE-20001.3.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530360#comment-16530360 ] ASF GitHub Bot commented on HIVE-20001: --- Github user beltran closed the pull request at: https://github.com/apache/hive/pull/387 > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch, > HIVE-20001.2.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,244|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Could not open client transport with JDBC Uri: > jdbc:hive2://ctr-e138-1518143905142-375925-01-04.hwx.site:10001/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit: > Failed to open new session: > org.apache.hadoop.hive.ql.metadata.HiveException: >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530276#comment-16530276 ] ASF GitHub Bot commented on HIVE-20001: --- GitHub user beltran opened a pull request: https://github.com/apache/hive/pull/387 HIVE-20001: With doas set to true, running select query as hrt_qa use… …r on external table fails due to permission denied to read /warehouse/tablespace/managed directory Special attention to whether the appropriate create/upgrade sql scripts have been modified. You can merge this pull request into a Git repository by running: $ git pull https://github.com/beltran/hive HIVE-20001-2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/387.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #387 commit 7b722374af80172f947f78a80a11565d13ddd4a7 Author: Jaume Marhuenda Date: 2018-07-01T03:47:15Z HIVE-20001: With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection:
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525280#comment-16525280 ] Hive QA commented on HIVE-20001: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12929285/HIVE-20001.1.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12190/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12190/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12190/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12929285/HIVE-20001.1.patch was found in seen patch url's cache and a test was probably run already on it. Aborting... {noformat} This message is automatically generated. ATTACHMENT ID: 12929285 - PreCommit-HIVE-Build > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525124#comment-16525124 ] Hive QA commented on HIVE-20001: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12929285/HIVE-20001.1.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 14609 tests executed *Failed tests:* {noformat} org.apache.hive.jdbc.TestTriggersWorkloadManager.testMultipleTriggers2 (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitions (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitionsMultiInsert (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedDynamicPartitionsUnionAll (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedFiles (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomNonExistent (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomReadOps (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighBytesRead (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighShuffleBytes (batchId=247) org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerVertexRawInputSplitsNoKill (batchId=247) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12187/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12187/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12187/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 10 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12929285 - PreCommit-HIVE-Build > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525088#comment-16525088 ] Hive QA commented on HIVE-20001: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 3s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 5s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 42s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 6s{color} | {color:blue} ql in master has 2280 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 57s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 27s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 5s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 5s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 40s{color} | {color:red} ql: The patch generated 7 new + 23 unchanged - 2 fixed = 30 total (was 25) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 4m 15s{color} | {color:red} ql generated 4 new + 2280 unchanged - 0 fixed = 2284 total (was 2280) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 58s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 24m 4s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | FindBugs | module:ql | | | org.apache.hadoop.hive.ql.security.authorization.Privilege defines equals and uses Object.hashCode() At Privilege.java:Object.hashCode() At Privilege.java:[lines 121-126] | | | org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider$PrivilegeExtractor.getReadReqPriv() may expose internal representation by returning StorageBasedAuthorizationProvider$PrivilegeExtractor.readReqPriv At StorageBasedAuthorizationProvider.java:by returning StorageBasedAuthorizationProvider$PrivilegeExtractor.readReqPriv At StorageBasedAuthorizationProvider.java:[line 505] | | | org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider$PrivilegeExtractor.getWriteReqPriv() may expose internal representation by returning StorageBasedAuthorizationProvider$PrivilegeExtractor.writeReqPriv At StorageBasedAuthorizationProvider.java:by returning StorageBasedAuthorizationProvider$PrivilegeExtractor.writeReqPriv At StorageBasedAuthorizationProvider.java:[line 509] | | | Should org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider$PrivilegeExtractor be a _static_ inner class? At StorageBasedAuthorizationProvider.java:inner class? At StorageBasedAuthorizationProvider.java:[lines 467-509] | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-12187/dev-support/hive-personality.sh | | git revision | master / c7fe4ef | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-12187/yetus/diff-checkstyle-ql.txt | | findbugs | http://104.198.109.242/logs//PreCommit-HIVE-Build-12187/yetus/new-findbugs-ql.html | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-12187/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > With doas set to true, running select query as hrt_qa user on external table >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524324#comment-16524324 ] Jaume M commented on HIVE-20001: Thank you [~ashutoshc] > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch, HIVE-20001.1.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,244|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Could not open client transport with JDBC Uri: > jdbc:hive2://ctr-e138-1518143905142-375925-01-04.hwx.site:10001/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit: > Failed to open new session: > org.apache.hadoop.hive.ql.metadata.HiveException: > MetaException(message:java.security.AccessControlException: Permission > denied: user=hrt_qa, access=READ, >
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524320#comment-16524320 ] Ashutosh Chauhan commented on HIVE-20001: - [~jmarhuen] seems like patch file is for different issue. > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,130|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Failed to connect to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22 10:22:34,244|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:34 [main]: > WARN jdbc.HiveConnection: Could not open client transport with JDBC Uri: > jdbc:hive2://ctr-e138-1518143905142-375925-01-04.hwx.site:10001/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit: > Failed to open new session: > org.apache.hadoop.hive.ql.metadata.HiveException: > MetaException(message:java.security.AccessControlException: Permission > denied: user=hrt_qa,
[jira] [Commented] (HIVE-20001) With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.
[ https://issues.apache.org/jira/browse/HIVE-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524295#comment-16524295 ] ASF GitHub Bot commented on HIVE-20001: --- GitHub user beltran opened a pull request: https://github.com/apache/hive/pull/380 HIVE-20001: With doas set to true, running select query as hrt_qa use… …r on external table fails due to permission denied to read /warehouse/tablespace/managed directory You can merge this pull request into a Git repository by running: $ git pull https://github.com/beltran/hive HIVE-20001 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/380.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #380 commit 3e9dd9a73ae9d33e2f291819b0e10e4296f2b568 Author: Jaume Marhuenda Date: 2018-06-26T22:42:14Z HIVE-20001: With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory > With doas set to true, running select query as hrt_qa user on external table > fails due to permission denied to read /warehouse/tablespace/managed > directory. > > > Key: HIVE-20001 > URL: https://issues.apache.org/jira/browse/HIVE-20001 > Project: Hive > Issue Type: Bug >Reporter: Jaume M >Assignee: Jaume M >Priority: Major > Labels: pull-request-available > Attachments: HIVE-20001.1.patch > > > Hive: With doas set to true, running select query as hrt_qa user on external > table fails due to permission denied to read /warehouse/tablespace/managed > directory. > Steps: > 1. Create a external table. > 2. Set doas to true. > 3. run select count(*) using user hrt_qa. > Table creation query. > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "drop table if exists test_table purge; > create external table test_table(id int, age int) row format delimited fields > terminated by '|' stored as textfile; > load data inpath '/tmp/table1.dat' overwrite into table test_table; > {code} > select count(*) query execution fails > {code} > beeline -n hrt_qa -p pwd -u > "jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit" > --outputformat=tsv -e "select count(*) from test_table where age>30 and > id<10100;" > 2018-06-22 10:22:29,328|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Class path contains > multiple SLF4J bindings. > 2018-06-22 10:22:29,330|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: See > http://www.slf4j.org/codes.html#multiple_bindings for an explanation. > 2018-06-22 10:22:29,335|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|SLF4J: Actual binding is of > type [org.apache.logging.slf4j.Log4jLoggerFactory] > 2018-06-22 10:22:31,408|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Format tsv is deprecated, > please use tsv2 > 2018-06-22 10:22:31,529|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|Connecting to > jdbc:hive2://ctr-e138-1518143905142-375925-01-06.hwx.site:2181,ctr-e138-1518143905142-375925-01-05.hwx.site:2181,ctr-e138-1518143905142-375925-01-07.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice;ssl=true;sslTrustStore=/etc/security/serverKeys/hivetruststore.jks;trustStorePassword=changeit > 2018-06-22 10:22:32,031|INFO|Thread-126|machine.py:111 - > tee_pipe()||b3a493ec-99be-483e-91fe-4b701ec27ebc|18/06/22 10:22:32 [main]: > INFO jdbc.HiveConnection: Connected to > ctr-e138-1518143905142-375925-01-04.hwx.site:10001 > 2018-06-22