[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Zach Amsden has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ Hadoop changed behavior regarding encrypted partitions and started automatically provisioning .Trash directories in encrypted partitions. This interplays poorly with the current test. Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Reviewed-on: http://gerrit.cloudera.org:8080/8274 Tested-by: Impala Public Jenkins Reviewed-by: Tim Armstrong--- M tests/metadata/test_hdfs_encryption.py 1 file changed, 28 insertions(+), 7 deletions(-) Approvals: Impala Public Jenkins: Verified Tim Armstrong: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 5 Gerrit-Owner: Zach Amsden Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Tim Armstrong has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 4: Code-Review+2 Yeah I see there are some existing long lines immediately below. Usually I think it's good to fix minor things when the code gets touched but this seems fine. -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 4 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Thu, 19 Oct 2017 15:51:01 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Zach Amsden has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 4: Looks like I finally got a good GVO on this. Tim, is it alright if I carry the +2 on this, or would you rather I fix the long lines? (Looks like there are a lot of long lines in this particular test however). -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 4 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Thu, 19 Oct 2017 15:09:36 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 4: Verified+1 -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 4 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Thu, 19 Oct 2017 01:45:33 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 4: Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/1349/ -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 4 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Wed, 18 Oct 2017 21:52:52 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Zach Amsden has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 4: Anyone know what's going on with this change not going through verification? I got a pass on private build and test, and the failures here appear Kerberos related. Trying a manual rebase... -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 4 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Wed, 18 Oct 2017 21:51:43 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 3: Verified-1 Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/1344/ -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 3 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Wed, 18 Oct 2017 20:10:07 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 3: Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/1344/ -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 3 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Wed, 18 Oct 2017 16:06:57 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Zach Amsden has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 2: Looks like a transient failure, retrying -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 2 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Wed, 18 Oct 2017 16:05:32 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 2: Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/1343/ -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 2 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Wed, 18 Oct 2017 16:04:44 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 2: Verified-1 Build failed: https://jenkins.impala.io/job/gerrit-verify-dryrun/1340/ -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 2 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Wed, 18 Oct 2017 02:18:10 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 2: Build started: https://jenkins.impala.io/job/gerrit-verify-dryrun/1340/ -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 2 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Tue, 17 Oct 2017 22:29:35 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Tim Armstrong has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 2: Code-Review+2 (1 comment) http://gerrit.cloudera.org:8080/#/c/8274/2/tests/metadata/test_hdfs_encryption.py File tests/metadata/test_hdfs_encryption.py: http://gerrit.cloudera.org:8080/#/c/8274/2/tests/metadata/test_hdfs_encryption.py@196 PS2, Line 196: assert self.hdfs_client.exists("test-warehouse/{0}.db/t1/j=1/j1.txt".format(TEST_DB)) nit: long lines -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 2 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Tim Armstrong Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Mon, 16 Oct 2017 22:07:52 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Hello Philip Zeyliger, Joe McDonnell, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/8274 to look at the new patch set (#2). Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ Hadoop changed behavior regarding encrypted partitions and started automatically provisioning .Trash directories in encrypted partitions. This interplays poorly with the current test. Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 --- M tests/metadata/test_hdfs_encryption.py 1 file changed, 28 insertions(+), 7 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/74/8274/2 -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 2 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Zach Amsden has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 1: (2 comments) http://gerrit.cloudera.org:8080/#/c/8274/1/tests/metadata/test_hdfs_encryption.py File tests/metadata/test_hdfs_encryption.py: http://gerrit.cloudera.org:8080/#/c/8274/1/tests/metadata/test_hdfs_encryption.py@191 PS1, Line 191: # exists. This behavior is expected due to the difference in encryption zones > "the difference in encryption zones between the .Trash and the warehouse di Done http://gerrit.cloudera.org:8080/#/c/8274/1/tests/metadata/test_hdfs_encryption.py@198 PS1, Line 198: # New HDFS behavior succeeds the query and creates trash; the partition removal > s/New HDFS/HDFS 2.8+/? Done -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 1 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Reviewer: Zach Amsden Gerrit-Comment-Date: Fri, 13 Oct 2017 23:10:09 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Philip Zeyliger has posted comments on this change. ( http://gerrit.cloudera.org:8080/8274 ) Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. Patch Set 1: Code-Review+1 (3 comments) This looks fine to me, with minor comment nits. http://gerrit.cloudera.org:8080/#/c/8274/1//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/8274/1//COMMIT_MSG@13 PS1, Line 13: N.B. this is probably worth fixing upstream. We are upstream! http://gerrit.cloudera.org:8080/#/c/8274/1/tests/metadata/test_hdfs_encryption.py File tests/metadata/test_hdfs_encryption.py: http://gerrit.cloudera.org:8080/#/c/8274/1/tests/metadata/test_hdfs_encryption.py@191 PS1, Line 191: # exists. This behavior is expected due to the difference in encryption zones "the difference in encryption zones between the .Trash and the warehouse directory" If that's true, could we elaborate on "difference in encryption zones" perhaps as suggested here? http://gerrit.cloudera.org:8080/#/c/8274/1/tests/metadata/test_hdfs_encryption.py@198 PS1, Line 198: # New HDFS behavior succeeds the query and creates trash; the partition removal s/New HDFS/HDFS 2.8+/? -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 1 Gerrit-Owner: Zach AmsdenGerrit-Reviewer: Joe McDonnell Gerrit-Reviewer: Philip Zeyliger Gerrit-Comment-Date: Fri, 13 Oct 2017 22:07:59 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+
Zach Amsden has uploaded this change for review. ( http://gerrit.cloudera.org:8080/8274 Change subject: IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ .. IMPALA-6055: Fix hdfs encryption test far Hadoop 2.8+ Hadoop changed behavior regarding encrypted partitions and started automatically provisioning .Trash directories in encrypted partitions. This interplays poorly with the current test. N.B. this is probably worth fixing upstream. Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 --- M tests/metadata/test_hdfs_encryption.py 1 file changed, 27 insertions(+), 7 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/74/8274/1 -- To view, visit http://gerrit.cloudera.org:8080/8274 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I30234aa50fea93f316e75beea2ced002dcea0c24 Gerrit-Change-Number: 8274 Gerrit-PatchSet: 1 Gerrit-Owner: Zach Amsden