[GitHub] [hadoop] hadoop-yetus commented on issue #1341: HDDS-2022. Add additional freon tests

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1341: HDDS-2022. Add additional freon tests URL: https://github.com/apache/hadoop/pull/1341#issuecomment-531452566 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:|

[GitHub] [hadoop] elek commented on issue #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-13 Thread GitBox
elek commented on issue #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435#issuecomment-531450551 Thanks @nandakumar131 the patch. Unfortunately it seems to be failing for me with

[GitHub] [hadoop] anuengineer commented on a change in pull request #1344: HDDS-1982 Extend SCMNodeManager to support decommission and maintenance states

2019-09-13 Thread GitBox
anuengineer commented on a change in pull request #1344: HDDS-1982 Extend SCMNodeManager to support decommission and maintenance states URL: https://github.com/apache/hadoop/pull/1344#discussion_r324412721 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on issue #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet URL: https://github.com/apache/hadoop/pull/1448#issuecomment-531449913 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] anuengineer commented on issue #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed…

2019-09-13 Thread GitBox
anuengineer commented on issue #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed… URL: https://github.com/apache/hadoop/pull/1444#issuecomment-531449080 @xiaoyuyao I think all these failures are due to the trunk issues. If you can retest, it might be a good

[GitHub] [hadoop] anuengineer commented on issue #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed…

2019-09-13 Thread GitBox
anuengineer commented on issue #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed… URL: https://github.com/apache/hadoop/pull/1444#issuecomment-531449098 /retest This is an automated message from

[GitHub] [hadoop] anuengineer commented on issue #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet

2019-09-13 Thread GitBox
anuengineer commented on issue #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet URL: https://github.com/apache/hadoop/pull/1448#issuecomment-531448967 +1, pending Jenkins. This is an

[jira] [Commented] (HADOOP-15804) upgrade to commons-compress 1.18

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929680#comment-16929680 ] Wei-Chiu Chuang commented on HADOOP-15804: -- Cherrypicked the commit into branch2. > upgrade

[jira] [Updated] (HADOOP-16555) Update commons-compress to 1.19

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16555: - Fix Version/s: 2.10.0 > Update commons-compress to 1.19 >

[jira] [Updated] (HADOOP-15804) upgrade to commons-compress 1.18

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-15804: - Fix Version/s: 2.10.0 > upgrade to commons-compress 1.18 >

[GitHub] [hadoop] elek commented on a change in pull request #1341: HDDS-2022. Add additional freon tests

2019-09-13 Thread GitBox
elek commented on a change in pull request #1341: HDDS-2022. Add additional freon tests URL: https://github.com/apache/hadoop/pull/1341#discussion_r324412003 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/SameKeyReader.java ## @@ -0,0 +1,109

[GitHub] [hadoop] elek closed pull request #1439: HDDS-2125. maven-javadoc-plugin.version is missing in pom.ozone.xml.

2019-09-13 Thread GitBox
elek closed pull request #1439: HDDS-2125. maven-javadoc-plugin.version is missing in pom.ozone.xml. URL: https://github.com/apache/hadoop/pull/1439 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on issue #1446: YARN-9834. Allow using a pool of local users to run Yarn Secure Conta…

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1446: YARN-9834. Allow using a pool of local users to run Yarn Secure Conta… URL: https://github.com/apache/hadoop/pull/1446#issuecomment-531447976 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] elek opened a new pull request #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet

2019-09-13 Thread GitBox
elek opened a new pull request #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet URL: https://github.com/apache/hadoop/pull/1448 The LOC 324 in the file 

[GitHub] [hadoop] hadoop-yetus commented on issue #1447: HDDS-2111. XSS fragments can be injected to the S3g landing page

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1447: HDDS-2111. XSS fragments can be injected to the S3g landing page URL: https://github.com/apache/hadoop/pull/1447#issuecomment-531447108 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#issuecomment-531446769 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] elek opened a new pull request #1447: HDDS-2111. XSS fragments can be injected to the S3g landing page

2019-09-13 Thread GitBox
elek opened a new pull request #1447: HDDS-2111. XSS fragments can be injected to the S3g landing page URL: https://github.com/apache/hadoop/pull/1447 VULNERABILITY DETAILS There is a way to bypass anti-XSS filter for DOM XSS exploiting a "window.location.href". Considering a

[GitHub] [hadoop] elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-13 Thread GitBox
elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#discussion_r324409675 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ##

[GitHub] [hadoop] elek commented on issue #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-13 Thread GitBox
elek commented on issue #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#issuecomment-531442173 > Have few comments in place. > Can we open Jira's for all TODO's in this Jira for tracking purpose? > > 1. Audit support for the

[GitHub] [hadoop] elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-13 Thread GitBox
elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#discussion_r324409356 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java

[GitHub] [hadoop] shanyu opened a new pull request #1446: YARN-9834. Allow using a pool of local users to run Yarn Secure Conta…

2019-09-13 Thread GitBox
shanyu opened a new pull request #1446: YARN-9834. Allow using a pool of local users to run Yarn Secure Conta… URL: https://github.com/apache/hadoop/pull/1446 …iner in secure mode Signed-off-by: Shanyu Zhao https://issues.apache.org/jira/browse/YARN-9834

[GitHub] [hadoop] elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-13 Thread GitBox
elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#discussion_r324409058 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/OMMetadataManager.java ## @@

[jira] [Commented] (HADOOP-15578) GridmixTestUtils uses the wrong staging directory in windows

2019-09-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929621#comment-16929621 ] Hadoop QA commented on HADOOP-15578: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-12928) Update netty to 3.10.5.Final to sync with zookeeper

2019-09-13 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929617#comment-16929617 ] Jonathan Hung commented on HADOOP-12928: Hi [~ozawa] / [~eddyxu], I see this never got

[GitHub] [hadoop] hadoop-yetus commented on issue #1445: HDDS-2128. Make ozone sh command work with OM HA service ids

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1445: HDDS-2128. Make ozone sh command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1445#issuecomment-531422743 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #1440: HDDS-2114: Rename does not preserve non-explicitly created interim directories

2019-09-13 Thread GitBox
xiaoyuyao commented on a change in pull request #1440: HDDS-2114: Rename does not preserve non-explicitly created interim directories URL: https://github.com/apache/hadoop/pull/1440#discussion_r324392898 ## File path:

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #1440: HDDS-2114: Rename does not preserve non-explicitly created interim directories

2019-09-13 Thread GitBox
xiaoyuyao commented on a change in pull request #1440: HDDS-2114: Rename does not preserve non-explicitly created interim directories URL: https://github.com/apache/hadoop/pull/1440#discussion_r324392898 ## File path:

[GitHub] [hadoop] smengcl opened a new pull request #1445: HDDS-2128. Make ozone sh command work with OM HA service ids

2019-09-13 Thread GitBox
smengcl opened a new pull request #1445: HDDS-2128. Make ozone sh command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1445 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on issue #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed…

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed… URL: https://github.com/apache/hadoop/pull/1444#issuecomment-531410808 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-15578) GridmixTestUtils uses the wrong staging directory in windows

2019-09-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929564#comment-16929564 ] Ayush Saxena commented on HADOOP-15578: --- Thanx [~elgoiri] for the report, I guess this problem

[GitHub] [hadoop] xiaoyuyao opened a new pull request #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed…

2019-09-13 Thread GitBox
xiaoyuyao opened a new pull request #1444: HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909. Contributed… URL: https://github.com/apache/hadoop/pull/1444 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] hadoop-yetus commented on issue #1443: HDDS-2124. Random next links

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1443: HDDS-2124. Random next links URL: https://github.com/apache/hadoop/pull/1443#issuecomment-531369389 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 |

[GitHub] [hadoop] smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-13 Thread GitBox
smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-531358343 Thanks for committing @bharatviswa504 ! This is

[GitHub] [hadoop] hadoop-yetus commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit.

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit. URL: https://github.com/apache/hadoop/pull/1442#issuecomment-531357838 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1441: HADOOP-16568. S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1441: HADOOP-16568. S3A FullCredentialsTokenBinding fails if local credentials are unset URL: https://github.com/apache/hadoop/pull/1441#issuecomment-531357805 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] adoroszlai commented on issue #1443: HDDS-2124. Random next links

2019-09-13 Thread GitBox
adoroszlai commented on issue #1443: HDDS-2124. Random next links URL: https://github.com/apache/hadoop/pull/1443#issuecomment-531354016 /label ozone This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] adoroszlai opened a new pull request #1443: HDDS-2124. Random next links

2019-09-13 Thread GitBox
adoroszlai opened a new pull request #1443: HDDS-2124. Random next links URL: https://github.com/apache/hadoop/pull/1443 ## What changes were proposed in this pull request? Assign weights to pages to ensure correct order. https://issues.apache.org/jira/browse/HDDS-2124

[GitHub] [hadoop] bharatviswa504 edited a comment on issue #1377: HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message. Contributed by Supratim Deka

2019-09-13 Thread GitBox
bharatviswa504 edited a comment on issue #1377: HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/1377#issuecomment-531347971 I think, we need to revert this. Due to some classpath loading magic

[GitHub] [hadoop] bharatviswa504 commented on issue #1377: HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message. Contributed by Supratim Deka

2019-09-13 Thread GitBox
bharatviswa504 commented on issue #1377: HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/1377#issuecomment-531347971 I think, we need to revert this. Due to some classpath loading magic stuff, we

[GitHub] [hadoop] vivekratnavel commented on issue #1424: HDDS-2107. Datanodes should retry forever to connect to SCM in an…

2019-09-13 Thread GitBox
vivekratnavel commented on issue #1424: HDDS-2107. Datanodes should retry forever to connect to SCM in an… URL: https://github.com/apache/hadoop/pull/1424#issuecomment-531343596 @hanishakoneru Sure. This is an automated

[jira] [Resolved] (HADOOP-16555) Update commons-compress to 1.19

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-16555. -- Resolution: Fixed There was a trivial conflict cherrypicking the commits into lower

[jira] [Updated] (HADOOP-16555) Update commons-compress to 1.19

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16555: - Fix Version/s: 3.1.3 3.2.1 > Update commons-compress to 1.19 >

[GitHub] [hadoop] bharatviswa504 commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-13 Thread GitBox
bharatviswa504 commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-531341578 Thank You @smengcl for the contribution. I have committed this to the trunk.

[GitHub] [hadoop] bharatviswa504 merged pull request #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-13 Thread GitBox
bharatviswa504 merged pull request #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360 This is an automated message from the Apache Git Service. To

[jira] [Updated] (HADOOP-16555) Update commons-compress to 1.19

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16555: - Attachment: HADOOP-16555.branch-3.2.patch > Update commons-compress to 1.19 >

[jira] [Updated] (HADOOP-16555) Update commons-compress to 1.19

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16555: - Fix Version/s: 3.3.0 > Update commons-compress to 1.19 >

[jira] [Commented] (HADOOP-16555) Update commons-compress to 1.19

2019-09-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929416#comment-16929416 ] Hudson commented on HADOOP-16555: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17295 (See

[jira] [Assigned] (HADOOP-16555) Update commons-compress to 1.19

2019-09-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HADOOP-16555: Assignee: YiSheng Lien > Update commons-compress to 1.19 >

[GitHub] [hadoop] jojochuang merged pull request #1425: HADOOP-16555. Update commons-compress to 1.19.

2019-09-13 Thread GitBox
jojochuang merged pull request #1425: HADOOP-16555. Update commons-compress to 1.19. URL: https://github.com/apache/hadoop/pull/1425 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] jojochuang commented on issue #1425: HADOOP-16555. Update commons-compress to 1.19.

2019-09-13 Thread GitBox
jojochuang commented on issue #1425: HADOOP-16555. Update commons-compress to 1.19. URL: https://github.com/apache/hadoop/pull/1425#issuecomment-531337509 For the record, here are the two failed tests: >

[GitHub] [hadoop] jojochuang commented on issue #1425: HADOOP-16555. Update commons-compress to 1.19.

2019-09-13 Thread GitBox
jojochuang commented on issue #1425: HADOOP-16555. Update commons-compress to 1.19. URL: https://github.com/apache/hadoop/pull/1425#issuecomment-531337110 +1 The precommit had two test failures, both looks unrelated. However, it didn't report back to GitHub: > Could not

[jira] [Work started] (HADOOP-16570) S3A committers leak threads on job/task commit

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16570 started by Steve Loughran. --- > S3A committers leak threads on job/task commit >

[GitHub] [hadoop] steveloughran commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit.

2019-09-13 Thread GitBox
steveloughran commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit. URL: https://github.com/apache/hadoop/pull/1442#issuecomment-531333276 tested s3 ireland, ddb, auth This is an automated

[GitHub] [hadoop] steveloughran opened a new pull request #1442: HADOOP-16570. S3A committers leak threads on job/task commit.

2019-09-13 Thread GitBox
steveloughran opened a new pull request #1442: HADOOP-16570. S3A committers leak threads on job/task commit. URL: https://github.com/apache/hadoop/pull/1442 This patch explicitly shuts down the thread pool in job cleanup and after task commit, abort, job abort and job commit. The

[GitHub] [hadoop] steveloughran commented on issue #1441: HADOOP-16568. S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-13 Thread GitBox
steveloughran commented on issue #1441: HADOOP-16568. S3A FullCredentialsTokenBinding fails if local credentials are unset URL: https://github.com/apache/hadoop/pull/1441#issuecomment-531332720 tested: ITests and manually. Obviously those itest tests aren't enough, but I couldn't think of

[GitHub] [hadoop] steveloughran opened a new pull request #1441: HADOOP-16568. S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-13 Thread GitBox
steveloughran opened a new pull request #1441: HADOOP-16568. S3A FullCredentialsTokenBinding fails if local credentials are unset URL: https://github.com/apache/hadoop/pull/1441 Move the local loading to deployUnbonded() (where they are required) and add a safety check when a new DT

[GitHub] [hadoop] bshashikant commented on issue #1163: HDDS-1786 : Datanodes takeSnapshot should delete previously created s…

2019-09-13 Thread GitBox
bshashikant commented on issue #1163: HDDS-1786 : Datanodes takeSnapshot should delete previously created s… URL: https://github.com/apache/hadoop/pull/1163#issuecomment-531331231 Thanks @avijayanhwx for the contribution. I have committed this.

[GitHub] [hadoop] bshashikant merged pull request #1163: HDDS-1786 : Datanodes takeSnapshot should delete previously created s…

2019-09-13 Thread GitBox
bshashikant merged pull request #1163: HDDS-1786 : Datanodes takeSnapshot should delete previously created s… URL: https://github.com/apache/hadoop/pull/1163 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] hadoop-yetus commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/1369#issuecomment-531320049 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hanishakoneru commented on issue #1424: HDDS-2107. Datanodes should retry forever to connect to SCM in an…

2019-09-13 Thread GitBox
hanishakoneru commented on issue #1424: HDDS-2107. Datanodes should retry forever to connect to SCM in an… URL: https://github.com/apache/hadoop/pull/1424#issuecomment-531314877 Thank you @vivekratnavel for working on this. LGTM. +1. Can you please update the description. It states

[GitHub] [hadoop] arp7 commented on issue #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar

2019-09-13 Thread GitBox
arp7 commented on issue #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar URL: https://github.com/apache/hadoop/pull/1434#issuecomment-531310413 Thanks for the quick fix @elek. Should we also exclude Ratis.. since HBase potentially has a dependency on Ratis and we should

[GitHub] [hadoop] xiaoyuyao commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.

2019-09-13 Thread GitBox
xiaoyuyao commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/1369#issuecomment-531301387 /retest This is an automated message from the

[jira] [Reopened] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HADOOP-16565: - Reopened to add a message. > Fix "com.amazonaws.SdkClientException: Unable to find a region via

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-13 Thread GitBox
hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-530779279 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Created] (HADOOP-16576) ITestS3GuardDDBRootOperations. test_100_FilesystemPrune failure

2019-09-13 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16576: --- Summary: ITestS3GuardDDBRootOperations. test_100_FilesystemPrune failure Key: HADOOP-16576 URL: https://issues.apache.org/jira/browse/HADOOP-16576 Project:

[jira] [Updated] (HADOOP-16570) S3A committers leak threads on job/task commit

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16570: Parent: HADOOP-15620 Issue Type: Sub-task (was: Bug) > S3A committers leak

[jira] [Work started] (HADOOP-16520) race condition in DDB table init and waiting threads

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16520 started by Gabor Bota. --- > race condition in DDB table init and waiting threads >

[jira] [Assigned] (HADOOP-16520) race condition in DDB table init and waiting threads

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16520: --- Assignee: Gabor Bota > race condition in DDB table init and waiting threads >

[jira] [Work started] (HADOOP-16568) S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16568 started by Steve Loughran. --- > S3A FullCredentialsTokenBinding fails if local credentials are unset

[jira] [Commented] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929313#comment-16929313 ] Steve Loughran commented on HADOOP-16565: - maybe you always need to set a region, and I'd not

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-531290077 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-531284055 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1438: HDDS-2126. Ozone 0.4.1 branch build issue.

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1438: HDDS-2126. Ozone 0.4.1 branch build issue. URL: https://github.com/apache/hadoop/pull/1438#issuecomment-531283615 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16569) improve TLS performance for NativeAzureFileSystem

2019-09-13 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929292#comment-16929292 ] Sahil Takiar commented on HADOOP-16569: --- Hey [~Steven Rand], thanks for tagging me. Yeah,

[jira] [Resolved] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16565. - Resolution: Workaround > Fix "com.amazonaws.SdkClientException: Unable to find a region via

[jira] [Commented] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929284#comment-16929284 ] Gabor Bota commented on HADOOP-16565: - It worked with the following STS config: {noformat}

[jira] [Resolved] (HADOOP-16421) ITestS3GuardOutOfBandOperations.deleteAfterTombstoneExpiryOobCreate failure

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16421. - Resolution: Cannot Reproduce >

[jira] [Resolved] (HADOOP-16429) DynamoDBMetaStore deleteSubtree to delete leaf nodes first

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16429. - Resolution: Done seems to be done; as well as the deleteSubtree doing leaf nodes

[jira] [Resolved] (HADOOP-16392) S3Guard Diff tool to list+ compare the etag and version fields

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16392. - Resolution: Duplicate > S3Guard Diff tool to list+ compare the etag and version fields

[jira] [Resolved] (HADOOP-16326) S3Guard: Remove LocalMetadataStore

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16326. - Resolution: Won't Fix > S3Guard: Remove LocalMetadataStore >

[jira] [Resolved] (HADOOP-16274) transient failure of ITestS3GuardToolDynamoDB.testDestroyUnknownTable

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16274. - Resolution: Cannot Reproduce > transient failure of

[jira] [Resolved] (HADOOP-16280) S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16280. - Fix Version/s: 3.3.0 Resolution: Duplicate HADOOP-16490 added exactly this

[jira] [Assigned] (HADOOP-16280) S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16280: --- Assignee: Steve Loughran > S3Guard: Retry failed read with backoff in

[jira] [Resolved] (HADOOP-15800) ITestS3GuardListConsistency#testConsistentListAfterDelete fails when running with dynamo

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15800. - Resolution: Cannot Reproduce >

[jira] [Updated] (HADOOP-16101) Use lighter-weight alternatives to innerGetFileStatus where possible

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16101: Parent Issue: HADOOP-15620 (was: HADOOP-15619) > Use lighter-weight alternatives to

[GitHub] [hadoop] hadoop-yetus commented on issue #1440: HDDS-2114: Rename does not preserve non-explicitly created interim directories

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1440: HDDS-2114: Rename does not preserve non-explicitly created interim directories URL: https://github.com/apache/hadoop/pull/1440#issuecomment-531270620 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16568) S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16568: Parent Issue: HADOOP-15620 (was: HADOOP-15619) > S3A FullCredentialsTokenBinding fails

[GitHub] [hadoop] steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-13 Thread GitBox
steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r324232111 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-13 Thread GitBox
steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r324231824 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-13 Thread GitBox
steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r324231592 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-13 Thread GitBox
steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r324231054 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-13 Thread GitBox
steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r324230455 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-13 Thread GitBox
steveloughran commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r324230187 ## File path:

[GitHub] [hadoop] lokeshj1703 commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out.

2019-09-13 Thread GitBox
lokeshj1703 commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out. URL: https://github.com/apache/hadoop/pull/1430#issuecomment-531260923 @bshashikant Thanks for updating the PR! The changes look good to me. +1. Pending jenkins. The yetus build seems

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929243#comment-16929243 ] Steve Loughran commented on HADOOP-16547: - with the test plan, I can verify that prune,

[jira] [Commented] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929242#comment-16929242 ] Gabor Bota commented on HADOOP-16565: - I don't have any STS endpoint besides {noformat}

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929239#comment-16929239 ] Steve Loughran commented on HADOOP-16547: - * build a full Hadoop distro without the patch *

[GitHub] [hadoop] hadoop-yetus commented on issue #1439: HDDS-2125. maven-javadoc-plugin.version is missing in pom.ozone.xml.

2019-09-13 Thread GitBox
hadoop-yetus commented on issue #1439: HDDS-2125. maven-javadoc-plugin.version is missing in pom.ozone.xml. URL: https://github.com/apache/hadoop/pull/1439#issuecomment-531255241 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-13 Thread GitBox
steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-531254101 manually verified this patch works through DT games, as well as ITest run. All good

[GitHub] [hadoop] anuengineer commented on issue #1377: HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message. Contributed by Supratim Deka

2019-09-13 Thread GitBox
anuengineer commented on issue #1377: HDDS-2057. Incorrect Default OM Port in Ozone FS URI Error Message. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/1377#issuecomment-531253622 @supratimdeka Thanks for the contribution. @arp7 , @bharatviswa504 Thanks for the

  1   2   >