[GitHub] [hadoop-ozone] vinayakumarb commented on pull request #933: HDDS-3604. Use Ozone version from Hadoop Sercurity/Token classes

2020-06-03 Thread GitBox
vinayakumarb commented on pull request #933: URL: https://github.com/apache/hadoop-ozone/pull/933#issuecomment-638613535 I am not sure whats the problem with acceptance tests. Can anyone help me understand? This is an

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1012: HDDS-3658. Stop to persist container related pipeline info of each ke…

2020-06-03 Thread GitBox
adoroszlai commented on pull request #1012: URL: https://github.com/apache/hadoop-ozone/pull/1012#issuecomment-638612932 > The rat check failed in doc module. Have we changed the rule recently? Thanks @ChenSammi for flagging this problem. Posted #1017 to fix it.

[jira] [Updated] (HDDS-1815) Add SVG Logo for Ozone

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1815: - Labels: Triaged pull-request-available (was: Triaged) > Add SVG Logo for Ozone >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1017: HDDS-1815. Add missing license for SVG Logo

2020-06-03 Thread GitBox
adoroszlai opened a new pull request #1017: URL: https://github.com/apache/hadoop-ozone/pull/1017 ## What changes were proposed in this pull request? HDDS-1815 was recently committed without CI (730cc0f09), accidentally breaking [`rat`

[GitHub] [hadoop-ozone] timmylicheng commented on pull request #1016: HDDS-3711. Handle inner classes in SCMRatisRequest and SCMRatisResponse

2020-06-03 Thread GitBox
timmylicheng commented on pull request #1016: URL: https://github.com/apache/hadoop-ozone/pull/1016#issuecomment-638587455 +1 pending on CI This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HDDS-3711) Handle inner classes in SCMRatisRequest and SCMRatisResponse

2020-06-03 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-3711: -- Status: Patch Available (was: Open) > Handle inner classes in SCMRatisRequest and SCMRatisResponse >

[GitHub] [hadoop-ozone] nandakumar131 opened a new pull request #1016: HDDS-3711. Handle inner classes in SCMRatisRequest and SCMRatisResponse

2020-06-03 Thread GitBox
nandakumar131 opened a new pull request #1016: URL: https://github.com/apache/hadoop-ozone/pull/1016 ## What changes were proposed in this pull request? Currently creating class object for inner class fails with `ClassNotFoundException`. We have to handle inner class instantiation.

[jira] [Updated] (HDDS-3711) Handle inner classes in SCMRatisRequest and SCMRatisResponse

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3711: - Labels: pull-request-available (was: ) > Handle inner classes in SCMRatisRequest and

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #1000: HDDS-3562. Datanodes should send ICR when a container replica deletion is successful.

2020-06-03 Thread GitBox
dineshchitlangia commented on a change in pull request #1000: URL: https://github.com/apache/hadoop-ozone/pull/1000#discussion_r434974495 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/AbstractContainerReportHandler.java ## @@ -225,14

[jira] [Created] (HDDS-3711) Handle inner classes in SCMRatisRequest and SCMRatisResponse

2020-06-03 Thread Nanda kumar (Jira)
Nanda kumar created HDDS-3711: - Summary: Handle inner classes in SCMRatisRequest and SCMRatisResponse Key: HDDS-3711 URL: https://issues.apache.org/jira/browse/HDDS-3711 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1012: HDDS-3658. Stop to persist container related pipeline info of each ke…

2020-06-03 Thread GitBox
ChenSammi commented on pull request #1012: URL: https://github.com/apache/hadoop-ozone/pull/1012#issuecomment-638581173 The rat check failed in doc module. Have we changed the rule recently? This is an automated message

[jira] [Updated] (HDDS-2665) Implement new Ozone Filesystem scheme ofs://

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-2665: - Description: Implement a new scheme for Ozone Filesystem where all volumes (and buckets) can be accessed

[jira] [Updated] (HDDS-2665) Implement new Ozone Filesystem scheme ofs://

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-2665: - Description: Implement a new scheme for Ozone Filesystem where all volumes (and buckets) can be access

[jira] [Commented] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-06-03 Thread liusheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125450#comment-17125450 ] liusheng commented on HDDS-3678: Thank you [~adoroszlai] for clarification :) > Remove usage of

[jira] [Updated] (HDDS-3709) Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3709: - Resolution: Fixed Status: Resolved (was: Patch Available) > Rebase OFS branch - 3. Adapt to

[GitHub] [hadoop-ozone] anuengineer commented on pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-06-03 Thread GitBox
anuengineer commented on pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-638517204 I think it should be cancelled. Thanks for checking. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] smengcl closed pull request #1015: HDDS-3709. Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread GitBox
smengcl closed pull request #1015: URL: https://github.com/apache/hadoop-ozone/pull/1015 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] smengcl commented on pull request #1015: HDDS-3709. Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread GitBox
smengcl commented on pull request #1015: URL: https://github.com/apache/hadoop-ozone/pull/1015#issuecomment-638509129 Checks passed. Pushing to `HDDS-2665-ofs` branch manually. This is an automated message from the Apache

[jira] [Resolved] (HDDS-3653) Add documentation for Copy key command

2020-06-03 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3653. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~maobaolong] for the contribution and all for the

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #990: HDDS-3653. Add documentation for Copy key command

2020-06-03 Thread GitBox
xiaoyuyao merged pull request #990: URL: https://github.com/apache/hadoop-ozone/pull/990 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #990: HDDS-3653. Add documentation for Copy key command

2020-06-03 Thread GitBox
xiaoyuyao commented on a change in pull request #990: URL: https://github.com/apache/hadoop-ozone/pull/990#discussion_r434900433 ## File path: hadoop-hdds/docs/content/shell/KeyCommands.md ## @@ -155,3 +156,22 @@ The `key cat` command displays the contents of a specific Ozone

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #990: HDDS-3653. Add documentation for Copy key command

2020-06-03 Thread GitBox
xiaoyuyao commented on a change in pull request #990: URL: https://github.com/apache/hadoop-ozone/pull/990#discussion_r434900433 ## File path: hadoop-hdds/docs/content/shell/KeyCommands.md ## @@ -155,3 +156,22 @@ The `key cat` command displays the contents of a specific Ozone

[jira] [Updated] (HDDS-3681) Recon: Add support to store file size counts in each volume/bucket

2020-06-03 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian updated HDDS-3681: - Resolution: Fixed Status: Resolved (was: Patch Available) >

[GitHub] [hadoop-ozone] vivekratnavel merged pull request #988: HDDS-3681. Recon: Add support to store file size counts in each volum…

2020-06-03 Thread GitBox
vivekratnavel merged pull request #988: URL: https://github.com/apache/hadoop-ozone/pull/988 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] vivekratnavel commented on pull request #988: HDDS-3681. Recon: Add support to store file size counts in each volum…

2020-06-03 Thread GitBox
vivekratnavel commented on pull request #988: URL: https://github.com/apache/hadoop-ozone/pull/988#issuecomment-638490425 @avijayanhwx Thanks for the review! This is an automated message from the Apache Git Service. To

[jira] [Resolved] (HDDS-3586) OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-06-03 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-3586. -- Resolution: Fixed > OM HA can be started with 3 isolated LEADER instead of one OM ring >

[GitHub] [hadoop-ozone] hanishakoneru merged pull request #925: HDDS-3586. OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-06-03 Thread GitBox
hanishakoneru merged pull request #925: URL: https://github.com/apache/hadoop-ozone/pull/925 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] hanishakoneru commented on pull request #925: HDDS-3586. OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-06-03 Thread GitBox
hanishakoneru commented on pull request #925: URL: https://github.com/apache/hadoop-ozone/pull/925#issuecomment-638476936 Thanks @elek. Got green CI run. Merging the PR. This is an automated message from the Apache Git

[jira] [Resolved] (HDDS-1815) Add SVG Logo for Ozone

2020-06-03 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-1815. - Fix Version/s: 0.6.0 Target Version/s: (was: 0.6.0) Resolution: Fixed I've

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #994: HDDS-3082. Refactor recon missing containers task to detect under, over and mis-replicated containers.

2020-06-03 Thread GitBox
avijayanhwx commented on pull request #994: URL: https://github.com/apache/hadoop-ozone/pull/994#issuecomment-638435611 Thank you @sodonnel. LGTM +1 This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HDDS-3709) Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3709: - Status: Patch Available (was: Open) > Rebase OFS branch - 3. Adapt to HDDS-3501 >

[jira] [Updated] (HDDS-3709) Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3709: - Labels: pull-request-available (was: ) > Rebase OFS branch - 3. Adapt to HDDS-3501 >

[GitHub] [hadoop-ozone] smengcl opened a new pull request #1015: HDDS-3709. Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread GitBox
smengcl opened a new pull request #1015: URL: https://github.com/apache/hadoop-ozone/pull/1015 ## What changes were proposed in this pull request? Due to HDDS-3501, I need to change OFS AdapterImpl as well to adapt to OzoneFileStatus class change. This PR is intentionally

[jira] [Updated] (HDDS-3709) Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3709: - Description: Due to change in > Rebase OFS branch - 3. Adapt to HDDS-3501 >

[jira] [Updated] (HDDS-3709) Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3709: - Description: Due to HDDS-3501, I need to change OFS AdapterImpl as well to adapt to OzoneFileStatus class

[jira] [Updated] (HDDS-3709) Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3709: - Description: Due to change in HDDS-3501. I need to change OFS AdapterImpl as well to adapt to

[jira] [Updated] (HDDS-3709) Rebase OFS branch - 3. Adapt to HDDS-3501

2020-06-03 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3709: - Summary: Rebase OFS branch - 3. Adapt to HDDS-3501 (was: Rebase OFS branch - 3) > Rebase OFS branch -

[GitHub] [hadoop-ozone] vinayakumarb commented on pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-06-03 Thread GitBox
vinayakumarb commented on pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987#issuecomment-638363080 thanks @adoroszlai for headsup. I will add it back. This is an automated message from the Apache Git

[jira] [Updated] (HDDS-426) Add field modificationTime for Volume and Bucket

2020-06-03 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-426: --- Labels: Triaged backlog newbie pull-request-available (was: backlog newbie pull-request-available) >

[jira] [Updated] (HDDS-1523) Ozone Docker container phase 1

2020-06-03 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1523: Labels: Triaged (was: ) > Ozone Docker container phase 1 > -- > >

[jira] [Updated] (HDDS-1565) Rename k8s-dev and k8s-dev-push profiles to docker and docker-push

2020-06-03 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1565: Labels: Triaged (was: ) > Rename k8s-dev and k8s-dev-push profiles to docker and docker-push >

[GitHub] [hadoop-ozone] elek commented on pull request #949: HDDS-3621. Separate client/server/admin proto files of HDDS to separated subprojects

2020-06-03 Thread GitBox
elek commented on pull request #949: URL: https://github.com/apache/hadoop-ozone/pull/949#issuecomment-638324325 Thanks the answer, If I understood well, we have a consensus. I will merge it if no objection and do the same on the `hadoop-ozone` side as a next step.

[GitHub] [hadoop-ozone] maobaolong commented on pull request #991: HDDS-3686. Insert an argument of ozone shell to accept jvm arguments

2020-06-03 Thread GitBox
maobaolong commented on pull request #991: URL: https://github.com/apache/hadoop-ozone/pull/991#issuecomment-638320257 @sodonnel Thank you for your suggestion, i push a new commit to address it, PTAL. This is an automated

[GitHub] [hadoop-ozone] elek commented on pull request #1014: HDDS-3710. Merge archived jacoco coverage results

2020-06-03 Thread GitBox
elek commented on pull request #1014: URL: https://github.com/apache/hadoop-ozone/pull/1014#issuecomment-638315154 Updated the sonar report. Will see how does it work after the next build on **apache** repo: https://github.com/apache/hadoop-ozone/actions?query=branch%3AHDDS-3710

[GitHub] [hadoop-ozone] dineshchitlangia commented on pull request #1001: HDDS-3694. Reduce dn-audit log

2020-06-03 Thread GitBox
dineshchitlangia commented on pull request #1001: URL: https://github.com/apache/hadoop-ozone/pull/1001#issuecomment-638284710 Thanks @adoroszlai for review/commit. This is an automated message from the Apache Git Service.

[jira] [Updated] (HDDS-3694) Reduce dn-audit log

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3694: - Labels: Triaged performance pull-request-available (was: Triaged performance) > Reduce dn-audit

[jira] [Updated] (HDDS-1880) Decommissioining and maintenance mode in Ozone

2020-06-03 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1880: Target Version/s: 0.7.0 (was: 0.6.0) > Decommissioining and maintenance mode in Ozone >

[jira] [Updated] (HDDS-1504) Watch Request should use retry policy with higher timeouts for RaftClient

2020-06-03 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1504: Labels: (was: TriagePending) > Watch Request should use retry policy with higher timeouts for

[jira] [Updated] (HDDS-1504) Watch Request should use retry policy with higher timeouts for RaftClient

2020-06-03 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1504: Target Version/s: (was: 0.6.0) > Watch Request should use retry policy with higher timeouts for

[jira] [Resolved] (HDDS-1504) Watch Request should use retry policy with higher timeouts for RaftClient

2020-06-03 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-1504. --- Fix Version/s: 0.6.0 Resolution: Fixed This has been fixed with 

[jira] [Updated] (HDDS-3694) Reduce dn-audit log

2020-06-03 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3694: --- Labels: Triaged performance (was: Triaged performance pull-request-available) > Reduce

[jira] [Resolved] (HDDS-3694) Reduce dn-audit log

2020-06-03 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3694. Fix Version/s: 0.6.0 Resolution: Fixed > Reduce dn-audit log > --- >

[jira] [Commented] (HDDS-3694) Reduce dn-audit log

2020-06-03 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125030#comment-17125030 ] Attila Doroszlai commented on HDDS-3694: Username and IP-related improvement postponed to

[jira] [Resolved] (HDDS-1807) TestWatchForCommit#testWatchForCommitForRetryfailure fails as a result of no leader election for extended period of time

2020-06-03 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-1807. --- Fix Version/s: 0.6.0 Resolution: Cannot Reproduce >

[jira] [Resolved] (HDDS-3257) Intermittent timeout in integration tests

2020-06-03 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3257. --- Fix Version/s: 0.6.0 Resolution: Fixed > Intermittent timeout in integration

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1001: HDDS-3694. Reduce dn-audit log

2020-06-03 Thread GitBox
adoroszlai commented on pull request #1001: URL: https://github.com/apache/hadoop-ozone/pull/1001#issuecomment-638255454 Thanks @dineshchitlangia for updating the patch. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1001: HDDS-3694. Reduce dn-audit log

2020-06-03 Thread GitBox
adoroszlai merged pull request #1001: URL: https://github.com/apache/hadoop-ozone/pull/1001 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] elek commented on pull request #925: HDDS-3586. OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-06-03 Thread GitBox
elek commented on pull request #925: URL: https://github.com/apache/hadoop-ozone/pull/925#issuecomment-638253640 Shame on me, I didn't check it again, yet. I think if the address is unresolved at the beginning and resolved during the start up, it couldn't start, but not sure. I have to

[GitHub] [hadoop-ozone] elek commented on a change in pull request #990: HDDS-3653. Add documentation for Copy key command

2020-06-03 Thread GitBox
elek commented on a change in pull request #990: URL: https://github.com/apache/hadoop-ozone/pull/990#discussion_r434628781 ## File path: hadoop-hdds/docs/content/shell/KeyCommands.md ## @@ -155,3 +156,22 @@ The `key cat` command displays the contents of a specific Ozone key

[jira] [Resolved] (HDDS-3518) Add a freon generator to create directory tree and create files in each directory

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3518. --- Resolution: Fixed > Add a freon generator to create directory tree and create files in each >

[GitHub] [hadoop-ozone] elek commented on pull request #895: HDDS-3518: Add a freon generator to create directory tree and create …

2020-06-03 Thread GitBox
elek commented on pull request #895: URL: https://github.com/apache/hadoop-ozone/pull/895#issuecomment-638242436 Merged. Thank you the contribution @rakeshadr (and thanks for the patience for my long comments ;-) ) This is

[GitHub] [hadoop-ozone] elek merged pull request #895: HDDS-3518: Add a freon generator to create directory tree and create …

2020-06-03 Thread GitBox
elek merged pull request #895: URL: https://github.com/apache/hadoop-ozone/pull/895 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop-ozone] elek commented on pull request #895: HDDS-3518: Add a freon generator to create directory tree and create …

2020-06-03 Thread GitBox
elek commented on pull request #895: URL: https://github.com/apache/hadoop-ozone/pull/895#issuecomment-638241382 Thanks @rakeshadr the update. Unfortunately when I checked your update 3 more opinions came in to my mind (Sorry). Let me share them here: 1. You introduced an

[GitHub] [hadoop-ozone] elek commented on pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-06-03 Thread GitBox
elek commented on pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-638231484 There is a [related discussion](https://lists.apache.org/thread.html/rb3bfc0b6795a9fd5973e06e17b3fdc8780911e8be66536133d461ce6%40%3Cozone-dev.hadoop.apache.org%3E) on the

[jira] [Commented] (HDDS-2562) Handle InterruptedException in DatanodeStateMachine

2020-06-03 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124963#comment-17124963 ] Dinesh Chitlangia commented on HDDS-2562: - [~Sammi] - Yes, this patch was reverted last night. I

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #991: HDDS-3686. Insert an argument of ozone shell to accept jvm arguments

2020-06-03 Thread GitBox
sodonnel commented on a change in pull request #991: URL: https://github.com/apache/hadoop-ozone/pull/991#discussion_r434558985 ## File path: hadoop-ozone/dist/src/shell/ozone/ozone ## @@ -31,6 +31,7 @@ function hadoop_usage hadoop_add_option "--hosts filename" "list of

[jira] [Updated] (HDDS-3703) Consider avoiding file lookup calls in writeChunk hotpath

2020-06-03 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3703: --- Status: Patch Available (was: In Progress) > Consider avoiding file lookup calls in

[GitHub] [hadoop-ozone] elek commented on pull request #1014: HDDS-3710. Merge archived jacoco coverage results

2020-06-03 Thread GitBox
elek commented on pull request #1014: URL: https://github.com/apache/hadoop-ozone/pull/1014#issuecomment-638145568 FYI @arp7 @vivekratnavel @vivekratnavel: this patch creates an XML report which can be used to upload the results to any services. @arp7 suggested updating the Sonar,

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-06-03 Thread GitBox
adoroszlai commented on pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987#issuecomment-638145212 Thanks @elek for merging it. Please note that the `shuffle` change is now missing from both this commit and the other PR.

[GitHub] [hadoop-ozone] elek opened a new pull request #1014: HDDS-3710. Merge archived jacoco coverage results

2020-06-03 Thread GitBox
elek opened a new pull request #1014: URL: https://github.com/apache/hadoop-ozone/pull/1014 ## What changes were proposed in this pull request? HDDS-3635 started to archive the jacoco coverage data for each of the unit and integration tests (unit, it-*). This patch introduces

[jira] [Updated] (HDDS-3710) Merge archived jacoco coverage results

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3710: - Labels: pull-request-available (was: ) > Merge archived jacoco coverage results >

[jira] [Created] (HDDS-3710) Merge archived jacoco coverage results

2020-06-03 Thread Marton Elek (Jira)
Marton Elek created HDDS-3710: - Summary: Merge archived jacoco coverage results Key: HDDS-3710 URL: https://issues.apache.org/jira/browse/HDDS-3710 Project: Hadoop Distributed Data Store Issue

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1013: HDDS-3703. Avoid file lookup calls in writeChunk hotpath

2020-06-03 Thread GitBox
adoroszlai commented on pull request #1013: URL: https://github.com/apache/hadoop-ozone/pull/1013#issuecomment-638143782 > "FilePerBlockStrategy::writeChunk-->validateChunkForOverwrite" possibly can be optimised, as "isOverWritePermitted" would be false most of the times.

[jira] [Commented] (HDDS-2562) Handle InterruptedException in DatanodeStateMachine

2020-06-03 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124884#comment-17124884 ] Sammi Chen commented on HDDS-2562: -- Hi [~dineshchitlangia], with this patch, datanode doesn't start as

[jira] [Commented] (HDDS-1504) Watch Request should use retry policy with higher timeouts for RaftClient

2020-06-03 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124875#comment-17124875 ] Lokesh Jain commented on HDDS-1504: --- [~shashikant] Is this Jira for increasing the sleep interval

[jira] [Updated] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3678: -- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDDS-1939) Owner/group information for a file should be returned from OzoneFileStatus

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124864#comment-17124864 ] Marton Elek commented on HDDS-1939: --- {quote}Turns out this problem goes away as a side effect of

[jira] [Resolved] (HDDS-3272) Smoke Test: hdfs commands failing on hadoop 27 docker-compose

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3272. --- Resolution: Duplicate Not a simple duplicate, but will be fixed by HDDS-3458. I enabled this test in

[jira] [Commented] (HDDS-2881) Legacy (isolated) ozonefs couldn't work in secure environments

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124849#comment-17124849 ] Marton Elek commented on HDDS-2881: --- This is the main reason why HDDS-3458 is started to replace the

[jira] [Resolved] (HDDS-2881) Legacy (isolated) ozonefs couldn't work in secure environments

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2881. --- Resolution: Duplicate > Legacy (isolated) ozonefs couldn't work in secure environments >

[jira] [Resolved] (HDDS-2004) Ozone documentation issues

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2004. --- Resolution: Fixed Resolving as all the sub-issues are either resolved or closed. Thanks to collect

[jira] [Resolved] (HDDS-2005) Local Multi-Container Cluster Example generates spurious lines in the config

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2005. --- Resolution: Fixed I remember that we had this problem earlier, but we have fixed it. I tested 0.5.0

[jira] [Updated] (HDDS-1565) Rename k8s-dev and k8s-dev-push profiles to docker and docker-push

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-1565: -- Target Version/s: (was: 0.7.0) > Rename k8s-dev and k8s-dev-push profiles to docker and docker-push >

[jira] [Resolved] (HDDS-1552) RpcClient works with both Hadoop-3 and Hadoop-2

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-1552. --- Resolution: Duplicate > RpcClient works with both Hadoop-3 and Hadoop-2 >

[jira] [Commented] (HDDS-1552) RpcClient works with both Hadoop-3 and Hadoop-2

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124841#comment-17124841 ] Marton Elek commented on HDDS-1552: --- Thanks the reminder (and BTW thanks the Jira clean-up effort)

[jira] [Resolved] (HDDS-851) Provide official apache docker image for Ozone

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-851. -- Fix Version/s: 0.4.0 Target Version/s: (was: 0.7.0) Resolution: Fixed It seems to be

[GitHub] [hadoop-ozone] elek merged pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-06-03 Thread GitBox
elek merged pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HDDS-1880) Decommissioining and maintenance mode in Ozone

2020-06-03 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124829#comment-17124829 ] Stephen O'Donnell commented on HDDS-1880: - [~arp] Nobody is actively working on this at the moment

[jira] [Updated] (HDDS-3703) Consider avoiding file lookup calls in writeChunk hotpath

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3703: - Labels: Triaged performance pull-request-available (was: Triaged performance) > Consider

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1013: HDDS-3703. Avoid file lookup calls in writeChunk hotpath

2020-06-03 Thread GitBox
adoroszlai opened a new pull request #1013: URL: https://github.com/apache/hadoop-ozone/pull/1013 ## What changes were proposed in this pull request? 1. Skip the check for existence of chunks directory that happened on each `getChunkFile` call. Read and delete operations already

[GitHub] [hadoop-ozone] vinayakumarb edited a comment on pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-06-03 Thread GitBox
vinayakumarb edited a comment on pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987#issuecomment-637969319 > > some code changes are already suggested in #933 > > I think the only overlap is `shuffle`. I'm fine with reverting that part of my change here to avoid

[GitHub] [hadoop-ozone] vinayakumarb commented on pull request #933: HDDS-3604. Support for Hadoop-3.3+

2020-06-03 Thread GitBox
vinayakumarb commented on pull request #933: URL: https://github.com/apache/hadoop-ozone/pull/933#issuecomment-638083091 Rebased and Updated the PR. Excluded changes related to #987 Please review. This is an automated

[GitHub] [hadoop-ozone] vinayakumarb commented on a change in pull request #933: HDDS-3604. Support for Hadoop-3.3+

2020-06-03 Thread GitBox
vinayakumarb commented on a change in pull request #933: URL: https://github.com/apache/hadoop-ozone/pull/933#discussion_r434437643 ## File path: hadoop-ozone/common/pom.xml ## @@ -82,7 +82,43 @@ https://maven.apache.org/xsd/maven-4.0.0.xsd;> true +

[GitHub] [hadoop-ozone] vinayakumarb commented on a change in pull request #933: HDDS-3604. Support for Hadoop-3.3+

2020-06-03 Thread GitBox
vinayakumarb commented on a change in pull request #933: URL: https://github.com/apache/hadoop-ozone/pull/933#discussion_r434437400 ## File path: hadoop-ozone/common/dev-support/findbugsExcludeFile.xml ## @@ -19,4 +19,10 @@ + + + + + Review

[jira] [Commented] (HDDS-3676) Display datanode uuid into the printTopology command output

2020-06-03 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124770#comment-17124770 ] maobaolong commented on HDDS-3676: -- [~xyao] Thanks for your review and suggestion. > Display datanode

[jira] [Commented] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124725#comment-17124725 ] Marton Elek commented on HDDS-1354: --- Product, AFAIK. > Kerberos principal configuration of OzoneManager

[jira] [Commented] (HDDS-2465) S3 Multipart upload failing

2020-06-03 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124724#comment-17124724 ] Jitendra Nath Pandey commented on HDDS-2465: Is this still a problem? > S3 Multipart upload

[jira] [Updated] (HDDS-2328) Support large-scale listing

2020-06-03 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-2328: --- Priority: Critical (was: Major) > Support large-scale listing >

[jira] [Commented] (HDDS-818) OzoneConfiguration uses an existing XMLRoot value

2020-06-03 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124722#comment-17124722 ] Marton Elek commented on HDDS-818: -- I think the classpath handling is changed in the last 1.5 years. Is it

[jira] [Updated] (HDDS-2465) S3 Multipart upload failing

2020-06-03 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-2465: --- Priority: Critical (was: Major) > S3 Multipart upload failing >

  1   2   >