[GitHub] [hadoop-ozone] bshashikant commented on pull request #1005: HDDS-3350. Ozone Retry Policy Improvements.

2020-06-02 Thread GitBox
bshashikant commented on pull request #1005: URL: https://github.com/apache/hadoop-ozone/pull/1005#issuecomment-637972830 @lokeshj1703 , can you please update the patch? This is an automated message from the Apache Git Se

[GitHub] [hadoop-ozone] vinayakumarb commented on pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-06-02 Thread GitBox
vinayakumarb commented on pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987#issuecomment-637969319 > > some code changes are already suggested in #933 > > I think the only overlap is `shuffle`. I'm fine with reverting that part of my change here to avoid conflic

[jira] [Resolved] (HDDS-3477) Disable partial chunk write during flush() call in ozone client by default

2020-06-02 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3477. --- Resolution: Fixed > Disable partial chunk write during flush() call in ozone client by

[GitHub] [hadoop-ozone] bshashikant merged pull request #957: HDDS-3477. Disable partial chunk write during flush() call in ozone client by default.

2020-06-02 Thread GitBox
bshashikant merged pull request #957: URL: https://github.com/apache/hadoop-ozone/pull/957 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] bshashikant commented on pull request #957: HDDS-3477. Disable partial chunk write during flush() call in ozone client by default.

2020-06-02 Thread GitBox
bshashikant commented on pull request #957: URL: https://github.com/apache/hadoop-ozone/pull/957#issuecomment-63795 Thanks @captainzmc for the contribution. I have committed this to master branch. This is an automated me

[jira] [Commented] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-06-02 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124587#comment-17124587 ] Attila Doroszlai commented on HDDS-3678: [~seanlau], I don't think HADOOP-17046 ne

[jira] [Resolved] (HDDS-3693) Switch to PipelineStateManagerV2 and put PipelineFactory in PipelineManager

2020-06-02 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-3693. Release Note: PR is merged Resolution: Fixed > Switch to PipelineStateManagerV2 and put PipelineFactor

[GitHub] [hadoop-ozone] timmylicheng commented on pull request #1007: HDDS-3693 Switch to new StateManager interface.

2020-06-02 Thread GitBox
timmylicheng commented on pull request #1007: URL: https://github.com/apache/hadoop-ozone/pull/1007#issuecomment-637932167 Thanks @xiaoyuyao for review. I will merge it in. This is an automated message from the Apache Git Ser

[GitHub] [hadoop-ozone] timmylicheng merged pull request #1007: HDDS-3693 Switch to new StateManager interface.

2020-06-02 Thread GitBox
timmylicheng merged pull request #1007: URL: https://github.com/apache/hadoop-ozone/pull/1007 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-3667) If we gracefully stop datanode it would be better to notify scm and recon to unregister

2020-06-02 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3667: - Description: if you execute `bin/ozone --daemon stop datanode`, datanode would be better if it handle the

[jira] [Commented] (HDDS-2562) Handle InterruptedException in DatanodeStateMachine

2020-06-02 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124560#comment-17124560 ] Dinesh Chitlangia commented on HDDS-2562: - Reopened as the PR was reverted > Hand

[jira] [Updated] (HDDS-2562) Handle InterruptedException in DatanodeStateMachine

2020-06-02 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-2562: Fix Version/s: (was: 0.6.0) > Handle InterruptedException in DatanodeStateMachine >

[jira] [Updated] (HDDS-2562) Handle InterruptedException in DatanodeStateMachine

2020-06-02 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-2562: Labels: newbie sonar (was: newbie pull-request-available sonar) > Handle InterruptedExcepti

[jira] [Reopened] (HDDS-2562) Handle InterruptedException in DatanodeStateMachine

2020-06-02 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia reopened HDDS-2562: - > Handle InterruptedException in DatanodeStateMachine > --

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #1011: Revert "HDDS-2562. Handle InterruptedException in DatanodeStateMachine"

2020-06-02 Thread GitBox
dineshchitlangia merged pull request #1011: URL: https://github.com/apache/hadoop-ozone/pull/1011 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[jira] [Updated] (HDDS-3567) Make replicationfactor can be configurable to any number

2020-06-02 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3567: - Description: As there is a feature request that Ozone should support any replication number of a file, we

[GitHub] [hadoop-ozone] captainzmc commented on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-06-02 Thread GitBox
captainzmc commented on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-637919589 Fixed issues with large lock granularity. PR can continue to be reviewed. This is an automated message fro

[GitHub] [hadoop-ozone] captainzmc commented on pull request #957: HDDS-3477. Disable partial chunk write during flush() call in ozone client by default.

2020-06-02 Thread GitBox
captainzmc commented on pull request #957: URL: https://github.com/apache/hadoop-ozone/pull/957#issuecomment-637919086 Had set flush config to false in the original UT. And rewrite the same test with the flush configuration set to true. cc @bshashikant ---

[GitHub] [hadoop-ozone] prashantpogde commented on a change in pull request #1004: HDDS-3639. Maintain FileHandle Information in OMMetadataManager.

2020-06-02 Thread GitBox
prashantpogde commented on a change in pull request #1004: URL: https://github.com/apache/hadoop-ozone/pull/1004#discussion_r434276036 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyRenameResponse.java ## @@ -88,11 +88,22 @@

[GitHub] [hadoop-ozone] prashantpogde commented on a change in pull request #1004: HDDS-3639. Maintain FileHandle Information in OMMetadataManager.

2020-06-02 Thread GitBox
prashantpogde commented on a change in pull request #1004: URL: https://github.com/apache/hadoop-ozone/pull/1004#discussion_r434276194 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/key/OMKeyRenameResponse.java ## @@ -88,11 +88,22 @@

[jira] [Updated] (HDDS-3658) Stop to persist container related pipeline info of each key into OM DB to reduce DB size

2020-06-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3658: - Labels: pull-request-available (was: ) > Stop to persist container related pipeline info of each

[GitHub] [hadoop-ozone] ChenSammi opened a new pull request #1012: HDDS-3658. Stop to persist container related pipeline info of each ke…

2020-06-02 Thread GitBox
ChenSammi opened a new pull request #1012: URL: https://github.com/apache/hadoop-ozone/pull/1012 https://issues.apache.org/jira/browse/HDDS-3658 This is an automated message from the Apache Git Service. To respond to the mess

[jira] [Assigned] (HDDS-3428) Enable TestOzoneRpcClientWithRatis test cases

2020-06-02 Thread Prashant Pogde (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Pogde reassigned HDDS-3428: Assignee: Prashant Pogde > Enable TestOzoneRpcClientWithRatis test cases >

[jira] [Updated] (HDDS-3658) Stop to persist container related pipeline info of each key into OM DB to reduce DB size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Summary: Stop to persist container related pipeline info of each key into OM DB to reduce DB size (was: S

[jira] [Updated] (HDDS-3658) Stop persist container related pipeline info of each key into OM DB to reduce DB size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Summary: Stop persist container related pipeline info of each key into OM DB to reduce DB size (was: Remo

[jira] [Updated] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Description: An investigation result of serilized key size, RATIS with three replica. Following examples

[jira] [Commented] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124522#comment-17124522 ] Sammi Chen commented on HDDS-3658: -- Hi [~elek], the example is copied from the "ozone sh

[GitHub] [hadoop-ozone] sonarcloud[bot] commented on pull request #1011: Revert "HDDS-2562. Handle InterruptedException in DatanodeStateMachine"

2020-06-02 Thread GitBox
sonarcloud[bot] commented on pull request #1011: URL: https://github.com/apache/hadoop-ozone/pull/1011#issuecomment-637911957 SonarCloud Quality Gate failed. [](https://sonarcloud.io/project/issues?id=hadoop-ozone&pullRequest=1011&resolved=false&types=BUG) [](https://sonarcloud.io/pr

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #976: HDDS-3672. Ozone fs failed to list intermediate directory.

2020-06-02 Thread GitBox
ChenSammi commented on pull request #976: URL: https://github.com/apache/hadoop-ozone/pull/976#issuecomment-637911979 Thanks @elek and @rakeshadr for the review. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] dineshchitlangia opened a new pull request #1011: Revert "HDDS-2562. Handle InterruptedException in DatanodeStateMachine"

2020-06-02 Thread GitBox
dineshchitlangia opened a new pull request #1011: URL: https://github.com/apache/hadoop-ozone/pull/1011 Reverts apache/hadoop-ozone#969 After this change was merged, acceptance and integration tests are getting timed out. Reverting this to ensure other PR are not blocked by this

[jira] [Commented] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-06-02 Thread liusheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124500#comment-17124500 ] liusheng commented on HDDS-3678: Hi, Does the HADOOP-17046 need to wait  this merged firs

[GitHub] [hadoop-ozone] iamabug commented on pull request #870: HDDS-2765. security/SecureOzone.md translation

2020-06-02 Thread GitBox
iamabug commented on pull request #870: URL: https://github.com/apache/hadoop-ozone/pull/870#issuecomment-637889210 > Thanks @iamabug for the translation. > Overall LGTM, a minor title could be consistent with the latest release. Sorry for taking so long, a new commit has been made

[jira] [Updated] (HDDS-3350) Ozone Retry Policy Improvements

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3350: --- Priority: Blocker (was: Major) > Ozone Retry Policy Improvements > --

[jira] [Commented] (HDDS-3402) Use proper acls for sub directories created during CreateDirectory operation

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124463#comment-17124463 ] Jitendra Nath Pandey commented on HDDS-3402: cc [~xyao] > Use proper acls for

[jira] [Updated] (HDDS-3402) Use proper acls for sub directories created during CreateDirectory operation

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3402: --- Priority: Blocker (was: Major) > Use proper acls for sub directories created during C

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #990: HDDS-3653. Add documentation for Copy key command

2020-06-02 Thread GitBox
xiaoyuyao commented on a change in pull request #990: URL: https://github.com/apache/hadoop-ozone/pull/990#discussion_r434231116 ## File path: hadoop-hdds/docs/content/shell/KeyCommands.md ## @@ -155,3 +156,22 @@ The `key cat` command displays the contents of a specific Ozone

[jira] [Updated] (HDDS-3436) Enable TestOzoneContainerRatis test cases

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3436: --- Priority: Critical (was: Major) > Enable TestOzoneContainerRatis test cases > ---

[jira] [Updated] (HDDS-3439) Enable TestSecureContainerServer test cases

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3439: --- Priority: Blocker (was: Major) > Enable TestSecureContainerServer test cases > --

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #992: HDDS-3627. Remove FilteredClassloader and replace with maven based hadoop2/hadoop3 ozonefs generation

2020-06-02 Thread GitBox
xiaoyuyao commented on pull request #992: URL: https://github.com/apache/hadoop-ozone/pull/992#issuecomment-637860876 @elek Agree. If you could check and confirm the CI clean, I think we should merge this one given the size of the patch. --

[jira] [Updated] (HDDS-3458) Support Hadoop 2.x with build-time classpath separation instead of isolated classloader

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3458: --- Priority: Blocker (was: Major) > Support Hadoop 2.x with build-time classpath separat

[jira] [Updated] (HDDS-3476) Use persisted transaction info during OM startup in OM StateMachine

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3476: --- Priority: Critical (was: Major) > Use persisted transaction info during OM startup in

[jira] [Updated] (HDDS-3481) SCM ask 31 datanodes to replicate the same container

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3481: --- Priority: Critical (was: Major) > SCM ask 31 datanodes to replicate the same containe

[jira] [Comment Edited] (HDDS-3508) container replicas are replicated to all available datanodes

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124309#comment-17124309 ] Jitendra Nath Pandey edited comment on HDDS-3508 at 6/2/20, 11:24 PM: --

[jira] [Updated] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3512: --- Priority: Blocker (was: Major) > s3g multi-upload saved content incorrect when client

[jira] [Updated] (HDDS-3554) Multipart Upload Failed because partName mismatch

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3554: --- Priority: Critical (was: Major) > Multipart Upload Failed because partName mismatch >

[jira] [Updated] (HDDS-3562) Datanodes should send ICR when a container replica deletion is successful

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3562: --- Priority: Blocker (was: Major) > Datanodes should send ICR when a container replica d

[jira] [Commented] (HDDS-3554) Multipart Upload Failed because partName mismatch

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124457#comment-17124457 ] Jitendra Nath Pandey commented on HDDS-3554: cc [~bharat] [~elek] > Multipart

[jira] [Commented] (HDDS-3594) ManagedChannels are leaked in XceiverClientGrpc manager

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124455#comment-17124455 ] Jitendra Nath Pandey commented on HDDS-3594: Is it a duplicate of HDDS-3600 ?

[jira] [Updated] (HDDS-3596) Clean up unused code after HDDS-2940 and HDDS-2942

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3596: --- Priority: Blocker (was: Major) > Clean up unused code after HDDS-2940 and HDDS-2942 >

[jira] [Updated] (HDDS-3599) Implement ofs://: Add contract test for HA

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3599: --- Priority: Blocker (was: Major) > Implement ofs://: Add contract test for HA > ---

[jira] [Updated] (HDDS-3600) ManagedChannels leaked on ratis pipeline when there are many connection retries

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3600: --- Priority: Critical (was: Major) > ManagedChannels leaked on ratis pipeline when there

[jira] [Updated] (HDDS-3611) Ozone client should not consider closed container error as failure

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3611: --- Priority: Critical (was: Major) > Ozone client should not consider closed container e

[jira] [Updated] (HDDS-3612) Allow mounting bucket under other volume

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3612: --- Priority: Critical (was: Major) > Allow mounting bucket under other volume >

[jira] [Updated] (HDDS-3619) OzoneManager fails with IllegalArgumentException for cmdType RenameKey

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3619: --- Priority: Critical (was: Major) > OzoneManager fails with IllegalArgumentException fo

[jira] [Created] (HDDS-3709) Rebase OFS branch - 3

2020-06-02 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-3709: Summary: Rebase OFS branch - 3 Key: HDDS-3709 URL: https://issues.apache.org/jira/browse/HDDS-3709 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Assigned] (HDDS-3709) Rebase OFS branch - 3

2020-06-02 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng reassigned HDDS-3709: Assignee: Siyao Meng > Rebase OFS branch - 3 > - > > Key: HDDS-

[jira] [Updated] (HDDS-3632) HddsDatanodeService cannot be started if HDFS datanode running in same machine with same user.

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3632: --- Priority: Critical (was: Major) > HddsDatanodeService cannot be started if HDFS datan

[jira] [Updated] (HDDS-3632) HddsDatanodeService cannot be started if HDFS datanode running in same machine with same user.

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3632: --- Priority: Blocker (was: Critical) > HddsDatanodeService cannot be started if HDFS dat

[jira] [Updated] (HDDS-3627) Remove FilteredClassloader and replace with maven based hadoop2/hadoop3 ozonefs generation

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3627: --- Priority: Blocker (was: Major) > Remove FilteredClassloader and replace with maven ba

[jira] [Resolved] (HDDS-1939) Owner/group information for a file should be returned from OzoneFileStatus

2020-06-02 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng resolved HDDS-1939. -- Resolution: Not A Problem Turns out this problem goes away as a side effect of HDDS-3501 by [~elek]: ht

[jira] [Updated] (HDDS-3694) Reduce dn-audit log

2020-06-02 Thread Jitendra Nath Pandey (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDDS-3694: --- Priority: Critical (was: Minor) > Reduce dn-audit log > --- > >

[jira] [Updated] (HDDS-3566) Acceptance test ozone-mr and ozonesecure-mr do not succeed when run locally

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3566: Target Version/s: 0.7.0 (was: 0.6.0) > Acceptance test ozone-mr and ozonesecure-mr do not succeed w

[jira] [Updated] (HDDS-3376) Exclude unwanted jars from Ozone Filesystem jar

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3376: Target Version/s: 0.7.0 (was: 0.6.0) > Exclude unwanted jars from Ozone Filesystem jar > --

[jira] [Commented] (HDDS-3567) Make replicationfactor can be configurable to any number

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124447#comment-17124447 ] Arpit Agarwal commented on HDDS-3567: - [~maobaolong] it would be good to have a design

[jira] [Updated] (HDDS-1409) TestOzoneClientRetriesOnException is flaky

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1409: Target Version/s: 0.6.0 Labels: TriagePending ozone-flaky-test (was: ozone-flaky-test)

[jira] [Updated] (HDDS-2708) Translate docs to Chinese

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2708: Target Version/s: 0.7.0 > Translate docs to Chinese > - > >

[jira] [Updated] (HDDS-3689) Add various profiles to MiniOzoneChaosCluster to run different modes

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3689: Target Version/s: 0.7.0 > Add various profiles to MiniOzoneChaosCluster to run different modes > ---

[jira] [Updated] (HDDS-3601) Refactor TestOzoneManagerHA.java into multiple tests to avoid frequent timeout issues

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3601: Target Version/s: 0.6.0 Labels: TriagePending pull-request-available (was: pull-reque

[jira] [Updated] (HDDS-3542) ozone chunkinfo CLI cannot connect to OM when run from NON OM leader client node

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3542: Target Version/s: 0.7.0 > ozone chunkinfo CLI cannot connect to OM when run from NON OM leader clien

[jira] [Updated] (HDDS-3378) OzoneManager group init failed because of incorrect snapshot directory location

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3378: Target Version/s: 0.7.0 Affects Version/s: (was: 0.7.0) > OzoneManager group init failed be

[jira] [Updated] (HDDS-3381) OzoneManager starts 2 OzoneManagerDoubleBuffer for HA clusters

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3381: Target Version/s: 0.6.0 Labels: MiniOzoneChaosCluster Triaged pull-request-available

[jira] [Updated] (HDDS-3378) OzoneManager group init failed because of incorrect snapshot directory location

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3378: Affects Version/s: (was: 0.6.0) 0.7.0 > OzoneManager group init failed be

[jira] [Updated] (HDDS-3330) TestDeleteWithSlowFollower is still flaky

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3330: Target Version/s: 0.6.0 Labels: TriagePending ozone-flaky-test (was: ) > TestDeleteWi

[jira] [Updated] (HDDS-3276) Multiple leasemanager timeout exception while running MiniOzoneChaosCluster

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3276: Target Version/s: 0.6.0 Labels: MiniOzoneChaosCluster TriagePending (was: MiniOzoneCh

[jira] [Updated] (HDDS-3216) Revisit all the flags OzoneContract.xml tests to make sure all the contract options are covered

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3216: Target Version/s: 0.7.0 > Revisit all the flags OzoneContract.xml tests to make sure all the contrac

[jira] [Updated] (HDDS-3195) Make number of threads in BlockDeletingService configurable

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3195: Component/s: (was: test) > Make number of threads in BlockDeletingService configurable > ---

[jira] [Updated] (HDDS-3195) Make number of threads in BlockDeletingService configurable

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3195: Target Version/s: 0.7.0 > Make number of threads in BlockDeletingService configurable >

[jira] [Updated] (HDDS-2998) Improve test coverage of audit logging

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2998: Target Version/s: 0.7.0 > Improve test coverage of audit logging > -

[jira] [Updated] (HDDS-2794) Failed to close QUASI_CLOSED container

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2794: Target Version/s: 0.6.0 > Failed to close QUASI_CLOSED container > -

[jira] [Updated] (HDDS-2807) Fail Unit Test: TestMiniChaosOzoneCluster

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2807: Target Version/s: 0.7.0 > Fail Unit Test: TestMiniChaosOzoneCluster > --

[jira] [Updated] (HDDS-2964) Fix @Ignore-d integration tests

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2964: Target Version/s: 0.6.0 Labels: TriagePending (was: ) > Fix @Ignore-d integration tes

[jira] [Updated] (HDDS-2246) Reduce runtime of TestBlockOutputStreamWithFailures

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2246: Target Version/s: 0.7.0 (was: 0.5.0) > Reduce runtime of TestBlockOutputStreamWithFailures > --

[jira] [Updated] (HDDS-2760) Intermittent timeout in TestCloseContainerEventHandler

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2760: Target Version/s: 0.6.0 Labels: TriagePending ozone-flaky-test (was: ) > Intermittent

[jira] [Updated] (HDDS-2088) Different components in MiniOzoneChaosCluster should log to different files

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2088: Target Version/s: 0.7.0 (was: 0.5.0) > Different components in MiniOzoneChaosCluster should log to

[jira] [Updated] (HDDS-2384) Large chunks during write can have memory pressure on DN with multiple clients

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2384: Target Version/s: 0.6.0 > Large chunks during write can have memory pressure on DN with multiple cli

[jira] [Updated] (HDDS-2083) Fix TestQueryNode#testStaleNodesCount

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2083: Target Version/s: 0.6.0 Labels: TriagePending (was: ) > Fix TestQueryNode#testStaleNo

[jira] [Updated] (HDDS-2082) Fix flaky TestContainerStateMachineFailures#testApplyTransactionFailure

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2082: Target Version/s: 0.6.0 Description: {code:java} --

[jira] [Updated] (HDDS-2085) TestBlockManager#testMultipleBlockAllocationWithClosedContainer timed out

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2085: Target Version/s: 0.6.0 Description: {code:java} --

[jira] [Updated] (HDDS-1967) TestBlockOutputStreamWithFailures is flaky

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1967: Target Version/s: 0.6.0 Labels: TriagePending ozone-flaky-test (was: ozone-flaky-test)

[jira] [Updated] (HDDS-1967) TestBlockOutputStreamWithFailures is flaky

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1967: Labels: ozone-flaky-test (was: ) > TestBlockOutputStreamWithFailures is flaky > ---

[jira] [Updated] (HDDS-1681) TestNodeReportHandler failing because of NPE

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1681: Labels: TriagePending (was: ) > TestNodeReportHandler failing because of NPE >

[jira] [Updated] (HDDS-1889) Add support for verifying multiline log entry

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1889: Target Version/s: 0.7.0 > Add support for verifying multiline log entry > --

[jira] [Updated] (HDDS-1617) Restructure the code layout for Ozone Manager

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1617: Labels: Triaged backlog (was: Triaged) > Restructure the code layout for Ozone Manager > --

[jira] [Updated] (HDDS-1681) TestNodeReportHandler failing because of NPE

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1681: Target Version/s: 0.6.0 (was: 0.5.0) > TestNodeReportHandler failing because of NPE > -

[jira] [Updated] (HDDS-1427) Differentiate log messages by service instance in test output

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1427: Target Version/s: 0.7.0 (was: 0.5.0) > Differentiate log messages by service instance in test outpu

[jira] [Updated] (HDDS-1361) Add new failure modes to MiniOzoneChaosCluster

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1361: Target Version/s: 0.7.0 (was: 0.5.0) > Add new failure modes to MiniOzoneChaosCluster > ---

[jira] [Updated] (HDDS-851) Provide official apache docker image for Ozone

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-851: --- Target Version/s: 0.7.0 > Provide official apache docker image for Ozone >

[jira] [Resolved] (HDDS-3676) Display datanode uuid into the printTopology command output

2020-06-02 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3676. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~maobaolong] for the contribution and all for the

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #981: HDDS-3676. Display datanode uuid into the printTopology command output

2020-06-02 Thread GitBox
xiaoyuyao merged pull request #981: URL: https://github.com/apache/hadoop-ozone/pull/981 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Updated] (HDDS-750) Write Security audit entry to track activities related to Private Keys and certificates

2020-06-02 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-750: --- Target Version/s: (was: 0.5.0) Labels: backlog (was: ) > Write Security audit entry to

  1   2   3   4   5   6   7   >