[jira] [Created] (HDDS-4072) Pipeline creation on a datanodes should account for raft log disks reported

2020-08-05 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-4072: - Summary: Pipeline creation on a datanodes should account for raft log disks reported Key: HDDS-4072 URL: https://issues.apache.org/jira/browse/HDDS-4072

[jira] [Resolved] (HDDS-4044) Deprecate ozone.s3g.volume.name

2020-08-05 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-4044. -- Resolution: Fixed > Deprecate ozone.s3g.volume.name > --- > >

[GitHub] [hadoop-ozone] ChenSammi merged pull request #1270: HDDS-4044. Deprecate ozone.s3g.volume.name.

2020-08-05 Thread GitBox
ChenSammi merged pull request #1270: URL: https://github.com/apache/hadoop-ozone/pull/1270 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Resolved] (HDDS-4060) Clean up OM Rpc handler NPE Log

2020-08-05 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-4060. -- Resolution: Duplicate > Clean up OM Rpc handler NPE Log > --- > >

[jira] [Commented] (HDDS-4060) Clean up OM Rpc handler NPE Log

2020-08-05 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171871#comment-17171871 ] Sammi Chen commented on HDDS-4060: -- Duplicated with HDDS-4047. > Clean up OM Rpc handler NPE Log >

[GitHub] [hadoop-ozone] ChenSammi opened a new pull request #1295: HDDS-4037. Incorrect container numberOfKeys and usedBytes information…

2020-08-05 Thread GitBox
ChenSammi opened a new pull request #1295: URL: https://github.com/apache/hadoop-ozone/pull/1295 https://issues.apache.org/jira/browse/HDDS-4037 This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HDDS-4037) Incorrect container numberOfKeys and usedBytes information returned by container list command

2020-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4037: - Labels: pull-request-available (was: ) > Incorrect container numberOfKeys and usedBytes

[jira] [Created] (HDDS-4071) Add a long hold lock log and metrics to monitor the unexpected behavier.

2020-08-05 Thread maobaolong (Jira)
maobaolong created HDDS-4071: Summary: Add a long hold lock log and metrics to monitor the unexpected behavier. Key: HDDS-4071 URL: https://issues.apache.org/jira/browse/HDDS-4071 Project: Hadoop

[jira] [Created] (HDDS-4070) Design a god view for LockManager to search the lockHolder of each lock

2020-08-05 Thread maobaolong (Jira)
maobaolong created HDDS-4070: Summary: Design a god view for LockManager to search the lockHolder of each lock Key: HDDS-4070 URL: https://issues.apache.org/jira/browse/HDDS-4070 Project: Hadoop

[jira] [Updated] (HDDS-4068) Client Retry for ipc.client.connect.max.retries when first OM is down

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4068: - Component/s: Ozone Client > Client Retry for ipc.client.connect.max.retries when first OM

[jira] [Updated] (HDDS-4068) Client Retry for ipc.client.connect.max.retries when first OM is down

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4068: - Component/s: OM HA > Client Retry for ipc.client.connect.max.retries when first OM is

[jira] [Resolved] (HDDS-4063) Fix InstallSnapshot in OM HA

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-4063. -- Fix Version/s: 0.6.0 Resolution: Fixed > Fix InstallSnapshot in OM HA >

[jira] [Created] (HDDS-4069) Report datanode utilization to SCM

2020-08-05 Thread maobaolong (Jira)
maobaolong created HDDS-4069: Summary: Report datanode utilization to SCM Key: HDDS-4069 URL: https://issues.apache.org/jira/browse/HDDS-4069 Project: Hadoop Distributed Data Store Issue Type:

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1269: HDDS-4042. Update documentation for the GA release

2020-08-05 Thread GitBox
xiaoyuyao commented on a change in pull request #1269: URL: https://github.com/apache/hadoop-ozone/pull/1269#discussion_r466089826 ## File path: hadoop-hdds/docs/content/concept/StorageContainerManager.md ## @@ -0,0 +1,104 @@ +--- +title: "Storage Container Manager" +date:

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1191: HDDS-3837 Add isLeader check in SCMHAManager.

2020-08-05 Thread GitBox
xiaoyuyao commented on pull request #1191: URL: https://github.com/apache/hadoop-ozone/pull/1191#issuecomment-669624594 +1, Thanks @timmylicheng for the patience. This is an automated message from the Apache Git Service.

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1191: HDDS-3837 Add isLeader check in SCMHAManager.

2020-08-05 Thread GitBox
xiaoyuyao merged pull request #1191: URL: https://github.com/apache/hadoop-ozone/pull/1191 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HDDS-4068) Client Retry for ipc.client.connect.max.retries when first OM is down

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171849#comment-17171849 ] Bharat Viswanadham commented on HDDS-4068: -- cc [~arp]] [~hanishakoneru] Any thoughts? > Client

[jira] [Updated] (HDDS-4068) Client Retry for ipc.client.connect.max.retries when first OM is down

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4068: - Description: Right now retry logic on client to OM is, it will try connect to OM1, if it

[jira] [Created] (HDDS-4068) Client Retry for ipc.client.connect.max.retries when first OM is down

2020-08-05 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4068: Summary: Client Retry for ipc.client.connect.max.retries when first OM is down Key: HDDS-4068 URL: https://issues.apache.org/jira/browse/HDDS-4068 Project:

[jira] [Commented] (HDDS-4067) Implement toString for OMTransactionInfo

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171847#comment-17171847 ] Bharat Viswanadham commented on HDDS-4067: -- I have added you to the contributor list and assigned

[jira] [Assigned] (HDDS-4067) Implement toString for OMTransactionInfo

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-4067: Assignee: Rui Wang > Implement toString for OMTransactionInfo >

[jira] [Commented] (HDDS-4067) Implement toString for OMTransactionInfo

2020-08-05 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171842#comment-17171842 ] Rui Wang commented on HDDS-4067: Thanks Bharat, I will take this one. (I will send an email to dev@ later

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1280: HDDS-4054. Remove duplicate judgments in allocateBlockInKey.

2020-08-05 Thread GitBox
bharatviswa504 edited a comment on pull request #1280: URL: https://github.com/apache/hadoop-ozone/pull/1280#issuecomment-669604098 @captainzmc Old write request code is no more used, there is a cleanup Jira. https://issues.apache.org/jira/browse/HDDS-3371 I believe this is

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1280: HDDS-4054. Remove duplicate judgments in allocateBlockInKey.

2020-08-05 Thread GitBox
bharatviswa504 edited a comment on pull request #1280: URL: https://github.com/apache/hadoop-ozone/pull/1280#issuecomment-669604098 @captainzmc Old write request code is no more used, there is a cleanup Jira. https://issues.apache.org/jira/browse/HDDS-3371 I believe this is

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1280: HDDS-4054. Remove duplicate judgments in allocateBlockInKey.

2020-08-05 Thread GitBox
bharatviswa504 commented on pull request #1280: URL: https://github.com/apache/hadoop-ozone/pull/1280#issuecomment-669604098 @captainzmc Old write request code is no more used, there is a cleanup Jira. https://issues.apache.org/jira/browse/HDDS-3371

[jira] [Commented] (HDDS-1745) Add integration test for createDirectory for OM HA

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171837#comment-17171837 ] Bharat Viswanadham commented on HDDS-1745: -- Opened one new Jira

[jira] [Updated] (HDDS-4067) Implement toString for OMTransactionInfo

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4067: - Labels: newbie (was: ) > Implement toString for OMTransactionInfo >

[jira] [Created] (HDDS-4067) Implement toString for OMTransactionInfo

2020-08-05 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4067: Summary: Implement toString for OMTransactionInfo Key: HDDS-4067 URL: https://issues.apache.org/jira/browse/HDDS-4067 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1294: HDDS-4063. Fix InstallSnapshot in OM HA

2020-08-05 Thread GitBox
bharatviswa504 merged pull request #1294: URL: https://github.com/apache/hadoop-ozone/pull/1294 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1294: HDDS-4063. Fix InstallSnapshot in OM HA

2020-08-05 Thread GitBox
bharatviswa504 commented on pull request #1294: URL: https://github.com/apache/hadoop-ozone/pull/1294#issuecomment-669598857 Thank You @hanishakoneru for the contribution. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1286: HDDS-4040. OFS should use deleteObjects when deleting directory

2020-08-05 Thread GitBox
bharatviswa504 edited a comment on pull request #1286: URL: https://github.com/apache/hadoop-ozone/pull/1286#issuecomment-669533265 >It seems adding parameterized test for TestRootedOzoneFileSystem tripped the time out. Do we need to increase time out in test?

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1286: HDDS-4040. OFS should use deleteObjects when deleting directory

2020-08-05 Thread GitBox
bharatviswa504 commented on pull request #1286: URL: https://github.com/apache/hadoop-ozone/pull/1286#issuecomment-669533265 >It seems adding parameterized test for TestRootedOzoneFileSystem tripped the time out. Do we need to increase time out in test?

[GitHub] [hadoop-ozone] smengcl commented on pull request #1286: HDDS-4040. OFS should use deleteObjects when deleting directory

2020-08-05 Thread GitBox
smengcl commented on pull request #1286: URL: https://github.com/apache/hadoop-ozone/pull/1286#issuecomment-669513483 It seems adding parameterized test for `TestRootedOzoneFileSystem` tripped the time out. Before the parameterization it is already taking 40min to finish the

[jira] [Updated] (HDDS-4063) Fix InstallSnapshot in OM HA

2020-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4063: - Labels: pull-request-available (was: ) > Fix InstallSnapshot in OM HA >

[GitHub] [hadoop-ozone] hanishakoneru opened a new pull request #1294: HDDS-4063. Fix InstallSnapshot in OM HA

2020-08-05 Thread GitBox
hanishakoneru opened a new pull request #1294: URL: https://github.com/apache/hadoop-ozone/pull/1294 ## What changes were proposed in this pull request? OzoneManagerStateMachine#notifyInstallSnapshotFromLeader() checks the incoming roleInfoProto and proceeds with install snapshot

[jira] [Commented] (HDDS-1745) Add integration test for createDirectory for OM HA

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171635#comment-17171635 ] Bharat Viswanadham commented on HDDS-1745: -- [~amaliujia] Sorry missed this ping. We can add an

[jira] [Comment Edited] (HDDS-1745) Add integration test for createDirectory for OM HA

2020-08-05 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171635#comment-17171635 ] Bharat Viswanadham edited comment on HDDS-1745 at 8/5/20, 5:15 PM: ---

[jira] [Commented] (HDDS-1745) Add integration test for createDirectory for OM HA

2020-08-05 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171631#comment-17171631 ] Rui Wang commented on HDDS-1745: [~hanishakoneru] Appreciate for your response. I was looking for

[jira] [Commented] (HDDS-1745) Add integration test for createDirectory for OM HA

2020-08-05 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171624#comment-17171624 ] Hanisha Koneru commented on HDDS-1745: -- Hi [~amaliujia],  I see that there are already

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1264: HDDS-4035. Update logs of HadoopDirGenerator.

2020-08-05 Thread GitBox
rakeshadr commented on pull request #1264: URL: https://github.com/apache/hadoop-ozone/pull/1264#issuecomment-669306717 Merged the changes to master branch. Thanks @aryangupta1998 for the contribution! This is an automated

[jira] [Resolved] (HDDS-4035) Update logs of HadoopDirGenerator

2020-08-05 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Radhakrishnan resolved HDDS-4035. Fix Version/s: 0.7.0 Resolution: Fixed > Update logs of HadoopDirGenerator >

[GitHub] [hadoop-ozone] rakeshadr merged pull request #1264: HDDS-4035. Update logs of HadoopDirGenerator.

2020-08-05 Thread GitBox
rakeshadr merged pull request #1264: URL: https://github.com/apache/hadoop-ozone/pull/1264 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] llemec opened a new pull request #1293: Hdds 1889

2020-08-05 Thread GitBox
llemec opened a new pull request #1293: URL: https://github.com/apache/hadoop-ozone/pull/1293 ## What changes were proposed in this pull request? Added multi line support for Audit messages in TestOzoneAuditLogger ## What is the link to the Apache JIRA

[jira] [Assigned] (HDDS-4066) add core-site support debug ozone in IntelliJ using ofs

2020-08-05 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao reassigned HDDS-4066: --- Assignee: mingchao zhao > add core-site support debug ozone in IntelliJ using ofs >

[jira] [Created] (HDDS-4066) add core-site support debug ozone in IntelliJ using ofs

2020-08-05 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-4066: --- Summary: add core-site support debug ozone in IntelliJ using ofs Key: HDDS-4066 URL: https://issues.apache.org/jira/browse/HDDS-4066 Project: Hadoop Distributed Data

[jira] [Updated] (HDDS-4066) add core-site support debug ozone in IntelliJ using ofs

2020-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4066: - Labels: pull-request-available (was: ) > add core-site support debug ozone in IntelliJ using ofs

[GitHub] [hadoop-ozone] captainzmc opened a new pull request #1292: HDDS-4066. add core-site support debug ozone in IntelliJ using ofs.

2020-08-05 Thread GitBox
captainzmc opened a new pull request #1292: URL: https://github.com/apache/hadoop-ozone/pull/1292 ## What changes were proposed in this pull request? Currently Ozone supports debug to start in IntelliJ. [See Elek's video on how to use

[jira] [Created] (HDDS-4065) Regularly close and open new pipelines

2020-08-05 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-4065: --- Summary: Regularly close and open new pipelines Key: HDDS-4065 URL: https://issues.apache.org/jira/browse/HDDS-4065 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4062) Non rack aware pipelines should not be created if multiple racks are alive

2020-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4062: - Labels: pull-request-available (was: ) > Non rack aware pipelines should not be created if

[GitHub] [hadoop-ozone] sodonnel opened a new pull request #1291: HDDS-4062. Non rack aware pipelines should not be created if multiple racks are alive

2020-08-05 Thread GitBox
sodonnel opened a new pull request #1291: URL: https://github.com/apache/hadoop-ozone/pull/1291 ## What changes were proposed in this pull request? If we have a scenario where one rack has more nodes that others, it is possible for all hosts in the cluster to have reached their

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1264: HDDS-4035. Update logs of HadoopDirGenerator.

2020-08-05 Thread GitBox
rakeshadr commented on pull request #1264: URL: https://github.com/apache/hadoop-ozone/pull/1264#issuecomment-669106569 @aryangupta1998, Thanks for updating the PR! The changes look good to me. Pending GREEN CI This

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #1290: HDDS-4064. Show container verbose info with verbose option

2020-08-05 Thread GitBox
maobaolong opened a new pull request #1290: URL: https://github.com/apache/hadoop-ozone/pull/1290 ## What changes were proposed in this pull request? Show container verbose info with verbose option ## What is the link to the Apache JIRA HDDS-4064 ## How was this

[jira] [Updated] (HDDS-4064) Show container verbose info with verbose option

2020-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4064: - Labels: pull-request-available (was: ) > Show container verbose info with verbose option >

[jira] [Created] (HDDS-4064) Show container verbose info with verbose option

2020-08-05 Thread maobaolong (Jira)
maobaolong created HDDS-4064: Summary: Show container verbose info with verbose option Key: HDDS-4064 URL: https://issues.apache.org/jira/browse/HDDS-4064 Project: Hadoop Distributed Data Store

[jira] [Resolved] (HDDS-4014) FLAKY-UT: TestCommitWatcher#testReleaseBuffersOnException

2020-08-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4014. Resolution: Duplicate > FLAKY-UT: TestCommitWatcher#testReleaseBuffersOnException >

[GitHub] [hadoop-ozone] cxorm commented on pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-08-05 Thread GitBox
cxorm commented on pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#issuecomment-669071164 > Update PR, like [HDDS-3991](https://issues.apache.org/jira/browse/HDDS-3991), Ignore protobuf lock files. > Hi @cxorm. Previous issues has been solved. Could you help

[GitHub] [hadoop-ozone] timmylicheng closed pull request #1191: HDDS-3837 Add isLeader check in SCMHAManager.

2020-08-05 Thread GitBox
timmylicheng closed pull request #1191: URL: https://github.com/apache/hadoop-ozone/pull/1191 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL