[jira] [Updated] (HDDS-3653) Add documentation for Copy key command

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3653: - Labels: pull-request-available (was: ) > Add documentation for Copy key command >

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #990: HDDS-3653. Add documentation for Copy key command

2020-05-28 Thread GitBox
maobaolong opened a new pull request #990: URL: https://github.com/apache/hadoop-ozone/pull/990 ## What changes were proposed in this pull request? Add a documents for cp key command ## What is the link to the Apache JIRA

[GitHub] [hadoop-ozone] nandakumar131 commented on a change in pull request #980: HDDS-3196 New PipelineManager interface to persist to RatisServer.

2020-05-28 Thread GitBox
nandakumar131 commented on a change in pull request #980: URL: https://github.com/apache/hadoop-ozone/pull/980#discussion_r432260305 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineStateManagerV2.java ## @@ -0,0 +1,88 @@ +/* + *

[jira] [Resolved] (HDDS-3608) NPE while process a pipeline report when PipelineQuery absent in query2OpenPipelines

2020-05-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3608. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~maobaolong] for the contribution and all for the

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #938: HDDS-3608. NPE while process a pipeline report when PipelineQuery absent in query2OpenPipelines

2020-05-28 Thread GitBox
xiaoyuyao merged pull request #938: URL: https://github.com/apache/hadoop-ozone/pull/938 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #938: HDDS-3608. NPE while process a pipeline report when PipelineQuery absent in query2OpenPipelines

2020-05-28 Thread GitBox
xiaoyuyao commented on pull request #938: URL: https://github.com/apache/hadoop-ozone/pull/938#issuecomment-635766162 Sounds good to me. Thanks @maobaolong and all for the discussion. This is an automated message from the

[GitHub] [hadoop-ozone] nandakumar131 commented on a change in pull request #980: HDDS-3196 New PipelineManager interface to persist to RatisServer.

2020-05-28 Thread GitBox
nandakumar131 commented on a change in pull request #980: URL: https://github.com/apache/hadoop-ozone/pull/980#discussion_r432257069 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -0,0 +1,637 @@ +/** + *

[jira] [Updated] (HDDS-3685) Remove replay logic from actual request logic

2020-05-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3685: - Parent: HDDS-3354 Issue Type: Sub-task (was: Bug) > Remove replay logic from

[jira] [Updated] (HDDS-3476) Use persisted transaction info during OM startup in OM StateMachine

2020-05-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3476: - Status: Patch Available (was: Open) > Use persisted transaction info during OM startup

[jira] [Created] (HDDS-3685) Remove replay logic from actual request logic

2020-05-28 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3685: Summary: Remove replay logic from actual request logic Key: HDDS-3685 URL: https://issues.apache.org/jira/browse/HDDS-3685 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #980: HDDS-3196 New PipelineManager interface to persist to RatisServer.

2020-05-28 Thread GitBox
timmylicheng commented on a change in pull request #980: URL: https://github.com/apache/hadoop-ozone/pull/980#discussion_r432252645 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -0,0 +1,637 @@ +/** + *

[jira] [Commented] (HDDS-3683) Ozone fuse support

2020-05-28 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119269#comment-17119269 ] Mukul Kumar Singh commented on HDDS-3683: - [~maobaolong] This is already in progress and is

[jira] [Updated] (HDDS-3683) Ozone fuse support

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3683: - Description: https://github.com/opendataio/hcfsfuse > Ozone fuse support > --- > >

[jira] [Created] (HDDS-3684) Add tests for replication annotation

2020-05-28 Thread Li Cheng (Jira)
Li Cheng created HDDS-3684: -- Summary: Add tests for replication annotation Key: HDDS-3684 URL: https://issues.apache.org/jira/browse/HDDS-3684 Project: Hadoop Distributed Data Store Issue Type:

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #980: HDDS-3196 New PipelineManager interface to persist to RatisServer.

2020-05-28 Thread GitBox
xiaoyuyao commented on a change in pull request #980: URL: https://github.com/apache/hadoop-ozone/pull/980#discussion_r432245564 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineStateManagerV2.java ## @@ -0,0 +1,88 @@ +/* + *

[jira] [Updated] (HDDS-3196) New PipelineManager interface to persist to RatisServer

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3196: - Labels: pull-request-available (was: ) > New PipelineManager interface to persist to RatisServer

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #980: HDDS-3196 New PipelineManager interface to persist to RatisServer.

2020-05-28 Thread GitBox
xiaoyuyao commented on a change in pull request #980: URL: https://github.com/apache/hadoop-ozone/pull/980#discussion_r432242795 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineManagerV2Impl.java ## @@ -0,0 +1,637 @@ +/** + *

[jira] [Resolved] (HDDS-2764) security/_index.md translation

2020-05-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2764. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~iamabug] for the contribution and all for the

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #866: HDDS-2764. security/_index.md translation

2020-05-28 Thread GitBox
xiaoyuyao merged pull request #866: URL: https://github.com/apache/hadoop-ozone/pull/866 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Resolved] (HDDS-3645) Add a replication type option for putkey command

2020-05-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3645. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~maobaolong] for the contribution and all for the

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #962: HDDS-3645. Add a replication type option for putkey command

2020-05-28 Thread GitBox
xiaoyuyao merged pull request #962: URL: https://github.com/apache/hadoop-ozone/pull/962 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #976: HDDS-3672. Ozone fs failed to list intermediate directory.

2020-05-28 Thread GitBox
ChenSammi commented on a change in pull request #976: URL: https://github.com/apache/hadoop-ozone/pull/976#discussion_r432238251 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ## @@ -2037,11 +2037,11 @@ private void

[jira] [Updated] (HDDS-3672) Ozone fs failed to list intermediate directory

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3672: - Labels: pull-request-available (was: ) > Ozone fs failed to list intermediate directory >

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #976: HDDS-3672. Ozone fs failed to list intermediate directory.

2020-05-28 Thread GitBox
ChenSammi commented on a change in pull request #976: URL: https://github.com/apache/hadoop-ozone/pull/976#discussion_r432237092 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ## @@ -2037,11 +2037,11 @@ private void

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #976: HDDS-3672. Ozone fs failed to list intermediate directory.

2020-05-28 Thread GitBox
ChenSammi commented on a change in pull request #976: URL: https://github.com/apache/hadoop-ozone/pull/976#discussion_r432236941 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/HddsUtils.java ## @@ -465,11 +464,11 @@ public static ObjectName

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #968: HDDS-3633. Improve UniqueId.next() efficiency.

2020-05-28 Thread GitBox
ChenSammi commented on pull request #968: URL: https://github.com/apache/hadoop-ozone/pull/968#issuecomment-635736899 Thanks @adoroszlai @bshashikant for the review and commit. This is an automated message from the Apache

[jira] [Resolved] (HDDS-3670) Remove property ozone.scm.container.creation.lease.timeout

2020-05-28 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3670. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~cku328] for the contribution. I've merged the PR

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #985: HDDS-3670. Remove property ozone.scm.container.creation.lease.timeout

2020-05-28 Thread GitBox
xiaoyuyao merged pull request #985: URL: https://github.com/apache/hadoop-ozone/pull/985 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] aajisaka commented on pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread GitBox
aajisaka commented on pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987#issuecomment-635731459 LGTM. Thank you @adoroszlai This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HDDS-3546) The default config items of ScmClientConfig don't appear in the ozone-filesystem-xxx-jar

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3546: - Labels: pull-request-available (was: ) > The default config items of ScmClientConfig don't

[GitHub] [hadoop-ozone] Simon0806 opened a new pull request #989: HDDS-3546. use shade to build legacy jar

2020-05-28 Thread GitBox
Simon0806 opened a new pull request #989: URL: https://github.com/apache/hadoop-ozone/pull/989 ## What changes were proposed in this pull request? ![image](https://user-images.githubusercontent.com/12323514/83216058-f541ff00-a19a-11ea-8a3b-b95136b878f6.png) Currently, when using

[jira] [Created] (HDDS-3683) Ozone fuse support

2020-05-28 Thread maobaolong (Jira)
maobaolong created HDDS-3683: Summary: Ozone fuse support Key: HDDS-3683 URL: https://issues.apache.org/jira/browse/HDDS-3683 Project: Hadoop Distributed Data Store Issue Type: Improvement

[jira] [Assigned] (HDDS-3191) Switch current pipeline interface to the new Replication based interface to write to Ratis

2020-05-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-3191: -- Assignee: Li Cheng > Switch current pipeline interface to the new Replication based interface to >

[jira] [Updated] (HDDS-3191) Switch current pipeline interface to the new Replication based interface to write to Ratis

2020-05-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-3191: --- Summary: Switch current pipeline interface to the new Replication based interface to write to Ratis (was:

[jira] [Resolved] (HDDS-3550) Fix TestReadRetries

2020-05-28 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-3550. - Resolution: Fixed > Fix TestReadRetries > --- > > Key:

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #979: HDDS-3550. Fix TestReadRetries.

2020-05-28 Thread GitBox
dineshchitlangia merged pull request #979: URL: https://github.com/apache/hadoop-ozone/pull/979 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HDDS-3550) Fix TestReadRetries

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3550: - Labels: pull-request-available (was: ) > Fix TestReadRetries > --- > >

[jira] [Updated] (HDDS-3672) Ozone fs failed to list intermediate directory

2020-05-28 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-3672: Summary: Ozone fs failed to list intermediate directory (was: Ozone fs failed to list

[jira] [Updated] (HDDS-3475) Use transactionInfo table to persist transaction information

2020-05-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3475: - Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#issuecomment-635706807 Thank You @hanishakoneru for the review This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 merged pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HDDS-3681) Recon: Add support to store file size counts in each volume/bucket

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3681: - Labels: pull-request-available (was: ) > Recon: Add support to store file size counts in each

[GitHub] [hadoop-ozone] vivekratnavel opened a new pull request #988: HDDS-3681. Recon: Add support to store file size counts in each volum…

2020-05-28 Thread GitBox
vivekratnavel opened a new pull request #988: URL: https://github.com/apache/hadoop-ozone/pull/988 …e/bucket ## What changes were proposed in this pull request? - update utilization schema to include volume and bucket information - update filesizecount task to persist

[jira] [Updated] (HDDS-3681) Recon: Add support to store file size counts in each volume/bucket

2020-05-28 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian updated HDDS-3681: - Status: Patch Available (was: Open) > Recon: Add support to store file

[GitHub] [hadoop-ozone] hanishakoneru commented on pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
hanishakoneru commented on pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#issuecomment-635635579 +1 pending CI. This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Created] (HDDS-3682) Recon UI: Add interactive visualization for file size counts

2020-05-28 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3682: Summary: Recon UI: Add interactive visualization for file size counts Key: HDDS-3682 URL: https://issues.apache.org/jira/browse/HDDS-3682

[jira] [Created] (HDDS-3681) Recon: Add support to store file size counts in each volume/bucket

2020-05-28 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3681: Summary: Recon: Add support to store file size counts in each volume/bucket Key: HDDS-3681 URL: https://issues.apache.org/jira/browse/HDDS-3681

[GitHub] [hadoop-ozone] smengcl merged pull request #813: HDDS-3309. Add TimedOutTestsListener to surefire and add timeout to integration tests

2020-05-28 Thread GitBox
smengcl merged pull request #813: URL: https://github.com/apache/hadoop-ozone/pull/813 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop-ozone] smengcl commented on pull request #813: HDDS-3309. Add TimedOutTestsListener to surefire and add timeout to integration tests

2020-05-28 Thread GitBox
smengcl commented on pull request #813: URL: https://github.com/apache/hadoop-ozone/pull/813#issuecomment-635617243 Thanks @elek for triggering the recheck. The latest [it-client failure](https://github.com/apache/hadoop-ozone/pull/813/checks?check_run_id=716257941) is caused by flakiness

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#discussion_r432116511 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java ## @@ -173,17 +196,19 @@

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#discussion_r432119014 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java ## @@ -121,15 +133,27 @@

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#issuecomment-635603658 Thank You @hanishakoneru for the review. Addressed/replied to the comments. This is an automated

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#discussion_r432116511 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java ## @@ -173,17 +196,19 @@

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread GitBox
adoroszlai opened a new pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987 ## What changes were proposed in this pull request? Remove most usage of `DFSUtil`: 1. Copy `addPBProtocol` method to `HddsServerUtil` and use it. 2. Replace `bytes2String` and

[jira] [Updated] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3678: - Labels: pull-request-available (was: ) > Remove usage of DFSUtil.addPBProtocol method >

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
hanishakoneru commented on a change in pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#discussion_r432058124 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java ## @@ -121,15 +133,27 @@

[jira] [Updated] (HDDS-3476) Use persisted transaction info during OM startup in OM StateMachine

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3476: - Labels: pull-request-available (was: ) > Use persisted transaction info during OM startup in OM

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #986: HDDS-3476. Use persisted transaction info during OM startup in OM StateMachine.

2020-05-28 Thread GitBox
bharatviswa504 opened a new pull request #986: URL: https://github.com/apache/hadoop-ozone/pull/986 ## What changes were proposed in this pull request? HDDS-3474 and HDDS-3475 persisted transaction info to OM DB. This jira is to use the transaction info in OM during OMStateMachine's

[GitHub] [hadoop-ozone] cku328 opened a new pull request #985: HDDS-3670. Remove property ozone.scm.container.creation.lease.timeout

2020-05-28 Thread GitBox
cku328 opened a new pull request #985: URL: https://github.com/apache/hadoop-ozone/pull/985 ## What changes were proposed in this pull request? I removed the unused property `ozone.scm.container.creation.lease.timeout` in ScmConfigKeys and some test cases. ## What is the link

[jira] [Updated] (HDDS-3670) Remove property ozone.scm.container.creation.lease.timeout

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3670: - Labels: newbie pull-request-available (was: newbie) > Remove property

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #984: HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately

2020-05-28 Thread GitBox
maobaolong opened a new pull request #984: URL: https://github.com/apache/hadoop-ozone/pull/984 ## What changes were proposed in this pull request? https://docs.google.com/document/d/1YfN5IOckveREuwFWJvWJNHnySo2qSqsQ0e_sxE7XatY/edit# ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-3654) Let backgroundCreator create pipeline for the support replication factors alternately

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3654: - Labels: pull-request-available (was: ) > Let backgroundCreator create pipeline for the support

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #983: HDDS-3584. Support write 2 replication

2020-05-28 Thread GitBox
maobaolong opened a new pull request #983: URL: https://github.com/apache/hadoop-ozone/pull/983 ## What changes were proposed in this pull request? https://docs.google.com/document/d/1YfN5IOckveREuwFWJvWJNHnySo2qSqsQ0e_sxE7XatY/edit# ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-3584) Support write 2 replication

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3584: - Labels: pull-request-available (was: ) > Support write 2 replication >

[GitHub] [hadoop-ozone] dineshchitlangia commented on pull request #969: HDDS-2562. Handle InterruptedException in DatanodeStateMachine

2020-05-28 Thread GitBox
dineshchitlangia commented on pull request #969: URL: https://github.com/apache/hadoop-ozone/pull/969#issuecomment-635503131 Most failures are due to `[7.002s][warning][os,thread] Failed to start thread - pthread_create failed (EAGAIN) for attributes: stacksize: 1024k, guardsize: 0k,

[jira] [Updated] (HDDS-3654) Let backgroundCreator create pipeline for the support replication factors alternately

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3654: - Summary: Let backgroundCreator create pipeline for the support replication factors alternately (was:

[jira] [Commented] (HDDS-3680) Add a retry to the scm allocateblock process

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118926#comment-17118926 ] maobaolong commented on HDDS-3680: -- OzoneConfigKeys // Ozone scm Retry count configurations public

[jira] [Created] (HDDS-3680) Add a retry to the scm allocateblock process

2020-05-28 Thread maobaolong (Jira)
maobaolong created HDDS-3680: Summary: Add a retry to the scm allocateblock process Key: HDDS-3680 URL: https://issues.apache.org/jira/browse/HDDS-3680 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3669) SCM Infinite loop in BlockManagerImpl.allocateBlock

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118920#comment-17118920 ] maobaolong commented on HDDS-3669: -- PipelineStateMap#removePipeline add the following code List list

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #982: HDDS-3668. OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #982: URL: https://github.com/apache/hadoop-ozone/pull/982#discussion_r431993761 ## File path: hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/RDBStore.java ## @@ -94,6 +97,14 @@ public RDBStore(File

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Add the entire batch operation interface to ensure

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to

[GitHub] [hadoop-ozone] captainzmc commented on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc commented on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to ensure

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #900: HDDS-3500. Hide OMFailoverProxyProvider usage behind an interface

2020-05-28 Thread GitBox
bharatviswa504 commented on pull request #900: URL: https://github.com/apache/hadoop-ozone/pull/900#issuecomment-635460314 I have a question, and posted my comments to the discussion. This is an automated message from

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #900: HDDS-3500. Hide OMFailoverProxyProvider usage behind an interface

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #900: URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r431974113 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/OmTransportFactory.java ## @@ -0,0 +1,63 @@ +/** + *

[jira] [Commented] (HDDS-3668) OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118874#comment-17118874 ] Bharat Viswanadham commented on HDDS-3668: -- Thank You [~avijayan] for opening this issue. >

[jira] [Updated] (HDDS-3668) OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3668: - Reporter: Bharat Viswanadham (was: Aravindan Vijayan) > OzoneManager start fails with

[jira] [Resolved] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth resolved HDDS-3267. Resolution: Won't Fix > Replace ContainerCache in BlockUtils by LoadingCache >

[jira] [Resolved] (HDDS-3416) Enable TestSCMNodeManager#testScmStatsFromNodeReport

2020-05-28 Thread Neo Yang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neo Yang resolved HDDS-3416. Resolution: Fixed > Enable TestSCMNodeManager#testScmStatsFromNodeReport >

[GitHub] [hadoop-ozone] captainzmc closed pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc closed pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Assigned] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-3678: -- Assignee: Attila Doroszlai > Remove usage of DFSUtil.addPBProtocol method >

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #982: HDDS-3668. OzoneManager start fails with RocksDB error on downgrade t…

2020-05-28 Thread GitBox
avijayanhwx opened a new pull request #982: URL: https://github.com/apache/hadoop-ozone/pull/982 …o older version. ## What changes were proposed in this pull request? OM start fails with RocksDB error when downgrading to older version that does not have all the column

[jira] [Updated] (HDDS-3668) OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3668: - Labels: pull-request-available upgrade (was: upgrade) > OzoneManager start fails with RocksDB

[jira] [Commented] (HDDS-3673) Version information not printed correctly in SCM WebUI.

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118778#comment-17118778 ] Attila Doroszlai commented on HDDS-3673: Thanks [~cku328] for reporting this problem and

[jira] [Resolved] (HDDS-3673) Version information not printed correctly in SCM WebUI.

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3673. Fix Version/s: 0.6.0 Resolution: Fixed > Version information not printed correctly

[jira] [Updated] (HDDS-3673) Version information not printed correctly in SCM WebUI.

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3673: --- Labels: (was: pull-request-available) > Version information not printed correctly in SCM

[GitHub] [hadoop-ozone] adoroszlai merged pull request #977: HDDS-3673. Version information not printed correctly in SCM WebUI.

2020-05-28 Thread GitBox
adoroszlai merged pull request #977: URL: https://github.com/apache/hadoop-ozone/pull/977 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc commented on a change in pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#discussion_r431896180 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java ## @@ -111,51 +114,53 @@

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc commented on a change in pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#discussion_r429717053 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java ## @@ -111,51 +114,53 @@

[GitHub] [hadoop-ozone] esahekmat closed pull request #726: HDDS-3267. replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread GitBox
esahekmat closed pull request #726: URL: https://github.com/apache/hadoop-ozone/pull/726 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] esahekmat commented on pull request #726: HDDS-3267. replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread GitBox
esahekmat commented on pull request #726: URL: https://github.com/apache/hadoop-ozone/pull/726#issuecomment-635369399 no problem @fapifta, This issue helps me to understand the underlying of the Ozon better This is an

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread Isa Hekmatizadeh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118708#comment-17118708 ] Isa Hekmatizadeh commented on HDDS-3267: Yes, you're right, I also agree to close this issue and

[jira] [Commented] (HDDS-3630) Merge rocksdb in datanode

2020-05-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118639#comment-17118639 ] Istvan Fajth commented on HDDS-3630: One important thing that came out from HDDS-3267 is that the

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118635#comment-17118635 ] Istvan Fajth commented on HDDS-3267: As discussed in the PR, the problem to solve with this cache is

[jira] [Updated] (HDDS-3196) New PipelineManager interface to persist to RatisServer

2020-05-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-3196: --- Status: Patch Available (was: Open) [https://github.com/apache/hadoop-ozone/pull/980] > New PipelineManager

[jira] [Updated] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDDS-3678: Description: Hadoop 3.3.0 upgraded protocol buffers to 3.7.1 and RPC code have been changed. This

[jira] [Created] (HDDS-3679) Add unit tests for new PipelineManager interface

2020-05-28 Thread Li Cheng (Jira)
Li Cheng created HDDS-3679: -- Summary: Add unit tests for new PipelineManager interface Key: HDDS-3679 URL: https://issues.apache.org/jira/browse/HDDS-3679 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDDS-3678: --- Summary: Remove usage of DFSUtil.addPBProtocol method Key: HDDS-3678 URL: https://issues.apache.org/jira/browse/HDDS-3678 Project: Hadoop Distributed Data Store

  1   2   >