[GitHub] [hadoop-ozone] ChenSammi opened a new pull request #976: Hdds 3672. Ozone fs failed to list intermiedate directory.

2020-05-28 Thread GitBox
ChenSammi opened a new pull request #976: URL: https://github.com/apache/hadoop-ozone/pull/976 The root cause is replication factor and replication type are required field in KeyInfo proto. While the way to create the OMKeyInfo object for intermediate directory doesn't provide all

[GitHub] [hadoop-ozone] rakeshadr edited a comment on pull request #895: HDDS-3518: Add a freon generator to create directory tree and create …

2020-05-28 Thread GitBox
rakeshadr edited a comment on pull request #895: URL: https://github.com/apache/hadoop-ozone/pull/895#issuecomment-635135367 Thanks a lot @elek for the comments with detailed explanation. > 1. I guess you would like to test the correctness and not interested about the performance.

[jira] [Updated] (HDDS-3672) Ozone o3fs failed to list intermiedate directory

2020-05-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3672: - Summary: Ozone o3fs failed to list intermiedate directory (was: Ozone fs failed to list intermiedate

[jira] [Commented] (HDDS-3672) Ozone fs failed to list intermiedate directory

2020-05-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118384#comment-17118384 ] Sammi Chen commented on HDDS-3672: -- Hi [~msingh] , the data is written by TestDFSIO using o3fs. I will

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #895: HDDS-3518: Add a freon generator to create directory tree and create …

2020-05-28 Thread GitBox
rakeshadr commented on pull request #895: URL: https://github.com/apache/hadoop-ozone/pull/895#issuecomment-635135367 Thanks a lot @elek for the comments with detailed explanation. > 1. I guess you would like to test the correctness and not interested about the performance. But I

[jira] [Updated] (HDDS-3672) Ozone fs failed to list intermiedate directory

2020-05-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3672: - Summary: Ozone fs failed to list intermiedate directory (was: Ozone o3fs failed to list intermiedate

[GitHub] [hadoop-ozone] flirmnave opened a new pull request #977: HDDS-3673. Version information not printed correctly in SCM WebUI.

2020-05-28 Thread GitBox
flirmnave opened a new pull request #977: URL: https://github.com/apache/hadoop-ozone/pull/977 ## What changes were proposed in this pull request? Add property in pom so that can get correct version information. ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-3673) Version information not printed correctly in SCM WebUI.

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3673: - Labels: pull-request-available (was: ) > Version information not printed correctly in SCM WebUI.

[GitHub] [hadoop-ozone] elek commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).

2020-05-28 Thread GitBox
elek commented on pull request #911: URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-635194875 > What do you suggest with this version bump? ping @lokeshj1703, @mukul1987 This is an automated

[jira] [Updated] (HDDS-3657) Stop and start replicationmanager failed

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3657: --- Labels: (was: pull-request-available) > Stop and start replicationmanager failed >

[jira] [Resolved] (HDDS-3657) Stop and start replicationmanager failed

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3657. Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~maobaolong] for the fix. > Stop and

[jira] [Updated] (HDDS-3674) add a ozone-style.xml that can be imported into IDEA.

2020-05-28 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3674: Description: Add  a ozone-style.xml, Based on the current requirements of ozone checkstyle. After

[GitHub] [hadoop-ozone] captainzmc opened a new pull request #978: HDDS-3674. add a ozone-style.xml that can be imported into IDEA.

2020-05-28 Thread GitBox
captainzmc opened a new pull request #978: URL: https://github.com/apache/hadoop-ozone/pull/978 ## What changes were proposed in this pull request? Add a ozone-style.xml, based on the current requirements of ozone checkstyle. After importing into IDEA, you can format the code as

[jira] [Updated] (HDDS-3674) add a ozone-style.xml that can be imported into IDEA.

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3674: - Labels: pull-request-available (was: ) > add a ozone-style.xml that can be imported into IDEA. >

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #965: HDDS-3618. Update OM HA acceptance test to Python3

2020-05-28 Thread GitBox
adoroszlai commented on pull request #965: URL: https://github.com/apache/hadoop-ozone/pull/965#issuecomment-635209343 Thanks @vivekratnavel for reviewing and merging this. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] elek commented on a change in pull request #933: HDDS-3604. Support for Hadoop-3.3+

2020-05-28 Thread GitBox
elek commented on a change in pull request #933: URL: https://github.com/apache/hadoop-ozone/pull/933#discussion_r431684589 ## File path: hadoop-ozone/common/dev-support/findbugsExcludeFile.xml ## @@ -19,4 +19,10 @@ + + + + + Review comment:

[jira] [Resolved] (HDDS-3293) read operation failing when two container replicas are corrupted

2020-05-28 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3293. --- Fix Version/s: 0.6.0 Resolution: Fixed > read operation failing when two

[jira] [Resolved] (HDDS-3266) Intermittent integration test failure due to DEADLINE_EXCEEDED

2020-05-28 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3266. --- Fix Version/s: 0.6.0 Resolution: Fixed > Intermittent integration test failure

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #976: Hdds 3672. Ozone fs failed to list intermiedate directory.

2020-05-28 Thread GitBox
rakeshadr commented on a change in pull request #976: URL: https://github.com/apache/hadoop-ozone/pull/976#discussion_r431669238 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/HddsUtils.java ## @@ -465,11 +464,11 @@ public static ObjectName

[jira] [Updated] (HDDS-3657) Stop and start replicationmanager failed

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3657: --- Affects Version/s: (was: 0.7.0) > Stop and start replicationmanager failed >

[jira] [Updated] (HDDS-3674) add a ozone-style.xml that can be imported into IDEA.

2020-05-28 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3674: Environment: (was: Add a a ozone-style.xml, Based on the current requirements of ozone

[jira] [Created] (HDDS-3674) add a ozone-style.xml that can be imported into IDEA.

2020-05-28 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-3674: --- Summary: add a ozone-style.xml that can be imported into IDEA. Key: HDDS-3674 URL: https://issues.apache.org/jira/browse/HDDS-3674 Project: Hadoop Distributed Data

[jira] [Updated] (HDDS-3674) add a ozone-style.xml that can be imported into IDEA.

2020-05-28 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3674: Description: Add a a ozone-style.xml, Based on the current requirements of ozone checkstyle.

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #977: HDDS-3673. Version information not printed correctly in SCM WebUI.

2020-05-28 Thread GitBox
adoroszlai commented on a change in pull request #977: URL: https://github.com/apache/hadoop-ozone/pull/977#discussion_r431674908 ## File path: pom.xml ## @@ -75,6 +75,7 @@ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xs ${ozone.version}

[jira] [Commented] (HDDS-3604) Support for Hadoop-3.3

2020-05-28 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118461#comment-17118461 ] Marton Elek commented on HDDS-3604: --- > But now,to support Hadoop rpc with earlier version of Protobuf,

[jira] [Updated] (HDDS-3618) Update OM HA acceptance test to Python3

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3618: --- Fix Version/s: 0.6.0 > Update OM HA acceptance test to Python3 >

[jira] [Updated] (HDDS-3618) Update OM HA acceptance test to Python3

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3618: --- Labels: (was: pull-request-available) > Update OM HA acceptance test to Python3 >

[GitHub] [hadoop-ozone] elek commented on pull request #925: HDDS-3586. OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-05-28 Thread GitBox
elek commented on pull request #925: URL: https://github.com/apache/hadoop-ozone/pull/925#issuecomment-635187879 Thanks the update @hanishakoneru This pr is on me. It worked well in failure scenario, but when I started in normal scenario I noticed different errors (may or may not

[GitHub] [hadoop-ozone] flirmnave commented on pull request #977: HDDS-3673. Version information not printed correctly in SCM WebUI.

2020-05-28 Thread GitBox
flirmnave commented on pull request #977: URL: https://github.com/apache/hadoop-ozone/pull/977#issuecomment-635214210 Thanks @adoroszlai for reviewing and I change it. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] timmylicheng merged pull request #975: Hdds 3192. Handle AllocateContainer operation for HA.

2020-05-28 Thread GitBox
timmylicheng merged pull request #975: URL: https://github.com/apache/hadoop-ozone/pull/975 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Resolved] (HDDS-3633) Improve UniqueId.next() efficiency

2020-05-28 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3633. --- Fix Version/s: 0.6.0 Resolution: Fixed > Improve UniqueId.next() efficiency >

[GitHub] [hadoop-ozone] adoroszlai merged pull request #966: HDDS-3657. Unregister the metrics source when replicationmanager stop.

2020-05-28 Thread GitBox
adoroszlai merged pull request #966: URL: https://github.com/apache/hadoop-ozone/pull/966 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] maobaolong commented on pull request #978: HDDS-3674. add a ozone-style.xml that can be imported into IDEA.

2020-05-28 Thread GitBox
maobaolong commented on pull request #978: URL: https://github.com/apache/hadoop-ozone/pull/978#issuecomment-635211683 @captainzmc What a useful file, thank you, it help me to format my code easily. This is an automated

[jira] [Commented] (HDDS-3604) Support for Hadoop-3.3

2020-05-28 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118464#comment-17118464 ] Marton Elek commented on HDDS-3604: --- Ok, based on the code, as I understood, this patch is just using

[GitHub] [hadoop-ozone] timmylicheng commented on pull request #975: Hdds 3192. Handle AllocateContainer operation for HA.

2020-05-28 Thread GitBox
timmylicheng commented on pull request #975: URL: https://github.com/apache/hadoop-ozone/pull/975#issuecomment-635217170 LGTM, +1 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #968: HDDS-3633. Improve UniqueId.next() efficiency.

2020-05-28 Thread GitBox
adoroszlai commented on pull request #968: URL: https://github.com/apache/hadoop-ozone/pull/968#issuecomment-635230403 Thanks @ChenSammi for updating the patch. @bshashikant are you fine with merging this? This is an

[jira] [Created] (HDDS-3676) Display datanode uuid into the printTopology command output

2020-05-28 Thread maobaolong (Jira)
maobaolong created HDDS-3676: Summary: Display datanode uuid into the printTopology command output Key: HDDS-3676 URL: https://issues.apache.org/jira/browse/HDDS-3676 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-3677) Handle events fired from PipelineManager to close container

2020-05-28 Thread Li Cheng (Jira)
Li Cheng created HDDS-3677: -- Summary: Handle events fired from PipelineManager to close container Key: HDDS-3677 URL: https://issues.apache.org/jira/browse/HDDS-3677 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3192) Handle AllocateContainer operation for HA

2020-05-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118613#comment-17118613 ] Li Cheng commented on HDDS-3192: PR is merged. Thanks Nanda for this contribution. > Handle

[jira] [Updated] (HDDS-3192) Handle AllocateContainer operation for HA

2020-05-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-3192: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Handle AllocateContainer operation for

[jira] [Created] (HDDS-3679) Add unit tests for new PipelineManager interface

2020-05-28 Thread Li Cheng (Jira)
Li Cheng created HDDS-3679: -- Summary: Add unit tests for new PipelineManager interface Key: HDDS-3679 URL: https://issues.apache.org/jira/browse/HDDS-3679 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDDS-3678: --- Summary: Remove usage of DFSUtil.addPBProtocol method Key: HDDS-3678 URL: https://issues.apache.org/jira/browse/HDDS-3678 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3196) New PipelineManager interface to persist to RatisServer

2020-05-28 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-3196: --- Status: Patch Available (was: Open) [https://github.com/apache/hadoop-ozone/pull/980] > New PipelineManager

[jira] [Updated] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDDS-3678: Description: Hadoop 3.3.0 upgraded protocol buffers to 3.7.1 and RPC code have been changed. This

[jira] [Resolved] (HDDS-3666) Delete container failed

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong resolved HDDS-3666. -- Resolution: Duplicate > Delete container failed > --- > > Key:

[jira] [Resolved] (HDDS-3617) SCM security

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong resolved HDDS-3617. -- Resolution: Fixed > SCM security > > > Key: HDDS-3617 >

[jira] [Created] (HDDS-3675) Update Sonar statistics only from the apache repo, not from the forks

2020-05-28 Thread Marton Elek (Jira)
Marton Elek created HDDS-3675: - Summary: Update Sonar statistics only from the apache repo, not from the forks Key: HDDS-3675 URL: https://issues.apache.org/jira/browse/HDDS-3675 Project: Hadoop

[jira] [Assigned] (HDDS-2948) Object ID generator for directory and file

2020-05-28 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Radhakrishnan reassigned HDDS-2948: -- Assignee: Rakesh Radhakrishnan (was: Supratim Deka) > Object ID generator for

[jira] [Commented] (HDDS-3657) Stop and start replicationmanager failed

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118576#comment-17118576 ] maobaolong commented on HDDS-3657: -- [~adoroszlai] Thanks you for your review. > Stop and start

[jira] [Updated] (HDDS-3654) Configure a create list for backgroundCreator

2020-05-28 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3654: -- Summary: Configure a create list for backgroundCreator (was: Configure a create list for

[jira] [Commented] (HDDS-3617) SCM security

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118595#comment-17118595 ] maobaolong commented on HDDS-3617: -- Thanks [~xyao] to let me know this, your approach is more general and

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118635#comment-17118635 ] Istvan Fajth commented on HDDS-3267: As discussed in the PR, the problem to solve with this cache is

[jira] [Commented] (HDDS-3630) Merge rocksdb in datanode

2020-05-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118639#comment-17118639 ] Istvan Fajth commented on HDDS-3630: One important thing that came out from HDDS-3267 is that the

[GitHub] [hadoop-ozone] esahekmat closed pull request #726: HDDS-3267. replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread GitBox
esahekmat closed pull request #726: URL: https://github.com/apache/hadoop-ozone/pull/726 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] esahekmat commented on pull request #726: HDDS-3267. replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread GitBox
esahekmat commented on pull request #726: URL: https://github.com/apache/hadoop-ozone/pull/726#issuecomment-635369399 no problem @fapifta, This issue helps me to understand the underlying of the Ozon better This is an

[jira] [Resolved] (HDDS-3416) Enable TestSCMNodeManager#testScmStatsFromNodeReport

2020-05-28 Thread Neo Yang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neo Yang resolved HDDS-3416. Resolution: Fixed > Enable TestSCMNodeManager#testScmStatsFromNodeReport >

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #900: HDDS-3500. Hide OMFailoverProxyProvider usage behind an interface

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #900: URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r431974113 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/OmTransportFactory.java ## @@ -0,0 +1,63 @@ +/** + *

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Add the entire batch operation interface to ensure

[jira] [Updated] (HDDS-3668) OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3668: - Labels: pull-request-available upgrade (was: upgrade) > OzoneManager start fails with RocksDB

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #982: HDDS-3668. OzoneManager start fails with RocksDB error on downgrade t…

2020-05-28 Thread GitBox
avijayanhwx opened a new pull request #982: URL: https://github.com/apache/hadoop-ozone/pull/982 …o older version. ## What changes were proposed in this pull request? OM start fails with RocksDB error when downgrading to older version that does not have all the column

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc commented on a change in pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#discussion_r431896180 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java ## @@ -111,51 +114,53 @@

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread Isa Hekmatizadeh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118708#comment-17118708 ] Isa Hekmatizadeh commented on HDDS-3267: Yes, you're right, I also agree to close this issue and

[jira] [Commented] (HDDS-3673) Version information not printed correctly in SCM WebUI.

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118778#comment-17118778 ] Attila Doroszlai commented on HDDS-3673: Thanks [~cku328] for reporting this problem and

[GitHub] [hadoop-ozone] captainzmc closed pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc closed pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HDDS-3668) OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3668: - Reporter: Bharat Viswanadham (was: Aravindan Vijayan) > OzoneManager start fails with

[jira] [Commented] (HDDS-3668) OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118874#comment-17118874 ] Bharat Viswanadham commented on HDDS-3668: -- Thank You [~avijayan] for opening this issue. >

[jira] [Created] (HDDS-3680) Add a retry to the scm allocateblock process

2020-05-28 Thread maobaolong (Jira)
maobaolong created HDDS-3680: Summary: Add a retry to the scm allocateblock process Key: HDDS-3680 URL: https://issues.apache.org/jira/browse/HDDS-3680 Project: Hadoop Distributed Data Store

[jira] [Assigned] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-3678: -- Assignee: Attila Doroszlai > Remove usage of DFSUtil.addPBProtocol method >

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #900: HDDS-3500. Hide OMFailoverProxyProvider usage behind an interface

2020-05-28 Thread GitBox
bharatviswa504 commented on pull request #900: URL: https://github.com/apache/hadoop-ozone/pull/900#issuecomment-635460314 I have a question, and posted my comments to the discussion. This is an automated message from

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to

[GitHub] [hadoop-ozone] captainzmc commented on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc commented on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to ensure

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc commented on a change in pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#discussion_r429717053 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java ## @@ -111,51 +114,53 @@

[jira] [Resolved] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-05-28 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth resolved HDDS-3267. Resolution: Won't Fix > Replace ContainerCache in BlockUtils by LoadingCache >

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-05-28 Thread GitBox
captainzmc edited a comment on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-635474849 A new commit was committed to fix the review problem: 1. Use multiple KeyArgs to delete in batches. 2. Increase the batch operation interface as a whole to

[jira] [Commented] (HDDS-3669) SCM Infinite loop in BlockManagerImpl.allocateBlock

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118920#comment-17118920 ] maobaolong commented on HDDS-3669: -- PipelineStateMap#removePipeline add the following code List list

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #982: HDDS-3668. OzoneManager start fails with RocksDB error on downgrade to older version.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #982: URL: https://github.com/apache/hadoop-ozone/pull/982#discussion_r431993761 ## File path: hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/RDBStore.java ## @@ -94,6 +97,14 @@ public RDBStore(File

[jira] [Resolved] (HDDS-3673) Version information not printed correctly in SCM WebUI.

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3673. Fix Version/s: 0.6.0 Resolution: Fixed > Version information not printed correctly

[jira] [Updated] (HDDS-3673) Version information not printed correctly in SCM WebUI.

2020-05-28 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3673: --- Labels: (was: pull-request-available) > Version information not printed correctly in SCM

[GitHub] [hadoop-ozone] adoroszlai merged pull request #977: HDDS-3673. Version information not printed correctly in SCM WebUI.

2020-05-28 Thread GitBox
adoroszlai merged pull request #977: URL: https://github.com/apache/hadoop-ozone/pull/977 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HDDS-3654) Let backgroundCreator create pipeline for the support replication factors alternately

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3654: - Summary: Let backgroundCreator create pipeline for the support replication factors alternately (was:

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #983: HDDS-3584. Support write 2 replication

2020-05-28 Thread GitBox
maobaolong opened a new pull request #983: URL: https://github.com/apache/hadoop-ozone/pull/983 ## What changes were proposed in this pull request? https://docs.google.com/document/d/1YfN5IOckveREuwFWJvWJNHnySo2qSqsQ0e_sxE7XatY/edit# ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-3584) Support write 2 replication

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3584: - Labels: pull-request-available (was: ) > Support write 2 replication >

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #986: HDDS-3476. Use persisted transaction info during OM startup in OM StateMachine.

2020-05-28 Thread GitBox
bharatviswa504 opened a new pull request #986: URL: https://github.com/apache/hadoop-ozone/pull/986 ## What changes were proposed in this pull request? HDDS-3474 and HDDS-3475 persisted transaction info to OM DB. This jira is to use the transaction info in OM during OMStateMachine's

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#discussion_r432116511 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java ## @@ -173,17 +196,19 @@

[GitHub] [hadoop-ozone] smengcl commented on pull request #813: HDDS-3309. Add TimedOutTestsListener to surefire and add timeout to integration tests

2020-05-28 Thread GitBox
smengcl commented on pull request #813: URL: https://github.com/apache/hadoop-ozone/pull/813#issuecomment-635617243 Thanks @elek for triggering the recheck. The latest [it-client failure](https://github.com/apache/hadoop-ozone/pull/813/checks?check_run_id=716257941) is caused by flakiness

[jira] [Updated] (HDDS-3678) Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3678: - Labels: pull-request-available (was: ) > Remove usage of DFSUtil.addPBProtocol method >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #987: HDDS-3678. Remove usage of DFSUtil.addPBProtocol method

2020-05-28 Thread GitBox
adoroszlai opened a new pull request #987: URL: https://github.com/apache/hadoop-ozone/pull/987 ## What changes were proposed in this pull request? Remove most usage of `DFSUtil`: 1. Copy `addPBProtocol` method to `HddsServerUtil` and use it. 2. Replace `bytes2String` and

[jira] [Updated] (HDDS-3654) Let backgroundCreator create pipeline for the support replication factors alternately

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3654: - Labels: pull-request-available (was: ) > Let backgroundCreator create pipeline for the support

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #984: HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately

2020-05-28 Thread GitBox
maobaolong opened a new pull request #984: URL: https://github.com/apache/hadoop-ozone/pull/984 ## What changes were proposed in this pull request? https://docs.google.com/document/d/1YfN5IOckveREuwFWJvWJNHnySo2qSqsQ0e_sxE7XatY/edit# ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-3476) Use persisted transaction info during OM startup in OM StateMachine

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3476: - Labels: pull-request-available (was: ) > Use persisted transaction info during OM startup in OM

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#discussion_r432116511 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java ## @@ -173,17 +196,19 @@

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #856: HDDS-3475. Use transactionInfo table to persist transaction information.

2020-05-28 Thread GitBox
bharatviswa504 commented on a change in pull request #856: URL: https://github.com/apache/hadoop-ozone/pull/856#discussion_r432119014 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDoubleBuffer.java ## @@ -121,15 +133,27 @@

[GitHub] [hadoop-ozone] smengcl merged pull request #813: HDDS-3309. Add TimedOutTestsListener to surefire and add timeout to integration tests

2020-05-28 Thread GitBox
smengcl merged pull request #813: URL: https://github.com/apache/hadoop-ozone/pull/813 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (HDDS-3682) Recon UI: Add interactive visualization for file size counts

2020-05-28 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3682: Summary: Recon UI: Add interactive visualization for file size counts Key: HDDS-3682 URL: https://issues.apache.org/jira/browse/HDDS-3682

[jira] [Commented] (HDDS-3680) Add a retry to the scm allocateblock process

2020-05-28 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118926#comment-17118926 ] maobaolong commented on HDDS-3680: -- OzoneConfigKeys // Ozone scm Retry count configurations public

[GitHub] [hadoop-ozone] cku328 opened a new pull request #985: HDDS-3670. Remove property ozone.scm.container.creation.lease.timeout

2020-05-28 Thread GitBox
cku328 opened a new pull request #985: URL: https://github.com/apache/hadoop-ozone/pull/985 ## What changes were proposed in this pull request? I removed the unused property `ozone.scm.container.creation.lease.timeout` in ScmConfigKeys and some test cases. ## What is the link

[jira] [Updated] (HDDS-3670) Remove property ozone.scm.container.creation.lease.timeout

2020-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3670: - Labels: newbie pull-request-available (was: newbie) > Remove property

[GitHub] [hadoop-ozone] dineshchitlangia commented on pull request #969: HDDS-2562. Handle InterruptedException in DatanodeStateMachine

2020-05-28 Thread GitBox
dineshchitlangia commented on pull request #969: URL: https://github.com/apache/hadoop-ozone/pull/969#issuecomment-635503131 Most failures are due to `[7.002s][warning][os,thread] Failed to start thread - pthread_create failed (EAGAIN) for attributes: stacksize: 1024k, guardsize: 0k,

[jira] [Created] (HDDS-3681) Recon: Add support to store file size counts in each volume/bucket

2020-05-28 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3681: Summary: Recon: Add support to store file size counts in each volume/bucket Key: HDDS-3681 URL: https://issues.apache.org/jira/browse/HDDS-3681

  1   2   >