[jira] [Created] (HDDS-3616) TestReadRetries fails intermittently

2020-05-18 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-3616: --- Summary: TestReadRetries fails intermittently Key: HDDS-3616 URL: https://issues.apache.org/jira/browse/HDDS-3616 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] umamaheswararao commented on pull request #927: HDDS-3597. using protobuf maven plugin instead of the legacy protoc executable file

2020-05-18 Thread GitBox
umamaheswararao commented on pull request #927: URL: https://github.com/apache/hadoop-ozone/pull/927#issuecomment-630587680 Thanks @maobaolong and @vinayakumarb for doing this. Big +1 :-) This is an automated message

[jira] [Resolved] (HDDS-3603) Generate 2.5.0 protobuf classes using protobuf-maven-plugin

2020-05-18 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDDS-3603. - Resolution: Duplicate > Generate 2.5.0 protobuf classes using protobuf-maven-plugin >

[jira] [Comment Edited] (HDDS-3604) Support for Hadoop-3.3

2020-05-18 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110844#comment-17110844 ] Vinayakumar B edited comment on HDDS-3604 at 5/19/20, 4:39 AM: --- {quote}Can

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #930: HDDS-3601. Refactor TestOzoneManagerHA.java into multiple tests to avoid frequent timeout issues.

2020-05-18 Thread GitBox
bharatviswa504 commented on pull request #930: URL: https://github.com/apache/hadoop-ozone/pull/930#issuecomment-630574490 LGTM. One question I have is we have a time out rule of 5 minutes, this is applicable for each test right? Splitting it to multiple tests how will it solve the

[jira] [Commented] (HDDS-3604) Support for Hadoop-3.3

2020-05-18 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110844#comment-17110844 ] Vinayakumar B commented on HDDS-3604: - {quote}Can you please explain this? Based on my understanding

[jira] [Resolved] (HDDS-3493) Refactor Failures in MiniOzoneChaosCluster into pluggable model.

2020-05-18 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-3493. - Fix Version/s: 0.6.0 Resolution: Fixed Thanks for the reviews [~adoroszlai]. I

[GitHub] [hadoop-ozone] mukul1987 merged pull request #874: HDDS-3493. Refactor Failures in MiniOzoneChaosCluster into pluggable model.

2020-05-18 Thread GitBox
mukul1987 merged pull request #874: URL: https://github.com/apache/hadoop-ozone/pull/874 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] vinayakumarb commented on pull request #932: HDDS-3603. Generate 2.5.0 protobuf classes using protobuf-maven-plugin

2020-05-18 Thread GitBox
vinayakumarb commented on pull request #932: URL: https://github.com/apache/hadoop-ozone/pull/932#issuecomment-630572025 Thanks @elek for reviews anyway. I wil close this as duplicate This is an automated message from

[GitHub] [hadoop-ozone] vinayakumarb closed pull request #932: HDDS-3603. Generate 2.5.0 protobuf classes using protobuf-maven-plugin

2020-05-18 Thread GitBox
vinayakumarb closed pull request #932: URL: https://github.com/apache/hadoop-ozone/pull/932 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] ChenSammi merged pull request #922: HDDS-3588. Fix NPE while getPipelines if absent in query2OpenPipelines

2020-05-18 Thread GitBox
ChenSammi merged pull request #922: URL: https://github.com/apache/hadoop-ozone/pull/922 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #922: HDDS-3588. Fix NPE while getPipelines if absent in query2OpenPipelines

2020-05-18 Thread GitBox
ChenSammi commented on pull request #922: URL: https://github.com/apache/hadoop-ozone/pull/922#issuecomment-630565893 +1. Thanks @avijayanhwx for the review and @maobaolong for fix the issue. This is an automated message

[jira] [Commented] (HDDS-2939) Ozone FS namespace

2020-05-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110822#comment-17110822 ] Sammi Chen commented on HDDS-2939: -- Hi [~msingh], thanks for the explanation. So will the File table and

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #940: HDDS-3614. Remove S3Table from OmMetadataManager.

2020-05-18 Thread GitBox
bharatviswa504 commented on pull request #940: URL: https://github.com/apache/hadoop-ozone/pull/940#issuecomment-630555974 Thank You @ChenSammi for the review. Addressed review comments. This is an automated message from

[jira] [Updated] (HDDS-3615) Call cleanup on tables only when double buffer has transactions related to tables.

2020-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3615: - Labels: pull-request-available (was: ) > Call cleanup on tables only when double buffer has

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #943: HDDS-3615. Call cleanup on tables only when double buffer has transactions related to tables.

2020-05-18 Thread GitBox
bharatviswa504 opened a new pull request #943: URL: https://github.com/apache/hadoop-ozone/pull/943 Call cleanup on tables only when the double buffer has transactions related to tables. ## What changes were proposed in this pull request? (Please fill in changes proposed in

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #940: HDDS-3614. Remove S3Table from OmMetadataManager.

2020-05-18 Thread GitBox
ChenSammi commented on pull request #940: URL: https://github.com/apache/hadoop-ozone/pull/940#issuecomment-630552520 @bharatviswa504, the patch overall looks good. The static final string "S3_TABLE" and it's usage in the addOMTablesAndCodecs is missed.

[jira] [Updated] (HDDS-2556) Handle InterruptedException in BlockOutputStream

2020-05-18 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-2556: Status: Patch Available (was: Open) > Handle InterruptedException in BlockOutputStream >

[GitHub] [hadoop-ozone] ChenSammi edited a comment on pull request #934: HDDS-3605. Support close all pipelines.

2020-05-18 Thread GitBox
ChenSammi edited a comment on pull request #934: URL: https://github.com/apache/hadoop-ozone/pull/934#issuecomment-630550300 Hi, @maobaolong, can you explain in what situation this command is useful? This command is too powerful, how can we prevent user from mis-operation?

[GitHub] [hadoop-ozone] dineshchitlangia opened a new pull request #942: HDDS-2556. Handle InterruptedException in BlockOutputStream

2020-05-18 Thread GitBox
dineshchitlangia opened a new pull request #942: URL: https://github.com/apache/hadoop-ozone/pull/942 ## What changes were proposed in this pull request? Address sonar violations to handle InterruptedException appropriately. ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-2556) Handle InterruptedException in BlockOutputStream

2020-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2556: - Labels: newbie pull-request-available sonar (was: newbie sonar) > Handle InterruptedException in

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #934: HDDS-3605. Support close all pipelines.

2020-05-18 Thread GitBox
ChenSammi commented on pull request #934: URL: https://github.com/apache/hadoop-ozone/pull/934#issuecomment-630550300 Hi, @maobaolong, can you explain in what situation this command is useful? This is an automated message

[GitHub] [hadoop-ozone] prashantpogde commented on pull request #917: Hdds 3001

2020-05-18 Thread GitBox
prashantpogde commented on pull request #917: URL: https://github.com/apache/hadoop-ozone/pull/917#issuecomment-630547614 thanks, I will create smaller patches and upload them. This is an automated message from the Apache

[GitHub] [hadoop-ozone] maobaolong commented on pull request #935: HDDS-3606. Add datanode port into the printTopology command output

2020-05-18 Thread GitBox
maobaolong commented on pull request #935: URL: https://github.com/apache/hadoop-ozone/pull/935#issuecomment-630537961 @ChenSammi Thanks for correct me, sorry for my careless, i've address your comments, PTAL. This is an

[GitHub] [hadoop-ozone] maobaolong commented on pull request #927: HDDS-3597. using protobuf maven plugin instead of the legacy protoc executable file

2020-05-18 Thread GitBox
maobaolong commented on pull request #927: URL: https://github.com/apache/hadoop-ozone/pull/927#issuecomment-630529069 @elek Updated the `CONTRIBUTING.md` now, Bye bye `protoc 2.5`, thanks for your review. This is an

[jira] [Updated] (HDDS-3615) Call cleanup on tables only when double buffer has transactions related to tables.

2020-05-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3615: - Summary: Call cleanup on tables only when double buffer has transactions related to

[jira] [Updated] (HDDS-3615) Call cleanup on tables only when double buffer has transactions related to tables.

2020-05-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3615: - Description: For volume/bucket table currently it is full cache, and we need to cleanup

[jira] [Updated] (HDDS-3574) Implement ofs://: Override getTrashRoot

2020-05-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3574: - Status: Patch Available (was: In Progress) > Implement ofs://: Override getTrashRoot >

[jira] [Updated] (HDDS-3574) Implement ofs://: Override getTrashRoot

2020-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3574: - Labels: pull-request-available (was: ) > Implement ofs://: Override getTrashRoot >

[GitHub] [hadoop-ozone] smengcl opened a new pull request #941: HDDS-3574. Implement ofs://: Override getTrashRoot

2020-05-18 Thread GitBox
smengcl opened a new pull request #941: URL: https://github.com/apache/hadoop-ozone/pull/941 ## What changes were proposed in this pull request? Implement `getTrashRoot()` in OFS so deleting to trash will always move files/dirs within the same bucket. ## What is the link to

[jira] [Created] (HDDS-3615) Call cleanup for volume/bucket only when delete operations

2020-05-18 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3615: Summary: Call cleanup for volume/bucket only when delete operations Key: HDDS-3615 URL: https://issues.apache.org/jira/browse/HDDS-3615 Project: Hadoop

[jira] [Updated] (HDDS-3614) Remove S3Table from OmMetadataManager

2020-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3614: - Labels: pull-request-available (was: ) > Remove S3Table from OmMetadataManager >

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #940: HDDS-3614. Remove S3Table from OmMetadataManager.

2020-05-18 Thread GitBox
bharatviswa504 opened a new pull request #940: URL: https://github.com/apache/hadoop-ozone/pull/940 ## What changes were proposed in this pull request? Remove S3Table from OmMetadataManager, which are not used any more after HDDS-3385. ## What is the link to the Apache JIRA

[jira] [Created] (HDDS-3614) Remove S3Table from OmMetadataManager

2020-05-18 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3614: Summary: Remove S3Table from OmMetadataManager Key: HDDS-3614 URL: https://issues.apache.org/jira/browse/HDDS-3614 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] maobaolong commented on pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-05-18 Thread GitBox
maobaolong commented on pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-630488842 @sodonnel How about the result of the +1's int the community sync call? This is an automated message from

[jira] [Updated] (HDDS-3613) Fix JVMPause monitor start in OzoneManager

2020-05-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3613: - Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #939: HDDS-3613. Fix JVMPause monitor start in OzoneManager.

2020-05-18 Thread GitBox
bharatviswa504 commented on pull request #939: URL: https://github.com/apache/hadoop-ozone/pull/939#issuecomment-630484031 Thank You @hanishakoneru for the review. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #939: HDDS-3613. Fix JVMPause monitor start in OzoneManager.

2020-05-18 Thread GitBox
bharatviswa504 merged pull request #939: URL: https://github.com/apache/hadoop-ozone/pull/939 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #923: HDDS-3391. Delegate admin ACL checks to Ozone authorizer plugin.

2020-05-18 Thread GitBox
xiaoyuyao merged pull request #923: URL: https://github.com/apache/hadoop-ozone/pull/923 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #923: HDDS-3391. Delegate admin ACL checks to Ozone authorizer plugin.

2020-05-18 Thread GitBox
xiaoyuyao commented on pull request #923: URL: https://github.com/apache/hadoop-ozone/pull/923#issuecomment-630483305 Thanks all for the reviews. I will merge the PR shortly. This is an automated message from the Apache Git

[jira] [Resolved] (HDDS-1683) Update Ratis to 0.4.0-300d9c5-SNAPSHOT

2020-05-18 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-1683. -- Resolution: Abandoned > Update Ratis to 0.4.0-300d9c5-SNAPSHOT >

[jira] [Updated] (HDDS-3613) Fix JVMPause monitor start in OzoneManager

2020-05-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3613: - Status: Patch Available (was: In Progress) > Fix JVMPause monitor start in OzoneManager

[jira] [Updated] (HDDS-3613) Fix JVMPause monitor start in OzoneManager

2020-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3613: - Labels: pull-request-available (was: ) > Fix JVMPause monitor start in OzoneManager >

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #939: HDDS-3613. Fix JVMPause monitor start in OzoneManager.

2020-05-18 Thread GitBox
bharatviswa504 opened a new pull request #939: URL: https://github.com/apache/hadoop-ozone/pull/939 ## What changes were proposed in this pull request? Start JVM pause monitor during OM start up. ## What is the link to the Apache JIRA

[jira] [Created] (HDDS-3613) Fix JVMPause monitor start in OzoneManager

2020-05-18 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3613: Summary: Fix JVMPause monitor start in OzoneManager Key: HDDS-3613 URL: https://issues.apache.org/jira/browse/HDDS-3613 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #930: HDDS-3601. Refactor TestOzoneManagerHA.java into multiple tests to avoid frequent timeout issues.

2020-05-18 Thread GitBox
xiaoyuyao commented on pull request #930: URL: https://github.com/apache/hadoop-ozone/pull/930#issuecomment-630453051 Agree this will help the timeout issue of individual tests. But we have a 900s surefire timeout per test module. If they are still under the same module, we still might

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #930: HDDS-3601. Refactor TestOzoneManagerHA.java into multiple tests to avoid frequent timeout issues.

2020-05-18 Thread GitBox
xiaoyuyao commented on pull request #930: URL: https://github.com/apache/hadoop-ozone/pull/930#issuecomment-630451909 +1 from me too. Thanks for fixing this. This is an automated message from the Apache Git Service. To

[jira] [Updated] (HDDS-3596) Clean up unused code after HDDS-2940 and HDDS-2942

2020-05-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3596: - Description: It seems some snippets of code should be removed as HDDS-2940 is committed. Update: Pending

[jira] [Updated] (HDDS-3596) Clean up unused code after HDDS-2940 and HDDS-2942

2020-05-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3596: - Summary: Clean up unused code after HDDS-2940 and HDDS-2942 (was: Clean up unused code after HDDS-2940)

[GitHub] [hadoop-ozone] arp7 commented on pull request #926: HDDS-3596. Clean up unused code after HDDS-2940 and HDDS-2942

2020-05-18 Thread GitBox
arp7 commented on pull request #926: URL: https://github.com/apache/hadoop-ozone/pull/926#issuecomment-630447550 /pending We may need to delay fixing this until https://issues.apache.org/jira/browse/HDDS-2942 is committed.

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #915: HDDS-3563. Make s3GateWay s3v volume configurable.

2020-05-18 Thread GitBox
bharatviswa504 commented on pull request #915: URL: https://github.com/apache/hadoop-ozone/pull/915#issuecomment-630445839 Yes agreed, long term solution to solve this will be bind mount. If this PR solves temporarily for Tencent, I am fine with it.

[jira] [Commented] (HDDS-3589) Support running HBase on Ozone.

2020-05-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110624#comment-17110624 ] Wei-Chiu Chuang commented on HDDS-3589: --- Yes please make it a PR. Some quick comments: What is the

[jira] [Updated] (HDDS-3574) Implement ofs://: Override getTrashRoot

2020-05-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3574: - Status: In Progress (was: Patch Available) > Implement ofs://: Override getTrashRoot >

[jira] [Created] (HDDS-3612) Allow mounting bucket under other volume

2020-05-18 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3612: -- Summary: Allow mounting bucket under other volume Key: HDDS-3612 URL: https://issues.apache.org/jira/browse/HDDS-3612 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3499) Address compatibility issue by SCM DB instances change

2020-05-18 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110543#comment-17110543 ] Arpit Agarwal commented on HDDS-3499: - [~timmylicheng] can you confirm if this unblocks your upgrade?

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #874: HDDS-3493. Refactor Failures in MiniOzoneChaosCluster into pluggable model.

2020-05-18 Thread GitBox
mukul1987 commented on a change in pull request #874: URL: https://github.com/apache/hadoop-ozone/pull/874#discussion_r426821315 ## File path: hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/java/org/apache/hadoop/ozone/MiniOzoneChaosCluster.java ## @@ -406,19

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #874: HDDS-3493. Refactor Failures in MiniOzoneChaosCluster into pluggable model.

2020-05-18 Thread GitBox
adoroszlai commented on a change in pull request #874: URL: https://github.com/apache/hadoop-ozone/pull/874#discussion_r426810821 ## File path: hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/java/org/apache/hadoop/ozone/MiniOzoneChaosCluster.java ## @@ -406,19

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #874: HDDS-3493. Refactor Failures in MiniOzoneChaosCluster into pluggable model.

2020-05-18 Thread GitBox
mukul1987 commented on a change in pull request #874: URL: https://github.com/apache/hadoop-ozone/pull/874#discussion_r426807982 ## File path: hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/java/org/apache/hadoop/ozone/failure/FailureManager.java ## @@ -0,0

[jira] [Assigned] (HDDS-1470) Implement a CLI tool to dump the contents of rocksdb metadata

2020-05-18 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDDS-1470: --- Assignee: Sadanand Shenoy (was: Hrishikesh Gadre) > Implement a CLI tool to dump the

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #874: HDDS-3493. Refactor Failures in MiniOzoneChaosCluster into pluggable model.

2020-05-18 Thread GitBox
mukul1987 commented on a change in pull request #874: URL: https://github.com/apache/hadoop-ozone/pull/874#discussion_r426791389 ## File path: hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/java/org/apache/hadoop/ozone/MiniOzoneChaosCluster.java ## @@ -358,6

[jira] [Commented] (HDDS-1470) Implement a CLI tool to dump the contents of rocksdb metadata

2020-05-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110477#comment-17110477 ] Marton Elek commented on HDDS-1470: --- Are you planning to work on this [~hgadre]? It seems to be a good

[jira] [Created] (HDDS-3611) Ozone client should not consider closed container error as failure

2020-05-18 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-3611: - Summary: Ozone client should not consider closed container error as failure Key: HDDS-3611 URL: https://issues.apache.org/jira/browse/HDDS-3611 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] smengcl commented on pull request #865: HDDS-2969. Implement ofs://: Add contract test

2020-05-18 Thread GitBox
smengcl commented on pull request #865: URL: https://github.com/apache/hadoop-ozone/pull/865#issuecomment-630318136 #906 is merged. Rebasing this patch in a moment This is an automated message from the Apache Git Service. To

[jira] [Updated] (HDDS-3494) Implement ofs://: Support volume and bucket deletion

2020-05-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3494: - Resolution: Fixed Status: Resolved (was: Patch Available) > Implement ofs://: Support volume and

[GitHub] [hadoop-ozone] smengcl merged pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-18 Thread GitBox
smengcl merged pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop-ozone] smengcl commented on pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-18 Thread GitBox
smengcl commented on pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#issuecomment-630310469 Will merge this soon. Union of retest 1&2 passes all test suites. This is an automated message from the

[GitHub] [hadoop-ozone] elek commented on pull request #927: HDDS-3597. using protobuf maven plugin instead of the legacy protoc executable file

2020-05-18 Thread GitBox
elek commented on pull request #927: URL: https://github.com/apache/hadoop-ozone/pull/927#issuecomment-630309380 > Will test it soon. Tested and worked well on Linux. Bye bye `protoc 2.5`... I am +1 when the `CONTRIBUTION.md` is updated...

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #924: HDDS-3595. Add a maven proto file backward compatibility checker in Ozone.

2020-05-18 Thread GitBox
adoroszlai commented on a change in pull request #924: URL: https://github.com/apache/hadoop-ozone/pull/924#discussion_r426764724 ## File path: pom.xml ## @@ -1596,8 +1602,29 @@ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xs + +

[jira] [Updated] (HDDS-3599) Implement ofs://: Add contract test for HA

2020-05-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3599: - Status: Patch Available (was: Open) > Implement ofs://: Add contract test for HA >

[jira] [Created] (HDDS-3610) Test Recon works with MySQL and Postgres

2020-05-18 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-3610: --- Summary: Test Recon works with MySQL and Postgres Key: HDDS-3610 URL: https://issues.apache.org/jira/browse/HDDS-3610 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3574) Implement ofs://: Override getTrashRoot

2020-05-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3574: - Status: Patch Available (was: In Progress) > Implement ofs://: Override getTrashRoot >

[GitHub] [hadoop-ozone] smengcl edited a comment on pull request #928: HDDS-3599. Implement ofs://: Add contract test for HA

2020-05-18 Thread GitBox
smengcl edited a comment on pull request #928: URL: https://github.com/apache/hadoop-ozone/pull/928#issuecomment-630301984 Just a note. There is an integration test timeout issue when running on my Mac. Every time a second HA cluster is run (after the first test finishes and shutdown the

[GitHub] [hadoop-ozone] smengcl commented on pull request #928: HDDS-3599. Implement ofs://: Add contract test for HA

2020-05-18 Thread GitBox
smengcl commented on pull request #928: URL: https://github.com/apache/hadoop-ozone/pull/928#issuecomment-630301984 Just a note. There is an integration test timeout issue when running on my Mac. Every time a second HA cluster is run all the tests in that test suite times out for me. But

[GitHub] [hadoop-ozone] mukul1987 commented on pull request #924: HDDS-3595. Add a maven proto file backward compatibility checker in Ozone.

2020-05-18 Thread GitBox
mukul1987 commented on pull request #924: URL: https://github.com/apache/hadoop-ozone/pull/924#issuecomment-630301975 @elek, can you please have another look at this change ? This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] mukul1987 commented on pull request #924: HDDS-3595. Add a maven proto file backward compatibility checker in Ozone.

2020-05-18 Thread GitBox
mukul1987 commented on pull request #924: URL: https://github.com/apache/hadoop-ozone/pull/924#issuecomment-630301738 Do we need to check the backward compatibility for RPC or just for the persisted data? If only for the persisted data, it would be more useful to separated the two RPC

[jira] [Updated] (HDDS-3599) Implement ofs://: Add contract test for HA

2020-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3599: - Labels: pull-request-available (was: ) > Implement ofs://: Add contract test for HA >

[GitHub] [hadoop-ozone] smengcl commented on pull request #928: HDDS-3599. Implement ofs://: Add contract test for HA

2020-05-18 Thread GitBox
smengcl commented on pull request #928: URL: https://github.com/apache/hadoop-ozone/pull/928#issuecomment-630299167 > Hey Siyao, not sure why, but it looks like https://issues.apache.org/jira/browse/HDDS-3559 is linked to his JIRA. I think you mean to link to

[GitHub] [hadoop-ozone] smengcl commented on pull request #813: HDDS-3309. Add TimedOutTestsListener to surefire

2020-05-18 Thread GitBox
smengcl commented on pull request #813: URL: https://github.com/apache/hadoop-ozone/pull/813#issuecomment-630296429 Rebased again since HDDS-3602 is merged. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] mukul1987 commented on pull request #924: HDDS-3595. Add a maven proto file backward compatibility checker in Ozone.

2020-05-18 Thread GitBox
mukul1987 commented on pull request #924: URL: https://github.com/apache/hadoop-ozone/pull/924#issuecomment-630295146 @adoroszlai , Thanks for the review. Have addressed the comments in the followup patch. This is an

[GitHub] [hadoop-ozone] smengcl commented on pull request #813: HDDS-3309. Add TimedOutTestsListener to surefire

2020-05-18 Thread GitBox
smengcl commented on pull request #813: URL: https://github.com/apache/hadoop-ozone/pull/813#issuecomment-630282726 @adoroszlai I have rebased the jira and added commits similar to #750 . I have also left all ignored integration test classes untouched from the timeout change.

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #937: HDDS-3607. Lot of warnings at DN startup.

2020-05-18 Thread GitBox
sodonnel commented on a change in pull request #937: URL: https://github.com/apache/hadoop-ozone/pull/937#discussion_r426732321 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/impl/BlockManagerImpl.java ## @@ -108,9 +108,11

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #937: HDDS-3607. Lot of warnings at DN startup.

2020-05-18 Thread GitBox
sodonnel commented on a change in pull request #937: URL: https://github.com/apache/hadoop-ozone/pull/937#discussion_r426717257 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/impl/BlockManagerImpl.java ## @@ -108,9 +108,11

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #874: HDDS-3493. Refactor Failures in MiniOzoneChaosCluster into pluggable model.

2020-05-18 Thread GitBox
adoroszlai commented on a change in pull request #874: URL: https://github.com/apache/hadoop-ozone/pull/874#discussion_r426571715 ## File path: hadoop-ozone/fault-injection-test/mini-chaos-tests/src/test/java/org/apache/hadoop/ozone/MiniOzoneChaosCluster.java ## @@ -358,6

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #931: HDDS-3602. Fix KeyInputStream by adding a timeout exception.

2020-05-18 Thread GitBox
adoroszlai commented on pull request #931: URL: https://github.com/apache/hadoop-ozone/pull/931#issuecomment-630240967 Sorry for being late: can you please explain how adding a timeout fixes the test? This is an automated

[jira] [Commented] (HDDS-1470) Implement a CLI tool to dump the contents of rocksdb metadata

2020-05-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110343#comment-17110343 ] Marton Elek commented on HDDS-1470: --- I am not sure what is the exact plan here, we had a discussion a

[jira] [Commented] (HDDS-3354) OM HA replay optimization

2020-05-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110342#comment-17110342 ] Marton Elek commented on HDDS-3354: --- Thanks to explain, and also thanks the offline updates about this

[jira] [Commented] (HDDS-3589) Support running HBase on Ozone.

2020-05-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110335#comment-17110335 ] Marton Elek commented on HDDS-3589: --- Thanks to work in this [~sadanand_shenoy]. Can you please upload

[GitHub] [hadoop-ozone] mukul1987 commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot (0.6.0-3596a58-SNAPSHOT).

2020-05-18 Thread GitBox
mukul1987 commented on pull request #911: URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-630212368 The frequent test failures here are fixed via HDDS-3601 and HDDS-3602 This is an automated message from

[GitHub] [hadoop-ozone] elek commented on pull request #920: HDDS-3581. Make replicationfactor can be set as a number

2020-05-18 Thread GitBox
elek commented on pull request #920: URL: https://github.com/apache/hadoop-ozone/pull/920#issuecomment-630201297 Thanks to explain it @maobaolong > not sure if we should define a message StorageClass in the proto file which also contains replicationType and replicationFactor,

[GitHub] [hadoop-ozone] elek edited a comment on pull request #920: HDDS-3581. Make replicationfactor can be set as a number

2020-05-18 Thread GitBox
elek edited a comment on pull request #920: URL: https://github.com/apache/hadoop-ozone/pull/920#issuecomment-630201297 Thanks to explain it @maobaolong > not sure if we should define a message StorageClass in the proto file which also contains replicationType and

[GitHub] [hadoop-ozone] maobaolong commented on pull request #920: HDDS-3581. Make replicationfactor can be set as a number

2020-05-18 Thread GitBox
maobaolong commented on pull request #920: URL: https://github.com/apache/hadoop-ozone/pull/920#issuecomment-630185763 @elek Thank you for watching my PR. I have read the mail list link you give me before, and i agree this approach is one of the approach to solve the multi replication

[GitHub] [hadoop-ozone] fapifta commented on pull request #937: HDDS-3607. Lot of warnings at DN startup.

2020-05-18 Thread GitBox
fapifta commented on pull request #937: URL: https://github.com/apache/hadoop-ozone/pull/937#issuecomment-630181617 Hmm... there were an integration test failure that was not related (usual timeout we see in integration tests), I am unsure how to re-initiate testing, but it does not seem

[GitHub] [hadoop-ozone] fapifta commented on pull request #937: HDDS-3607. Lot of warnings at DN startup.

2020-05-18 Thread GitBox
fapifta commented on pull request #937: URL: https://github.com/apache/hadoop-ozone/pull/937#issuecomment-630179610 /retest This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #935: HDDS-3606. Add datanode port into the printTopology command output

2020-05-18 Thread GitBox
ChenSammi commented on a change in pull request #935: URL: https://github.com/apache/hadoop-ozone/pull/935#discussion_r426612777 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/TopologySubcommand.java ## @@ -116,15 +116,27 @@ private void

[GitHub] [hadoop-ozone] fapifta commented on pull request #937: HDDS-3607. Lot of warnings at DN startup.

2020-05-18 Thread GitBox
fapifta commented on pull request #937: URL: https://github.com/apache/hadoop-ozone/pull/937#issuecomment-630166960 /retest This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Created] (HDDS-3609) Avoid to use Hadoop3.x IOUtils in Ozone Client

2020-05-18 Thread Marton Elek (Jira)
Marton Elek created HDDS-3609: - Summary: Avoid to use Hadoop3.x IOUtils in Ozone Client Key: HDDS-3609 URL: https://issues.apache.org/jira/browse/HDDS-3609 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] maobaolong commented on pull request #938: HDDS-3608. NPE while process a pipeline report when PipelineQuery absent in query2OpenPipelines

2020-05-18 Thread GitBox
maobaolong commented on pull request #938: URL: https://github.com/apache/hadoop-ozone/pull/938#issuecomment-630156702 Hey @linyiqun , would you like to take a look at this PR? Thank you. This is an automated message from

[jira] [Updated] (HDDS-3608) NPE while process a pipeline report when PipelineQuery absent in query2OpenPipelines

2020-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3608: - Labels: pull-request-available (was: ) > NPE while process a pipeline report when PipelineQuery

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #938: HDDS-3608. NPE while process a pipeline report when PipelineQuery absent in query2OpenPipelines

2020-05-18 Thread GitBox
maobaolong opened a new pull request #938: URL: https://github.com/apache/hadoop-ozone/pull/938 ## What changes were proposed in this pull request? Fix a NPE while SCM receive and handle a datanode pipeline report, PipelineStateMap will get the pipelineList from

[jira] [Updated] (HDDS-3598) Allow existing buckets to enable trash ability.

2020-05-18 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-3598: --- Description: According the consideration-6 of 

  1   2   >