[jira] [Updated] (HDDS-4025) Add test for creating encrypted key

2020-07-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4025: - Fix Version/s: 0.7.0 Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1254: HDDS-4025. Add test for creating encrypted key

2020-07-24 Thread GitBox
bharatviswa504 commented on pull request #1254: URL: https://github.com/apache/hadoop-ozone/pull/1254#issuecomment-663811868 Thank You @adoroszlai for the contribution and @xiaoyuyao for the review This is an automated

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1254: HDDS-4025. Add test for creating encrypted key

2020-07-24 Thread GitBox
bharatviswa504 merged pull request #1254: URL: https://github.com/apache/hadoop-ozone/pull/1254 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1242: HDDS-4007. Generate encryption info for the bucket outside bucket lock.

2020-07-24 Thread GitBox
bharatviswa504 commented on pull request #1242: URL: https://github.com/apache/hadoop-ozone/pull/1242#issuecomment-663810580 Thank You @adoroszlai for the review and test. This is an automated message from the Apache Git

[jira] [Updated] (HDDS-3955) Unable to list intermediate paths on keys created using S3G.

2020-07-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3955: - Issue Type: New Feature (was: Bug) > Unable to list intermediate paths on keys created

[jira] [Resolved] (HDDS-4007) Generate encryption info for the bucket outside bucket lock

2020-07-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-4007. -- Fix Version/s: 0.7.0 Resolution: Fixed > Generate encryption info for the bucket

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1242: HDDS-4007. Generate encryption info for the bucket outside bucket lock.

2020-07-24 Thread GitBox
bharatviswa504 merged pull request #1242: URL: https://github.com/apache/hadoop-ozone/pull/1242 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1256: HDDS-4026. Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true

2020-07-24 Thread GitBox
codecov-commenter commented on pull request #1256: URL: https://github.com/apache/hadoop-ozone/pull/1256#issuecomment-663800442 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1256?src=pr=h1) Report > Merging

[GitHub] [hadoop-ozone] prashantpogde opened a new pull request #1257: HDDS-3970. Enabling TestStorageContainerManager with all failures add…

2020-07-24 Thread GitBox
prashantpogde opened a new pull request #1257: URL: https://github.com/apache/hadoop-ozone/pull/1257 ## What changes were proposed in this pull request? ContainerStateManager: Addressing test failures ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-3970) ContainerStateManager: invalid state transition state: CLOSING event: FINALIZE

2020-07-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3970: - Labels: pull-request-available (was: ) > ContainerStateManager: invalid state transition state:

[jira] [Updated] (HDDS-4026) Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true

2020-07-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4026: - Labels: pull-request-available (was: ) > Dir rename failed when sets

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1256: HDDS-4026. Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true

2020-07-24 Thread GitBox
bharatviswa504 opened a new pull request #1256: URL: https://github.com/apache/hadoop-ozone/pull/1256 ## What changes were proposed in this pull request? Rename failed for directory when ozone.om.enable.filesystem.paths is set to true. As rename is not used by ObjectStore

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1254: HDDS-4025. Add test for creating encrypted key

2020-07-24 Thread GitBox
xiaoyuyao commented on pull request #1254: URL: https://github.com/apache/hadoop-ozone/pull/1254#issuecomment-663781002 Thanks @adoroszlai for working on this. LGTM, +1. This is an automated message from the Apache Git

[jira] [Resolved] (HDDS-3997) Ozone certificate needs additional flags and SAN extension for GRPC TLS.

2020-07-24 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3997. -- Fix Version/s: 0.6.0 Resolution: Fixed > Ozone certificate needs additional flags and SAN

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1235: HDDS-3997. Ozone certificate needs additional flags and SAN extension…

2020-07-24 Thread GitBox
xiaoyuyao merged pull request #1235: URL: https://github.com/apache/hadoop-ozone/pull/1235 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1235: HDDS-3997. Ozone certificate needs additional flags and SAN extension…

2020-07-24 Thread GitBox
xiaoyuyao commented on pull request #1235: URL: https://github.com/apache/hadoop-ozone/pull/1235#issuecomment-663779372 Thanks @jnp for the review. I will merge the PR shortly. This is an automated message from the Apache

[GitHub] [hadoop-ozone] xiaoyuyao edited a comment on pull request #1234: HDDS-3996. Missing TLS client configurations to allow ozone.grpc.tls.…

2020-07-24 Thread GitBox
xiaoyuyao edited a comment on pull request #1234: URL: https://github.com/apache/hadoop-ozone/pull/1234#issuecomment-663773891 Thanks @jnp for the review. I will merge it shortly. This is an automated message from the

[jira] [Updated] (HDDS-3996) Missing TLS client configurations to allow ozone.grpc.tls.enabled.

2020-07-24 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-3996: - Reporter: Nilotpal Nandi (was: Xiaoyu Yao) > Missing TLS client configurations to allow

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1234: HDDS-3996. Missing TLS client configurations to allow ozone.grpc.tls.…

2020-07-24 Thread GitBox
xiaoyuyao merged pull request #1234: URL: https://github.com/apache/hadoop-ozone/pull/1234 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Resolved] (HDDS-3996) Missing TLS client configurations to allow ozone.grpc.tls.enabled.

2020-07-24 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3996. -- Fix Version/s: 0.6.0 Resolution: Fixed > Missing TLS client configurations to allow

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1234: HDDS-3996. Missing TLS client configurations to allow ozone.grpc.tls.…

2020-07-24 Thread GitBox
xiaoyuyao commented on pull request #1234: URL: https://github.com/apache/hadoop-ozone/pull/1234#issuecomment-663773891 Thansk @jnp for the review. I will merge it shortly. This is an automated message from the Apache Git

[jira] [Updated] (HDDS-4021) Organize Recon DBs into a 'DBDefinition'.

2020-07-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4021: - Labels: pull-request-available (was: ) > Organize Recon DBs into a 'DBDefinition'. >

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #1255: HDDS-4021. Organize Recon DBs into a 'DBDefinition'.

2020-07-24 Thread GitBox
avijayanhwx opened a new pull request #1255: URL: https://github.com/apache/hadoop-ozone/pull/1255 ## What changes were proposed in this pull request? - ReconNodeManager uses node db in an old format which is not part of ReconDBDefinition. Move the definition to ReconDBDefinition.

[jira] [Created] (HDDS-4029) Recon unable to add a new container which is in CLOSED state.

2020-07-24 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-4029: --- Summary: Recon unable to add a new container which is in CLOSED state. Key: HDDS-4029 URL: https://issues.apache.org/jira/browse/HDDS-4029 Project: Hadoop

[jira] [Updated] (HDDS-4029) Recon unable to add a new container which is in CLOSED state.

2020-07-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4029: Target Version/s: 0.6.0 > Recon unable to add a new container which is in CLOSED state. >

[jira] [Assigned] (HDDS-4026) Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true

2020-07-24 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDDS-4026: --- Assignee: Bharat Viswanadham > Dir rename failed when sets

[jira] [Created] (HDDS-4028) Fix parser failure message for FS shell command put

2020-07-24 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-4028: Summary: Fix parser failure message for FS shell command put Key: HDDS-4028 URL: https://issues.apache.org/jira/browse/HDDS-4028 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-4027) Suppress ERROR message when SCM attempt to create additional pipelines

2020-07-24 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-4027: Summary: Suppress ERROR message when SCM attempt to create additional pipelines Key: HDDS-4027 URL: https://issues.apache.org/jira/browse/HDDS-4027 Project: Hadoop

[jira] [Updated] (HDDS-4025) Add test for creating encrypted key

2020-07-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4025: --- Status: Patch Available (was: In Progress) > Add test for creating encrypted key >

[jira] [Updated] (HDDS-4025) Add test for creating encrypted key

2020-07-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4025: - Labels: pull-request-available (was: ) > Add test for creating encrypted key >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1254: HDDS-4025. Add test for creating encrypted key

2020-07-24 Thread GitBox
adoroszlai opened a new pull request #1254: URL: https://github.com/apache/hadoop-ozone/pull/1254 ## What changes were proposed in this pull request? Add acceptance test case to create a key in encrypted bucket. Inspired by HDDS-4007.

[jira] [Resolved] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-24 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-3999. - Fix Version/s: 0.6.0 Target Version/s: (was: 0.6.0) Resolution: Fixed > OM NPE

[GitHub] [hadoop-ozone] arp7 merged pull request #1244: HDDS-3999. OM Shutdown when Commit part tries to commit the part, after abort upload.

2020-07-24 Thread GitBox
arp7 merged pull request #1244: URL: https://github.com/apache/hadoop-ozone/pull/1244 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop-ozone] arp7 commented on pull request #1244: HDDS-3999. OM Shutdown when Commit part tries to commit the part, after abort upload.

2020-07-24 Thread GitBox
arp7 commented on pull request #1244: URL: https://github.com/apache/hadoop-ozone/pull/1244#issuecomment-663608276 Thanks for contributing this patch @bharatviswa504 and thanks for the review @maobaolong. I plan to commit this shortly. If there's any remaining unaddressed comments we can

[GitHub] [hadoop-ozone] jnp commented on pull request #1235: HDDS-3997. Ozone certificate needs additional flags and SAN extension…

2020-07-24 Thread GitBox
jnp commented on pull request #1235: URL: https://github.com/apache/hadoop-ozone/pull/1235#issuecomment-663603229 +1 for the patch. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop-ozone] jnp commented on pull request #1234: HDDS-3996. Missing TLS client configurations to allow ozone.grpc.tls.…

2020-07-24 Thread GitBox
jnp commented on pull request #1234: URL: https://github.com/apache/hadoop-ozone/pull/1234#issuecomment-663600025 +1 for the patch. This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Updated] (HDDS-4026) Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true

2020-07-24 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-4026: Target Version/s: 0.6.0 Priority: Blocker (was: Major) > Dir rename failed when sets

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #1096: HDDS-3833. Use Pipeline choose policy to choose pipeline from exist pipeline list

2020-07-24 Thread GitBox
maobaolong commented on a change in pull request #1096: URL: https://github.com/apache/hadoop-ozone/pull/1096#discussion_r460067221 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/choose/algorithms/PipelineChoosePolicyFactory.java ## @@

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #1096: HDDS-3833. Use Pipeline choose policy to choose pipeline from exist pipeline list

2020-07-24 Thread GitBox
maobaolong commented on a change in pull request #1096: URL: https://github.com/apache/hadoop-ozone/pull/1096#discussion_r460063742 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/PipelineChoosePolicy.java ## @@ -0,0 +1,36 @@ +/** + * Licensed to the

[jira] [Created] (HDDS-4026) Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true

2020-07-24 Thread Rakesh Radhakrishnan (Jira)
Rakesh Radhakrishnan created HDDS-4026: -- Summary: Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true Key: HDDS-4026 URL: https://issues.apache.org/jira/browse/HDDS-4026

[jira] [Commented] (HDDS-4026) Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true

2020-07-24 Thread Rakesh Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164438#comment-17164438 ] Rakesh Radhakrishnan commented on HDDS-4026: *Analysis:* With flag to true, it is not adding

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1236: HDDS-4000. Split acceptance tests to reduce CI feedback time

2020-07-24 Thread GitBox
codecov-commenter commented on pull request #1236: URL: https://github.com/apache/hadoop-ozone/pull/1236#issuecomment-663530749 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1236?src=pr=h1) Report > Merging

[GitHub] [hadoop-ozone] leosunli commented on a change in pull request #1033: HDDS-3667. If we gracefully stop datanode it would be better to notify scm and r…

2020-07-24 Thread GitBox
leosunli commented on a change in pull request #1033: URL: https://github.com/apache/hadoop-ozone/pull/1033#discussion_r459992764 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/NodeStateManager.java ## @@ -708,6 +707,21 @@ private void

[jira] [Created] (HDDS-4025) Add test for creating encrypted key

2020-07-24 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4025: -- Summary: Add test for creating encrypted key Key: HDDS-4025 URL: https://issues.apache.org/jira/browse/HDDS-4025 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] elek commented on pull request #1226: HDDS-3989. Display revision and build date of DN in recon UI

2020-07-24 Thread GitBox
elek commented on pull request #1226: URL: https://github.com/apache/hadoop-ozone/pull/1226#issuecomment-663416483 Hi, thanks for the contributions @runitao, it's very useful for the UI. It looked good to me, but when I analyzed the network traffic found that the two new fields are

[GitHub] [hadoop-ozone] runzhiwang commented on a change in pull request #1253: HDDS-4024. Avoid while loop too soon when exception happen

2020-07-24 Thread GitBox
runzhiwang commented on a change in pull request #1253: URL: https://github.com/apache/hadoop-ozone/pull/1253#discussion_r459923041 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/DatanodeStateMachine.java ## @@

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1253: HDDS-4024. Avoid while loop too soon when exception happen

2020-07-24 Thread GitBox
adoroszlai commented on a change in pull request #1253: URL: https://github.com/apache/hadoop-ozone/pull/1253#discussion_r459900072 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/DatanodeStateMachine.java ## @@

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #1033: HDDS-3667. If we gracefully stop datanode it would be better to notify scm and r…

2020-07-24 Thread GitBox
maobaolong commented on a change in pull request #1033: URL: https://github.com/apache/hadoop-ozone/pull/1033#discussion_r459897552 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/NodeStateManager.java ## @@ -708,6 +707,21 @@ private void

[jira] [Updated] (HDDS-4024) Avoid while loop too soon when exception happen

2020-07-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4024: - Labels: pull-request-available (was: ) > Avoid while loop too soon when exception happen >

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #1253: HDDS-4024. Avoid while loop too soon when exception happen

2020-07-24 Thread GitBox
runzhiwang opened a new pull request #1253: URL: https://github.com/apache/hadoop-ozone/pull/1253 ## What changes were proposed in this pull request? When exception throw in `context.execute(executorService, heartbeatFrequency, TimeUnit.MILLISECONDS)`, thread will not sleep and

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1245: HDDS-4011. Update S3 related documentation.

2020-07-24 Thread GitBox
adoroszlai commented on a change in pull request #1245: URL: https://github.com/apache/hadoop-ozone/pull/1245#discussion_r459868266 ## File path: hadoop-hdds/docs/content/start/StartFromDockerHub.md ## @@ -72,7 +72,7 @@ connecting to the SCM's UI at

[jira] [Created] (HDDS-4024) Avoid while loop too soon when exception happen

2020-07-24 Thread runzhiwang (Jira)
runzhiwang created HDDS-4024: Summary: Avoid while loop too soon when exception happen Key: HDDS-4024 URL: https://issues.apache.org/jira/browse/HDDS-4024 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4018) Datanode log spammed by NPE

2020-07-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4018: - Labels: pull-request-available (was: ) > Datanode log spammed by NPE >

[GitHub] [hadoop-ozone] runzhiwang commented on pull request #1250: HDDS-4018. Datanode log spammed by NPE

2020-07-24 Thread GitBox
runzhiwang commented on pull request #1250: URL: https://github.com/apache/hadoop-ozone/pull/1250#issuecomment-663360990 @adoroszlai Thanks. I will file a new issue for that. This is an automated message from the Apache Git

[jira] [Updated] (HDDS-4018) Datanode log spammed by NPE

2020-07-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4018: --- Labels: (was: pull-request-available) > Datanode log spammed by NPE >

[jira] [Resolved] (HDDS-4018) Datanode log spammed by NPE

2020-07-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4018. Fix Version/s: 0.7.0 Resolution: Fixed > Datanode log spammed by NPE >

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1250: HDDS-4018. Datanode log spammed by NPE

2020-07-24 Thread GitBox
adoroszlai commented on pull request #1250: URL: https://github.com/apache/hadoop-ozone/pull/1250#issuecomment-663360651 Thanks @runzhiwang and @xiaoyuyao for the review. > The reason of so many logs when NPE happen is when NPE happen, the thread did not sleep and start another