Shashikant Banerjee created HDDS-3629:
-
Summary: Fix
TestBlockOutputStreamWithFailures#test2DatanodesFailure
Key: HDDS-3629
URL: https://issues.apache.org/jira/browse/HDDS-3629
Project: Hadoop
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-631439476
#08a3495 is failed with timeout, and it seems to be Ratis related:
```
2020-05-20 09:55:02,620
[java.util.concurrent.ThreadPoolExecutor$Worker@687b99c3[State = -1,
[
https://issues.apache.org/jira/browse/HDDS-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien updated HDDS-2431:
---
Description:
Add recover-trash command to the Ozone CLI.
*Note to be done*
1. Admins checking
xiaoyuyao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428208942
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
xiaoyuyao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428209482
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
xiaoyuyao commented on a change in pull request #934:
URL: https://github.com/apache/hadoop-ozone/pull/934#discussion_r428215546
##
File path:
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/pipeline/ClosePipelineSubcommand.java
##
@@ -38,14 +40,59 @@
xiaoyuyao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428204750
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -78,8 +88,8 @@ private void initOFSPath(String
[
https://issues.apache.org/jira/browse/HDDS-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia updated HDDS-3624:
Fix Version/s: 0.6.0
Resolution: Fixed
Status: Resolved (was: Patch
xiaoyuyao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428212741
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java
##
@@ -658,6 +658,19 @@ public String
dineshchitlangia merged pull request #947:
URL: https://github.com/apache/hadoop-ozone/pull/947
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
arp7 commented on pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#issuecomment-631639960
Just one thought about permissions. How will we ensure data deleted by one
user and moved to `.Trash` is not made visible to another user who doesn't have
permissions to see
xiaoyuyao commented on a change in pull request #934:
URL: https://github.com/apache/hadoop-ozone/pull/934#discussion_r428217119
##
File path:
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/pipeline/ClosePipelineSubcommand.java
##
@@ -38,14 +40,59 @@
[
https://issues.apache.org/jira/browse/HDDS-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien updated HDDS-2353:
---
Description:
This Jira is to cleanup old write path code in OM. As the newly added
request/response
xiaoyuyao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428210316
##
File path:
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/shell/TestOzoneShellHA.java
##
@@ -442,6 +446,27 @@ public void
xiaoyuyao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428210556
##
File path:
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/shell/TestOzoneShellHA.java
##
@@ -442,6 +446,27 @@ public void
xiaoyuyao commented on a change in pull request #934:
URL: https://github.com/apache/hadoop-ozone/pull/934#discussion_r428217442
##
File path:
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/pipeline/ClosePipelineSubcommand.java
##
@@ -38,14 +40,59 @@
umamaheswararao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428181772
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
xiaoyuyao commented on a change in pull request #934:
URL: https://github.com/apache/hadoop-ozone/pull/934#discussion_r428215546
##
File path:
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/pipeline/ClosePipelineSubcommand.java
##
@@ -38,14 +40,59 @@
[
https://issues.apache.org/jira/browse/HDDS-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia reassigned HDDS-2566:
---
Assignee: Dinesh Chitlangia
> Handle InterruptedException in ContainerDataScanner
>
[
https://issues.apache.org/jira/browse/HDDS-2564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia reassigned HDDS-2564:
---
Assignee: Dinesh Chitlangia
> Handle InterruptedException in ContainerStateMachine
>
[
https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia reassigned HDDS-2562:
---
Assignee: Dinesh Chitlangia
> Handle InterruptedException in DatanodeStateMachine
>
[
https://issues.apache.org/jira/browse/HDDS-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia reassigned HDDS-2563:
---
Assignee: Dinesh Chitlangia
> Handle InterruptedException in RunningDatanodeState
>
xiaoyuyao commented on pull request #921:
URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-631659926
Change Line length limit from 80 -> 120 is overall positive change for me,
only once in a while I hit it with modern IDEs. A few things I can think of are
multiple-window
[
https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
runzhiwang updated HDDS-3630:
-
Description: Currently, one rocksdb for one container. one container has
5GB capacity. 10TB data need
elek opened a new pull request #949:
URL: https://github.com/apache/hadoop-ozone/pull/949
## What changes were proposed in this pull request?
As described in the parent Jira admin/client/server protocols need different
compatibility guarantees. It's better to separate them to
[
https://issues.apache.org/jira/browse/HDDS-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3621:
-
Labels: pull-request-available (was: )
> Separate client/server/admin proto files of HDDS to
runzhiwang created HDDS-3630:
Summary: Merge rocksdb into one in datanode
Key: HDDS-3630
URL: https://issues.apache.org/jira/browse/HDDS-3630
Project: Hadoop Distributed Data Store
Issue Type:
[
https://issues.apache.org/jira/browse/HDDS-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien updated HDDS-2426:
---
Description:
Support recovering trash to an existing bucket.
*Note*
1. We should also add a config
[
https://issues.apache.org/jira/browse/HDDS-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien updated HDDS-2431:
---
Description:
Add recover-trash command to the Ozone CLI.
N
was:Add recover-trash command to the
[
https://issues.apache.org/jira/browse/HDDS-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
runzhiwang updated HDDS-3626:
-
Description:
Datanode occupy 5.2GB physical memory, Xmx is 2200m, MaxDirectMemorySize is
800m, so there
fapifta commented on a change in pull request #937:
URL: https://github.com/apache/hadoop-ozone/pull/937#discussion_r428081888
##
File path:
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/impl/BlockManagerImpl.java
##
@@ -108,9 +108,11
[
https://issues.apache.org/jira/browse/HDDS-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YiSheng Lien updated HDDS-2426:
---
Description:
Support recovering trash to an existing bucket.
*Note*
We should also add a config key
[
https://issues.apache.org/jira/browse/HDDS-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
runzhiwang updated HDDS-3254:
-
Summary: Control Datanode memory (was: Datanode memory leak)
> Control Datanode memory
>
[
https://issues.apache.org/jira/browse/HDDS-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112163#comment-17112163
]
mingchao zhao commented on HDDS-3477:
-
I will submit a PR to turn
[
https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112244#comment-17112244
]
Mukul Kumar Singh commented on HDDS-3630:
-
+1, this will be good optimization. However, we need to
[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112591#comment-17112591
]
Bharat Viswanadham edited comment on HDDS-3354 at 5/20/20, 8:43 PM:
[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112592#comment-17112592
]
Bharat Viswanadham commented on HDDS-3354:
--
If there are no further objections, I will proceed
bharatviswa504 commented on a change in pull request #900:
URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r428343544
##
File path:
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/Hadoop3OmTransport.java
##
@@ -0,0 +1,269 @@
+/**
+ *
bharatviswa504 commented on a change in pull request #900:
URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r428343544
##
File path:
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/Hadoop3OmTransport.java
##
@@ -0,0 +1,269 @@
+/**
+ *
bharatviswa504 commented on a change in pull request #900:
URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r428344095
##
File path:
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/Hadoop3OmTransportFactory.java
##
@@ -0,0 +1,35 @@
+/**
smengcl commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428271227
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
smengcl commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428270097
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -78,8 +88,8 @@ private void initOFSPath(String
smengcl edited a comment on pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#issuecomment-631710390
> Just one thought about permissions. How will we ensure data deleted by one
user and moved to `.Trash` is not made visible to another user who doesn't have
smengcl commented on pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#issuecomment-631710390
> Just one thought about permissions. How will we ensure data deleted by one
user and moved to `.Trash` is not made visible to another user who doesn't have
permissions to
smengcl edited a comment on pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#issuecomment-631710390
> Just one thought about permissions. How will we ensure data deleted by one
user and moved to `.Trash` is not made visible to another user who doesn't have
smengcl commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428264049
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -66,7 +70,13 @@
static final String
smengcl commented on pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#issuecomment-631704542
Also the `getTrashRoot` code doesn't handle the case where the input path is
root, volume or bucket. Will post update in a moment.
smengcl edited a comment on pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#issuecomment-631704542
The `getTrashRoot` code doesn't handle the case where the input path is
root, volume or bucket. Will post update in a moment.
[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bharat Viswanadham updated HDDS-3354:
-
Attachment: Screen Shot 2020-05-20 at 1.28.48 PM.png
> OM HA replay optimization
>
bharatviswa504 commented on a change in pull request #942:
URL: https://github.com/apache/hadoop-ozone/pull/942#discussion_r428361979
##
File path:
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java
##
@@ -317,10 +317,16 @@ private void
maobaolong commented on pull request #938:
URL: https://github.com/apache/hadoop-ozone/pull/938#issuecomment-631789119
@linyiqun Thank you for your review, it's important to receive your +1
This is an automated message from
umamaheswararao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428253556
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
smengcl commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428292547
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java
##
@@ -658,6 +658,19 @@ public String
[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112591#comment-17112591
]
Bharat Viswanadham commented on HDDS-3354:
--
The reason for the inclusion of HDDS-3615 and
[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112590#comment-17112590
]
Bharat Viswanadham commented on HDDS-3354:
--
Hi [~elek]
Perf results:
!Screen Shot 2020-05-20 at
bharatviswa504 commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428298169
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
bharatviswa504 commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428298169
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
umamaheswararao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428253556
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
smengcl commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428269845
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
umamaheswararao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428286559
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
[
https://issues.apache.org/jira/browse/HDDS-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112591#comment-17112591
]
Bharat Viswanadham edited comment on HDDS-3354 at 5/20/20, 8:38 PM:
bharatviswa504 commented on a change in pull request #900:
URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r428354713
##
File path:
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestOzoneRpcClientAbstract.java
##
@@ -216,23
bharatviswa504 commented on a change in pull request #900:
URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r428355368
##
File path:
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/OmFailoverProxyUtil.java
##
@@ -0,0 +1,50 @@
+/**
+ *
bharatviswa504 commented on a change in pull request #900:
URL: https://github.com/apache/hadoop-ozone/pull/900#discussion_r428345175
##
File path:
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/OmTransport.java
##
@@ -0,0 +1,36 @@
+/**
+ * Licensed
dineshchitlangia commented on a change in pull request #942:
URL: https://github.com/apache/hadoop-ozone/pull/942#discussion_r428424600
##
File path:
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java
##
@@ -317,10 +317,16 @@ private
prashantpogde opened a new pull request #950:
URL: https://github.com/apache/hadoop-ozone/pull/950
## What changes were proposed in this pull request?
Syncing hadoop-ozone:HDDS-3001 branch with hadoop-ozone:master
## What is the link to the Apache JIRA
[
https://issues.apache.org/jira/browse/HDDS-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HDDS-3001:
-
Labels: pull-request-available (was: )
> NFS support for Ozone
> -
>
>
xiaoyuyao commented on a change in pull request #941:
URL: https://github.com/apache/hadoop-ozone/pull/941#discussion_r428377628
##
File path:
hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OFSPath.java
##
@@ -238,4 +248,23 @@ static String
Prashant Pogde created HDDS-3631:
Summary: Proto changes and KeyInfo related changes to support
fileHandle
Key: HDDS-3631
URL: https://issues.apache.org/jira/browse/HDDS-3631
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDDS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bharat Viswanadham resolved HDDS-3625.
--
Fix Version/s: 0.6.0
Resolution: Fixed
> BadRequestException interception
bharatviswa504 merged pull request #948:
URL: https://github.com/apache/hadoop-ozone/pull/948
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
bharatviswa504 commented on pull request #948:
URL: https://github.com/apache/hadoop-ozone/pull/948#issuecomment-631265518
Thank You @ChenSammi for the catch and fix this issue.
This is an automated message from the Apache
[
https://issues.apache.org/jira/browse/HDDS-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
runzhiwang updated HDDS-3626:
-
Description:
Datanode occupy 5.2GB physical memory, Xmx is 2200m, MaxDirectMemorySize is
800m, so there
runzhiwang created HDDS-3626:
Summary: Limit the off-heap memory of RocksDB in datanode
Key: HDDS-3626
URL: https://issues.apache.org/jira/browse/HDDS-3626
Project: Hadoop Distributed Data Store
[
https://issues.apache.org/jira/browse/HDDS-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111923#comment-17111923
]
maobaolong commented on HDDS-3001:
--
[~ppogde] Do you still work on this ticket? If don't, i'd love to
runzhiwang commented on pull request #885:
URL: https://github.com/apache/hadoop-ozone/pull/885#issuecomment-631328275
/ready
This is an automated message from the Apache Git Service.
To respond to the message, please log on
elek commented on pull request #930:
URL: https://github.com/apache/hadoop-ozone/pull/930#issuecomment-631329847
Thanks @mukul1987 the patch. (and @bharatviswa504, @adoroszlai, @xiaoyuyao,
@hanishakoneru the review and the discussion).
I am merging it to the master...
elek commented on pull request #911:
URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-631343187
> The frequent test failures here are fixed via HDDS-3601 and HDDS-3602
Both are merged. I suppose we will have mostly green builds after a rebase.
elek closed pull request #930:
URL: https://github.com/apache/hadoop-ozone/pull/930
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
runzhiwang commented on pull request #885:
URL: https://github.com/apache/hadoop-ozone/pull/885#issuecomment-631368992
@avijayanhwx Could you help review it ? Thank you very much.
This is an automated message from the
Marton Elek created HDDS-3627:
-
Summary: Remove FilteredClassloader and replace with maven based
hadoop2/hadoop3 ozonefs generation
Key: HDDS-3627
URL: https://issues.apache.org/jira/browse/HDDS-3627
Shashikant Banerjee created HDDS-3628:
-
Summary: Fix
TestOzoneManagerHA#testMultipartUploadWithOneOmNodeDown
Key: HDDS-3628
URL: https://issues.apache.org/jira/browse/HDDS-3628
Project: Hadoop
82 matches
Mail list logo
