[jira] [Updated] (HDFS-12129) Ozone: SCM http server is not stopped with SCM#stop()

[ https://issues.apache.org/jira/browse/HDFS-12129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12129: --- Affects Version/s: HDFS-7240 > Ozone: SCM http server is not stopped with SCM#stop() >

[jira] [Updated] (HDFS-12129) Ozone: SCM http server is not stopped with SCM#stop()

[ https://issues.apache.org/jira/browse/HDFS-12129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12129: --- Summary: Ozone: SCM http server is not stopped with SCM#stop() (was: Ozone) > Ozone: SCM http server

[jira] [Created] (HDFS-12129) Ozone

Weiwei Yang created HDFS-12129: -- Summary: Ozone Key: HDFS-12129 URL: https://issues.apache.org/jira/browse/HDFS-12129 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Weiwei Yang

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16085463#comment-16085463 ] Weiwei Yang commented on HDFS-12098: Ah found the difference after hours of debugging ... it's not

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088382#comment-16088382 ] Weiwei Yang commented on HDFS-12098: Hi [~anu] I just uploaded a test case patch to reproduce this

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088411#comment-16088411 ] Weiwei Yang commented on HDFS-12098: Please hold on looking at the test patch, it still has some

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Status: In Progress (was: Patch Available) > Ozone: Datanode is unable to register with scm if scm

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Attachment: HDFS-12098-HDFS-7240.testcase.patch > Ozone: Datanode is unable to register with scm if

[jira] [Commented] (HDFS-12069) Ozone: Create a general abstraction for metadata store

[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088615#comment-16088615 ] Weiwei Yang commented on HDFS-12069: Hello [~anu] Thanks for your +1 :). Since it's being a while

[jira] [Updated] (HDFS-12069) Ozone: Create a general abstraction for metadata store

[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12069: --- Attachment: HDFS-12069-HDFS-7240.012.patch > Ozone: Create a general abstraction for metadata store >

[jira] [Commented] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091335#comment-16091335 ] Weiwei Yang commented on HDFS-12147: Hi [~nandakumar131] Thank you. But even we want to expose them

[jira] [Commented] (HDFS-12154) Incorrect javadoc description in StorageLocationChecker#check

[ https://issues.apache.org/jira/browse/HDFS-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091336#comment-16091336 ] Weiwei Yang commented on HDFS-12154: Looks good to me, +1, committing now. > Incorrect javadoc

[jira] [Commented] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090940#comment-16090940 ] Weiwei Yang commented on HDFS-12149: Ah posted last comment too quick until I see [~aw]'s comment.

[jira] [Comment Edited] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091335#comment-16091335 ] Weiwei Yang edited comment on HDFS-12147 at 7/18/17 9:26 AM: - Hi

[jira] [Updated] (HDFS-12154) Incorrect javadoc description in StorageLocationChecker#check

[ https://issues.apache.org/jira/browse/HDFS-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12154: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Comment Edited] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091091#comment-16091091 ] Weiwei Yang edited comment on HDFS-12147 at 7/18/17 4:34 AM: - Hi

[jira] [Commented] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091091#comment-16091091 ] Weiwei Yang commented on HDFS-12147: Hi [~nandakumar131], [~vagarychen] I am a bit confused with this

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091068#comment-16091068 ] Weiwei Yang commented on HDFS-12115: Hi [~anu] Thanks for the updates, I have comments to the v5

[jira] [Commented] (HDFS-11996) Ozone : add an UT to test partial read of chunks

[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091079#comment-16091079 ] Weiwei Yang commented on HDFS-11996: Just committed to the feature branch, thanks [~vagarychen] for

[jira] [Updated] (HDFS-11996) Ozone : add an UT to test partial read of chunks

[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11996: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11996) Ozone : add partial read of chunks

[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091073#comment-16091073 ] Weiwei Yang commented on HDFS-11996: Non of the UT failures were related to this patch, I am going to

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091052#comment-16091052 ] Weiwei Yang commented on HDFS-12098: Oh [~anu], no problem at all. Thanks for your quick reply. >

[jira] [Updated] (HDFS-11996) Ozone : add an UT to test partial read of chunks

[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11996: --- Target Version/s: HDFS-7240 Priority: Minor (was: Major) Component/s: test

[jira] [Updated] (HDFS-11996) Ozone : add an UT to test partial read of chunks

[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11996: --- Summary: Ozone : add an UT to test partial read of chunks (was: Ozone : add partial read of chunks)

[jira] [Commented] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090936#comment-16090936 ] Weiwei Yang commented on HDFS-12149: Thanks [~anu], sounds good to me. Since it seems no regression is

[jira] [Commented] (HDFS-12154) Incorrect javadoc description in StorageLocationChecker#check

[ https://issues.apache.org/jira/browse/HDFS-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090945#comment-16090945 ] Weiwei Yang commented on HDFS-12154: +1, pending on jenkins. Thanks [~nandakumar131] to fix this. >

[jira] [Commented] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090926#comment-16090926 ] Weiwei Yang commented on HDFS-12149: Hi [~anu] There was a rocksdb build few hours ago 5.5.3 but it

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091004#comment-16091004 ] Weiwei Yang commented on HDFS-12098: Hi [~anu] Have you tried to reproduce this issue or apply the

[jira] [Comment Edited] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091383#comment-16091383 ] Weiwei Yang edited comment on HDFS-12126 at 7/18/17 10:25 AM: -- Thanks

[jira] [Commented] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091358#comment-16091358 ] Weiwei Yang commented on HDFS-12147: Hi [~nandakumar131] Please hold on submitting a new patch, lets

[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091383#comment-16091383 ] Weiwei Yang commented on HDFS-12126: Thanks [~linyiqun] for working on this, this is very much needed.

[jira] [Created] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

Weiwei Yang created HDFS-12098: -- Summary: Ozone: Datanode is unable to register with scm if scm starts later Key: HDFS-12098 URL: https://issues.apache.org/jira/browse/HDFS-12098 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078213#comment-16078213 ] Weiwei Yang commented on HDFS-12098: This is because datanode state machine leaks

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Attachment: thread_dump.log > Ozone: Datanode is unable to register with scm if scm starts later >

[jira] [Comment Edited] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078213#comment-16078213 ] Weiwei Yang edited comment on HDFS-12098 at 7/7/17 3:11 PM: This is because

[jira] [Comment Edited] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078213#comment-16078213 ] Weiwei Yang edited comment on HDFS-12098 at 7/7/17 3:15 PM: This is because

[jira] [Commented] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089218#comment-16089218 ] Weiwei Yang commented on HDFS-12149: Thanks [~anu] for the message, I will work on this. bq. I am

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Attachment: HDFS-12098-HDFS-7240.testcase.patch > Ozone: Datanode is unable to register with scm if

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089283#comment-16089283 ] Weiwei Yang commented on HDFS-12098: Attached a test case patch to reproduce this issue. Please take a

[jira] [Comment Edited] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089283#comment-16089283 ] Weiwei Yang edited comment on HDFS-12098 at 7/17/17 4:01 AM: - Attached a test

[jira] [Comment Edited] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089283#comment-16089283 ] Weiwei Yang edited comment on HDFS-12098 at 7/17/17 3:59 AM: - Attached a test

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Attachment: (was: HDFS-12098-HDFS-7240.testcase.patch) > Ozone: Datanode is unable to register

[jira] [Comment Edited] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089283#comment-16089283 ] Weiwei Yang edited comment on HDFS-12098 at 7/17/17 3:58 AM: - Attached a test

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Status: Patch Available (was: In Progress) > Ozone: Datanode is unable to register with scm if scm

[jira] [Updated] (HDFS-12069) Ozone: Create a general abstraction for metadata store

[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12069: --- Attachment: HDFS-12069-HDFS-7240.013.patch > Ozone: Create a general abstraction for metadata store >

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088651#comment-16088651 ] Weiwei Yang commented on HDFS-12145: Hi [~msingh] Thanks for working on this, the patch overall looks

[jira] [Updated] (HDFS-12148) Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties

[ https://issues.apache.org/jira/browse/HDFS-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12148: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094349#comment-16094349 ] Weiwei Yang commented on HDFS-12149: Hi [~yuanbo] Thanks for helping to review this. I have fixed the

[jira] [Updated] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12149: --- Attachment: HDFS-12149-HDFS-7240.003.patch > Ozone: RocksDB implementation of ozone metadata store >

[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey

[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094728#comment-16094728 ] Weiwei Yang commented on HDFS-12167: See error message {noformat} Error Message Unable to find the

[jira] [Created] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey

Weiwei Yang created HDFS-12167: -- Summary: Ozone: Intermittent failure TestContainerPersistence#testListKey Key: HDFS-12167 URL: https://issues.apache.org/jira/browse/HDFS-12167 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey

[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12167: --- Release Note: (was: TestContainerPersistence#listKeys seems to fail intermittently. It looks like

[jira] [Updated] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey

[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12167: --- Description: TestContainerPersistence#listKeys seems to fail intermittently. It looks like it was

[jira] [Commented] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094739#comment-16094739 ] Weiwei Yang commented on HDFS-12149: The UT failure seems not related, I have opened HDFS-12167 to

[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092633#comment-16092633 ] Weiwei Yang commented on HDFS-12126: +1, I will commit this soon. Thanks [~linyiqun]! > Ozone: Ozone

[jira] [Updated] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12126: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092639#comment-16092639 ] Weiwei Yang commented on HDFS-12126: Just committed to the feature branch, thanks [~linyiqun] for the

[jira] [Assigned] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11984: -- Assignee: Weiwei Yang > Ozone: Ensures listKey lists all required key fields >

[jira] [Commented] (HDFS-12127) Ozone: Ozone shell: Add more testing for key shell commands

[ https://issues.apache.org/jira/browse/HDFS-12127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094774#comment-16094774 ] Weiwei Yang commented on HDFS-12127: Hi [~linyiqun] Thanks a lot to add the test case and fix those

[jira] [Assigned] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11922: -- Assignee: Weiwei Yang > Ozone: KSM: Garbage collect deleted blocks >

[jira] [Assigned] (HDFS-12176) dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

[ https://issues.apache.org/jira/browse/HDFS-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-12176: -- Assignee: Weiwei Yang > dfsadmin shows DFS Used%: NaN% if the cluster has zero block. >

[jira] [Commented] (HDFS-12176) dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

[ https://issues.apache.org/jira/browse/HDFS-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095698#comment-16095698 ] Weiwei Yang commented on HDFS-12176: Hi [~jojochuang] I did a quick check. NaN was from

[jira] [Updated] (HDFS-12176) dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

[ https://issues.apache.org/jira/browse/HDFS-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12176: --- Attachment: HDFS-12176.001.patch > dfsadmin shows DFS Used%: NaN% if the cluster has zero block. >

[jira] [Updated] (HDFS-12176) dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

[ https://issues.apache.org/jira/browse/HDFS-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12176: --- Status: Patch Available (was: Open) > dfsadmin shows DFS Used%: NaN% if the cluster has zero block.

[jira] [Commented] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

[ https://issues.apache.org/jira/browse/HDFS-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095702#comment-16095702 ] Weiwei Yang commented on HDFS-12149: Thanks [~anu] ! > Ozone: RocksDB implementation of ozone

[jira] [Commented] (HDFS-12071) Ozone: Corona: Implementation of Corona

[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095703#comment-16095703 ] Weiwei Yang commented on HDFS-12071: Nice work guys, any document how to run corona? I would like to

[jira] [Created] (HDFS-12149) Ozone: RocksDB implementation of ozone metadata store

Weiwei Yang created HDFS-12149: -- Summary: Ozone: RocksDB implementation of ozone metadata store Key: HDFS-12149 URL: https://issues.apache.org/jira/browse/HDFS-12149 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12148) Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties

[ https://issues.apache.org/jira/browse/HDFS-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088774#comment-16088774 ] Weiwei Yang commented on HDFS-12148: +[~anu] I have added missing properties to ozone-default.xml.

[jira] [Updated] (HDFS-12148) Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties

[ https://issues.apache.org/jira/browse/HDFS-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12148: --- Status: Patch Available (was: Open) > Ozone: TestOzoneConfigurationFields is failing because

[jira] [Updated] (HDFS-12148) Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties

[ https://issues.apache.org/jira/browse/HDFS-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12148: --- Attachment: HDFS-12148-HDFS-7240.001.patch > Ozone: TestOzoneConfigurationFields is failing because

[jira] [Updated] (HDFS-12069) Ozone: Create a general abstraction for metadata store

[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12069: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12069) Ozone: Create a general abstraction for metadata store

[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088767#comment-16088767 ] Weiwei Yang commented on HDFS-12069: UT failures are not related. I have test locally

[jira] [Created] (HDFS-12148) Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties

Weiwei Yang created HDFS-12148: -- Summary: Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties Key: HDFS-12148 URL: https://issues.apache.org/jira/browse/HDFS-12148

[jira] [Updated] (HDFS-12071) Ozone: Corona: Implementation of Corona

[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12071: --- Fix Version/s: HDFS-7240 > Ozone: Corona: Implementation of Corona >

[jira] [Commented] (HDFS-12127) Ozone: Ozone shell: Add more testing for key shell commands

[ https://issues.apache.org/jira/browse/HDFS-12127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095959#comment-16095959 ] Weiwei Yang commented on HDFS-12127: Hmm, there seems a lot more UT are failing, I can't tell if they

[jira] [Updated] (HDFS-11936) Ozone: TestNodeManager times out before it is able to find all nodes

[ https://issues.apache.org/jira/browse/HDFS-11936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11936: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095915#comment-16095915 ] Weiwei Yang commented on HDFS-12115: Hi [~anu] UT failure

[jira] [Updated] (HDFS-12071) Ozone: Corona: Implementation of Corona

[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12071: --- Labels: tool (was: ) > Ozone: Corona: Implementation of Corona >

[jira] [Commented] (HDFS-11936) Ozone: TestNodeManager times out before it is able to find all nodes

[ https://issues.apache.org/jira/browse/HDFS-11936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095908#comment-16095908 ] Weiwei Yang commented on HDFS-11936: Makes sense to me, 100ms HB interval here creates race condition,

[jira] [Updated] (HDFS-12127) Ozone: Ozone shell: Add more testing for key shell commands

[ https://issues.apache.org/jira/browse/HDFS-12127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12127: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12127) Ozone: Ozone shell: Add more testing for key shell commands

[ https://issues.apache.org/jira/browse/HDFS-12127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096190#comment-16096190 ] Weiwei Yang commented on HDFS-12127: Looks good, +1. I am going to commit this shortly. Thanks

[jira] [Commented] (HDFS-12187) Ozone : add support to DEBUG CLI for ksm.db

[ https://issues.apache.org/jira/browse/HDFS-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097045#comment-16097045 ] Weiwei Yang commented on HDFS-12187: TestKSMSQLCli.java is missing apache license header, please get

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097043#comment-16097043 ] Weiwei Yang commented on HDFS-12115: Hi [~anu] Guess you need to rebase you latest patch to latest

[jira] [Updated] (HDFS-12163) Ozone: MiniOzoneCluster uses 400+ threads

[ https://issues.apache.org/jira/browse/HDFS-12163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12163: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-7240 > Ozone: MiniOzoneCluster uses 400+

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Description: Implement a recycling service running on datanode to delete stale blocks. The recycling

[jira] [Updated] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11922: --- Attachment: Async delete keys.pdf > Ozone: KSM: Garbage collect deleted blocks >

[jira] [Commented] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099814#comment-16099814 ] Weiwei Yang commented on HDFS-11922: Hi [~anu], [~xyao] and folks on cc, I have uploaded a doc about

[jira] [Work started] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12196 started by Weiwei Yang. -- > Ozone: DeleteKey-2: Implement container recycling service to delete stale >

[jira] [Created] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

Weiwei Yang created HDFS-12195: -- Summary: Ozone: DeleteKey-1: KSM replies delete key request asynchronously Key: HDFS-12195 URL: https://issues.apache.org/jira/browse/HDFS-12195 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12195: --- Attachment: client-ksm.png > Ozone: DeleteKey-1: KSM replies delete key request asynchronously >

[jira] [Created] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

Weiwei Yang created HDFS-12196: -- Summary: Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background Key: HDFS-12196 URL: https://issues.apache.org/jira/browse/HDFS-12196

[jira] [Commented] (HDFS-12187) Ozone : add support to DEBUG CLI for ksm.db

[ https://issues.apache.org/jira/browse/HDFS-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099362#comment-16099362 ] Weiwei Yang commented on HDFS-12187: +1, I am going to commit this shortly. Thanks [~vagarychen]. >

[jira] [Updated] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12145: --- Attachment: HDFS-12145-HDFS-7240.006.patch Hi [~msingh] Apologies I might not comment clearly, I

[jira] [Commented] (HDFS-12155) Ozone : add RocksDB support to DEBUG CLI

[ https://issues.apache.org/jira/browse/HDFS-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099377#comment-16099377 ] Weiwei Yang commented on HDFS-12155: Hi [~vagarychen], I just committed HDFS-12187, could you resume

[jira] [Updated] (HDFS-12187) Ozone : add support to DEBUG CLI for ksm.db

[ https://issues.apache.org/jira/browse/HDFS-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12187: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Assigned] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11984: -- Assignee: Yiqun Lin (was: Weiwei Yang) > Ozone: Ensures listKey lists all required key fields

[jira] [Commented] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099422#comment-16099422 ] Weiwei Yang commented on HDFS-11984: Hi [~linyiqun] Thanks for working on this. You are right, we

[jira] [Updated] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11984: --- Description: HDFS-11782 implements the listKey operation which only lists the basic key fields, we

[jira] [Commented] (HDFS-11920) Ozone : add key partition

[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099438#comment-16099438 ] Weiwei Yang commented on HDFS-11920: Hi [~vagarychen] Thanks for the patch, it looks good to me

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102693#comment-16102693 ] Weiwei Yang commented on HDFS-12145: Thanks [~msingh] for confirming that, +1 to latest patch, I will

<    3   4   5   6   7   8   9   10   11   12   >