[jira] [Commented] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005536#comment-16005536 ] Chen Liang commented on HDFS-11788: --- Thanks [~anu] for the comment! The failed tests and findbug warning

[jira] [Created] (HDFS-11802) Ozone : add DEBUG CLI support for open container db file

2017-05-10 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11802: - Summary: Ozone : add DEBUG CLI support for open container db file Key: HDFS-11802 URL: https://issues.apache.org/jira/browse/HDFS-11802 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11768) Ozone: KSM: Create Key Space manager service

2017-05-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005320#comment-16005320 ] Chen Liang commented on HDFS-11768: --- I have a question about how will the access check work. Take

[jira] [Commented] (HDFS-11764) NPE when the GroupMappingServiceProvider has no group

2017-05-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005227#comment-16005227 ] Chen Liang commented on HDFS-11764: --- Hi [~runlinzhang], could you please elaborate a little bit about

[jira] [Updated] (HDFS-11802) Ozone : add DEBUG CLI support for open container db file

2017-05-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11802: -- Attachment: HDFS-11802-HDFS-7240.001.patch Post v001 patch, will make it patch available status after

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.006.patch Thanks [~arpitagarwal] for pointing out offline that,

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045096#comment-16045096 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 9:59 PM: --- Thanks

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.003.patch fixing a bug in v003 patch. > Ozone : add read/write random

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.005.patch Thanks [~andrew.wang] for the comments. Based on Andrew's comments,

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044987#comment-16044987 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 8:37 PM: --- Thanks

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.002.patch Post v002 patch to fix checkstyle warnining. > Ozone : add

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046809#comment-16046809 ] Chen Liang commented on HDFS-11907: --- Whoops... thanks [~arpitagarwal]! > Add metric for time taken by

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.007.patch Thansk [~arpitagarwal] for the catch! addressed in v007 patch. > Add

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047093#comment-16047093 ] Chen Liang commented on HDFS-11907: --- The failed test are unrelated. > Add metric for time taken by

[jira] [Commented] (HDFS-11967) TestJMXGet fails occasionally

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046854#comment-16046854 ] Chen Liang commented on HDFS-11967: --- v001 patch LGTM, thanks [~arpitagarwal] for the analysis and the

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.004.patch Had an offline discussion with [~anu], post v004 patch to

[jira] [Comment Edited] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056630#comment-16056630 ] Chen Liang edited comment on HDFS-12002 at 6/20/17 11:06 PM: - Post initial

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Status: Patch Available (was: Open) > Ozone : SCM cli misc fixes/improvements >

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Attachment: HDFS-12002-HDFS-7240.001.patch Post initial patch. Thanks [~elek] for the comments! Added

[jira] [Comment Edited] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056630#comment-16056630 ] Chen Liang edited comment on HDFS-12002 at 6/20/17 11:15 PM: - Post initial

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Description: Currently there are a few minor issues with the SCM CLI: 1. some commands do not use -c

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056668#comment-16056668 ] Chen Liang commented on HDFS-11998: --- {{TestAvailableSpaceBlockPlacementPolicy}} fail seems related,

[jira] [Commented] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056705#comment-16056705 ] Chen Liang commented on HDFS-11998: --- {{TestAvailableSpaceBlockPlacementPolicy}} fails because

[jira] [Created] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12002: - Summary: Ozone : SCM cli misc fixes/improvements Key: HDFS-12002 URL: https://issues.apache.org/jira/browse/HDFS-12002 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056453#comment-16056453 ] Chen Liang commented on HDFS-11679: --- Thanks [~yuanbo] for working on this, v003 patch looks pretty good

[jira] [Updated] (HDFS-12002) Ozone : SCM cli misc fixes/improvements

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12002: -- Description: Currently there are a few minor issues with the SCM CLI: 1. some commands do not use -c

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Status: Patch Available (was: Open) > Enable DFSNetworkTopology as default >

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Attachment: HDFS-11998.001.patch Post initial patch to set the config value to true by default. >

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11580: -- Attachment: (was: HDFS-11580-HDFS-7240.008.patch) > Ozone: Support asynchronus client API for SCM

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058466#comment-16058466 ] Chen Liang commented on HDFS-11580: --- To [~linyiqun] and anyone reviewing this. There are several places

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11580: -- Attachment: HDFS-11580-HDFS-7240.008.patch I looked deeper into v007 patch, looks pretty good to me

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11580: -- Attachment: HDFS-11580-HDFS-7240.008.patch > Ozone: Support asynchronus client API for SCM and

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11998: -- Attachment: HDFS-11998.002.patch Thanks [~linyiqun] for the catch! updated in v002 patch which also

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16059747#comment-16059747 ] Chen Liang commented on HDFS-12008: --- Hi [~kihwal] seem the

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060053#comment-16060053 ] Chen Liang commented on HDFS-12008: --- thanks [~kihwal] for the illustration! > Improve the

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060005#comment-16060005 ] Chen Liang commented on HDFS-12008: --- Jenkins reports a strange "null" in assertion error, and when I try

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061597#comment-16061597 ] Chen Liang commented on HDFS-12028: --- Thanks [~xyao] for filing this! I did some initial investigation by

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Status: Patch Available (was: Open) > Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml >

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.001.patch Post initial patch, also removed a few unused keys in

[jira] [Commented] (HDFS-11993) Add log info when connect to datanode socket address failed

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061279#comment-16061279 ] Chen Liang commented on HDFS-11993: --- Thanks [~candychencan] for the patch. Since this seems to be slf4j

[jira] [Assigned] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-12018: - Assignee: Chen Liang > Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml >

[jira] [Updated] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12028: -- Attachment: HDFS-12028-HDFS-7240.001.patch Post v001 patch. > Ozone: CLI: remove noisy slf4j binding

[jira] [Assigned] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-12028: - Assignee: Chen Liang > Ozone: CLI: remove noisy slf4j binding output from hdfs oz command. >

[jira] [Updated] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12028: -- Status: Patch Available (was: Open) > Ozone: CLI: remove noisy slf4j binding output from hdfs oz

[jira] [Created] (HDFS-12041) Block Storage : make the server address config more concise

2017-06-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12041: - Summary: Block Storage : make the server address config more concise Key: HDFS-12041 URL: https://issues.apache.org/jira/browse/HDFS-12041 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.002.patch Thanks [~xyao] for the comments! Post v002 patch. The last

[jira] [Updated] (HDFS-12018) Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12018: -- Attachment: HDFS-12018-HDFS-7240.003.patch Post v003 patch to rebase. > Ozone: Misc: Add CBlocks

[jira] [Commented] (HDFS-12028) Ozone: CLI: remove noisy slf4j binding output from hdfs oz command.

2017-06-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063457#comment-16063457 ] Chen Liang commented on HDFS-12028: --- Thanks [~xyao] for the comments. [~cheersyang] it seems to have

[jira] [Created] (HDFS-12043) Add counters for block re-replication

2017-06-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12043: - Summary: Add counters for block re-replication Key: HDFS-12043 URL: https://issues.apache.org/jira/browse/HDFS-12043 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11996: - Summary: Ozone : add partial read of chunks Key: HDFS-11996 URL: https://issues.apache.org/jira/browse/HDFS-11996 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054713#comment-16054713 ] Chen Liang commented on HDFS-11963: --- Thanks [~anu] for the update, v005 patch LGTM. > Ozone:

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054494#comment-16054494 ] Chen Liang commented on HDFS-11992: --- Thanks [~xiaodong.hu] for the contribution! v001 patch LGTM. >

[jira] [Created] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11997: - Summary: ChunkManager functions do not use the argument keyName Key: HDFS-11997 URL: https://issues.apache.org/jira/browse/HDFS-11997 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054779#comment-16054779 ] Chen Liang commented on HDFS-11997: --- I think from the perspective of abstraction, {{ChunkManager}}

[jira] [Created] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11998: - Summary: Enable DFSNetworkTopology as default Key: HDFS-11998 URL: https://issues.apache.org/jira/browse/HDFS-11998 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11996: -- Status: Patch Available (was: Open) > Ozone : add partial read of chunks >

[jira] [Updated] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11996: -- Attachment: HDFS-11996-HDFS-7240.001.patch Turns out it is already possible to do partial read of a

[jira] [Commented] (HDFS-11775) Ozone: KSM : add createBucket

2017-05-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016111#comment-16016111 ] Chen Liang commented on HDFS-11775: --- Thanks [~nandakumar131] for updating the patch! v007 patch LGTM, +1

[jira] [Commented] (HDFS-11835) Block Storage: Overwrite of blocks fails

2017-05-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016140#comment-16016140 ] Chen Liang commented on HDFS-11835: --- Thanks [~msingh] for the patch! The changes LGTM, but the failed

[jira] [Updated] (HDFS-11850) Ozone: Stack Overflow in XceiverClientManager because of race condition in accessing openClient

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11850: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to the feature branch. >

[jira] [Commented] (HDFS-11850) Ozone: Stack Overflow in XceiverClientManager because of race condition in accessing openClient

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019839#comment-16019839 ] Chen Liang commented on HDFS-11850: --- Thanks [~msingh] for working on this! v001 patch LGTM, will commit

[jira] [Updated] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11535: -- Attachment: HDFS-11535.004.patch Thanks [~arpitagarwal] for the comments! Post v004 patch with a number

[jira] [Commented] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019827#comment-16019827 ] Chen Liang commented on HDFS-11860: --- Thanks [~xyao] for the debugging and the fix! v001 patch LGTM with

[jira] [Commented] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021468#comment-16021468 ] Chen Liang commented on HDFS-11859: --- Thanks [~xyao] for updating the patch! +1 on v007 patch. > Ozone

[jira] [Commented] (HDFS-11727) Block Storage: Retry Blocks should be requeued when cblock is restarted

2017-05-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021542#comment-16021542 ] Chen Liang commented on HDFS-11727: --- v002 patch looks pretty good to me, will commit this shortly. This

[jira] [Created] (HDFS-11872) Ozone : implement StorageContainerManager#getStorageContainerLocations

2017-05-23 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11872: - Summary: Ozone : implement StorageContainerManager#getStorageContainerLocations Key: HDFS-11872 URL: https://issues.apache.org/jira/browse/HDFS-11872 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Status: Patch Available (was: In Progress) > Ozone: KSM : Add putKey > --- > >

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.002.patch I'm taking back the statement that this requires HDFS-11872

[jira] [Work started] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11780 started by Chen Liang. - > Ozone: KSM : Add putKey > --- > > Key:

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.001.patch Attach initial patch. Please note that the test is

[jira] [Resolved] (HDFS-11872) Ozone : implement StorageContainerManager#getStorageContainerLocations

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-11872. --- Resolution: Won't Fix I misread {{getStorageContainerLocations}} as the lookup of container given

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.002.patch > Ozone: KSM : Add putKey > --- > >

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: (was: HDFS-11780-HDFS-7240.002.patch) > Ozone: KSM : Add putKey >

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Status: Open (was: Patch Available) > Ozone: KSM : Add putKey > --- > >

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Status: Patch Available (was: Open) > Ozone: KSM : Add putKey > --- > >

[jira] [Commented] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026534#comment-16026534 ] Chen Liang commented on HDFS-11886: --- Thanks [~anu] for looking at this! No decision has been made at all

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.002.patch The failed test {{TestKeySpaceManager}} is related, fixed in

[jira] [Created] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11891: - Summary: DU#refresh should print the path of the directory when an exception is caught Key: HDFS-11891 URL: https://issues.apache.org/jira/browse/HDFS-11891 Project:

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.001.patch Post initial v001 patch. This patch also includes a number

[jira] [Updated] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11891: -- Status: Patch Available (was: Open) > DU#refresh should print the path of the directory when an

[jira] [Updated] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11891: -- Attachment: HDFS-11891.001.patch > DU#refresh should print the path of the directory when an exception

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Status: Patch Available (was: Open) > Ozone: KSM: Add getKey > --- > >

[jira] [Comment Edited] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027049#comment-16027049 ] Chen Liang edited comment on HDFS-11853 at 5/27/17 12:19 AM: - Thanks [~xyao]

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.003.patch Thanks [~xyao] for the comments! all addressed in v003

[jira] [Updated] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11886: -- Summary: Ozone : improve error handling for putkey operation (was: Ozone : improving error handling

[jira] [Updated] (HDFS-11886) Ozone : improving error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11886: -- Description: Ozone's putKey operations involve a couple steps: 1. KSM calls allocateBlock to SCM,

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.008.patch Thanks [~xyao] for the comments! post v008 patch. Also filed

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.007.patch Earlier patches were passing the wrong first argument to

[jira] [Created] (HDFS-11886) Ozone : improving error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11886: - Summary: Ozone : improving error handling for putkey operation Key: HDFS-11886 URL: https://issues.apache.org/jira/browse/HDFS-11886 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11822) Block Storage: Fix TestCBlockCLI, failing because of " Address already in use"

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023901#comment-16023901 ] Chen Liang commented on HDFS-11822: --- Thanks [~msingh] for the patch! One question though: looks like

[jira] [Updated] (HDFS-11780) Ozone: KSM : Add putKey

2017-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11780: -- Attachment: HDFS-11780-HDFS-7240.004.patch Thanks [~xyao] for the comments as well as the offline

[jira] [Updated] (HDFS-11832) Switch leftover logs to slf4j format in BlockManager.java

2017-05-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11832: -- Attachment: HDFS-11832.004.patch Thanks [~10075197] for the patches! and thanks [~ajisakaa] for the

[jira] [Commented] (HDFS-11832) Switch leftover logs to slf4j format in BlockManager.java

2017-05-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017734#comment-16017734 ] Chen Liang commented on HDFS-11832: --- Seems our comments interleaved, did not see your comments when I

[jira] [Commented] (HDFS-11835) Block Storage: Overwrite of blocks fails

2017-05-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017705#comment-16017705 ] Chen Liang commented on HDFS-11835: --- I have committed this to the feature branch, thanks [~msingh] for

[jira] [Updated] (HDFS-11835) Block Storage: Overwrite of blocks fails

2017-05-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11835: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Block Storage: Overwrite of blocks

[jira] [Commented] (HDFS-11832) Switch leftover logs to slf4j format in BlockManager.java

2017-05-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017724#comment-16017724 ] Chen Liang commented on HDFS-11832: --- Thanks [~10075197] for the followup. But just similar to

[jira] [Commented] (HDFS-11803) Add -v option for du command to show header line

2017-05-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018015#comment-16018015 ] Chen Liang commented on HDFS-11803: --- thanks [~xiaobingo] for v002 patch! LGTM, +1 > Add -v option for

[jira] [Updated] (HDFS-11857) Ozone : need to refactor StorageContainerLocationProtocolServerSideTranslatorPB

2017-05-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11857: -- Attachment: HDFS-11857-HDFS-7240.001.patch > Ozone : need to refactor >

[jira] [Created] (HDFS-11857) Ozone : need to refactor StorageContainerLocationProtocolServerSideTranslatorPB

2017-05-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11857: - Summary: Ozone : need to refactor StorageContainerLocationProtocolServerSideTranslatorPB Key: HDFS-11857 URL: https://issues.apache.org/jira/browse/HDFS-11857 Project:

[jira] [Updated] (HDFS-11857) Ozone : need to refactor StorageContainerLocationProtocolServerSideTranslatorPB

2017-05-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11857: -- Status: Patch Available (was: Open) > Ozone : need to refactor >

<    3   4   5   6   7   8   9   10   11   12   >