[jira] [Updated] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12352: -- Status: Patch Available (was: Open) > [branch-2] Use HDFS specific network topology to choose datanode

[jira] [Comment Edited] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140834#comment-16140834 ] Chen Liang edited comment on HDFS-12352 at 8/24/17 10:15 PM: - I manually fixed

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.009.patch Thanks [~anu] for the comments, addressed in v009 patch.

[jira] [Created] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-21 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12334: - Summary: [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom Key: HDFS-12334 URL: https://issues.apache.org/jira/browse/HDFS-12334 Project: Hadoop

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.005.patch Thanks [~anu] for the review and the comments! Post v005

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.004.patch Fix the javac warning in v004 patch. > Ozone : debug cli:

[jira] [Updated] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12334: -- Status: Patch Available (was: Open) > [branch-2] Add storage type demand to into

[jira] [Updated] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12334: -- Attachment: HDFS-12334-branch-2.001.patch > [branch-2] Add storage type demand to into

[jira] [Commented] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144093#comment-16144093 ] Chen Liang commented on HDFS-12365: --- Thanks [~cheersyang] for the catch! The v001 patch LGTM, I've

[jira] [Updated] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12365: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: ListVolume displays

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144144#comment-16144144 ] Chen Liang commented on HDFS-12321: --- The failed tests all passed in my local run. {{TestSQLQuery}} seems

[jira] [Updated] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12368: -- Attachment: HDFS-12368-branch-2.001.patch > [branch-2] Enable DFSNetworkTopology as default >

[jira] [Updated] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12368: -- Status: Patch Available (was: Open) > [branch-2] Enable DFSNetworkTopology as default >

[jira] [Created] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12368: - Summary: [branch-2] Enable DFSNetworkTopology as default Key: HDFS-12368 URL: https://issues.apache.org/jira/browse/HDFS-12368 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139316#comment-16139316 ] Chen Liang edited comment on HDFS-12321 at 8/23/17 11:18 PM: - Thanks Anu for

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139316#comment-16139316 ] Chen Liang commented on HDFS-12321: --- Thanks Anu for the patch, I thought about some of these changes

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139451#comment-16139451 ] Chen Liang commented on HDFS-12321: --- bq. Now we need to add these two as two options of the command.

[jira] [Updated] (HDFS-12346) [branch-2] Combine the old and the new chooseRandom for better performance

2017-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12346: -- Attachment: HDFS-12346-branch-2.001.patch v001 patch was cleanly cherry-picked from trunk. >

[jira] [Updated] (HDFS-12346) [branch-2] Combine the old and the new chooseRandom for better performance

2017-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12346: -- Status: Patch Available (was: Open) > [branch-2] Combine the old and the new chooseRandom for better

[jira] [Commented] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138883#comment-16138883 ] Chen Liang commented on HDFS-12334: --- The failed tests are unrelated. [~arpitagarwal] could you please

[jira] [Created] (HDFS-12346) [branch-2] Combine the old and the new chooseRandom for better performance

2017-08-23 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12346: - Summary: [branch-2] Combine the old and the new chooseRandom for better performance Key: HDFS-12346 URL: https://issues.apache.org/jira/browse/HDFS-12346 Project: Hadoop

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.010.patch Fix checkstyle and findbugs in v010 patch > Ozone : debug

[jira] [Commented] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135483#comment-16135483 ] Chen Liang commented on HDFS-12332: --- Thanks [~xzhao9] for the improvement. One thought, "Updating max

[jira] [Commented] (HDFS-12315) Use Path instead of String in the TestHdfsAdmin.verifyOpenFiles()

2017-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16130909#comment-16130909 ] Chen Liang commented on HDFS-12315: --- Thanks [~olegd] for the catch! v001 patch LGTM. > Use Path instead

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16130945#comment-16130945 ] Chen Liang commented on HDFS-12292: --- Thanks [~erofeev] for the patch! Curious though, is it possible to

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.003.patch Fix the various Jenkins warnings in v003 patch. > Ozone :

[jira] [Commented] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135670#comment-16135670 ] Chen Liang commented on HDFS-12325: --- Thanks [~elgoiri] for the review, this is good point! But just

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151296#comment-16151296 ] Chen Liang commented on HDFS-12235: --- Thanks [~yuanbo] for the patch, looks good to me overall, some

[jira] [Updated] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11921: -- Attachment: HDFS-11921-HDFS-7240.001.patch Right now, the behaviour is that if a length of 0 is given,

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149612#comment-16149612 ] Chen Liang commented on HDFS-12268: --- Thanks [~linyiqun] for the patch. v004 patch looks good to me

[jira] [Commented] (HDFS-12572) Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs

2017-10-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197680#comment-16197680 ] Chen Liang commented on HDFS-12572: --- Thanks [~msingh] for the update. v005 patch LGTM, pending Jenkins.

[jira] [Updated] (HDFS-12546) Ozone: DB listing operation performance improvement

2017-10-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12546: -- Resolution: Fixed Status: Resolved (was: Patch Available) v001 patch LGTM, and the failed

[jira] [Commented] (HDFS-12543) Ozone : allow create key without specifying size

2017-10-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191806#comment-16191806 ] Chen Liang commented on HDFS-12543: --- [~xyao], working on it, will submit a patch later today. Thanks! >

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192060#comment-16192060 ] Chen Liang commented on HDFS-12582: --- Thanks [~bharatviswa] for working on this! Could you please take a

[jira] [Commented] (HDFS-12572) Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs

2017-10-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193760#comment-16193760 ] Chen Liang commented on HDFS-12572: --- Thanks [~msingh] for updating the patch! v004 patch looks good to

[jira] [Updated] (HDFS-12543) Ozone : allow create key without specifying size

2017-10-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12543: -- Attachment: HDFS-12543-HDFS-7240.010.patch Thanks [~nandakumar131] for the review and the comments!

[jira] [Updated] (HDFS-12543) Ozone : allow create key without specifying size

2017-10-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12543: -- Attachment: HDFS-12543-HDFS-7240.012.patch Update v012 patch to fix checkstyle warning. > Ozone :

[jira] [Commented] (HDFS-12558) Ozone: Clarify the meaning of rpc.metrics.percentiles.intervals on KSM/SCM web ui

2017-10-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200982#comment-16200982 ] Chen Liang commented on HDFS-12558: --- Thanks [~elek]! The patch LGTM, could you please just re-submit the

[jira] [Commented] (HDFS-12585) Add description for config in Ozone config UI

2017-10-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200977#comment-16200977 ] Chen Liang commented on HDFS-12585: --- Thanks [~ajayydv] for working on this! Just one comment: In

[jira] [Commented] (HDFS-12504) Ozone: Improve SQLCLI performance

2017-10-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201118#comment-16201118 ] Chen Liang commented on HDFS-12504: --- Thanks [~yuanbo] for working on this! v001 patch looks pretty good

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.001.patch Post v001 patch. > Ozone : delete open key entries that

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202341#comment-16202341 ] Chen Liang commented on HDFS-12415: --- I looked in this a little bit too. What was happening seems to be

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Status: Patch Available (was: Open) > Ozone : delete open key entries that will no longer be closed >

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.002.patch 002 patch to rebase. > Ozone : delete open key entries that

[jira] [Commented] (HDFS-12632) Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202460#comment-16202460 ] Chen Liang commented on HDFS-12632: --- Thanks [~msingh] for adding the tests. +1 > Ozone:

[jira] [Updated] (HDFS-12632) Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12632: -- Resolution: Fixed Status: Resolved (was: Patch Available) The failed tests are unrelated. I've

[jira] [Commented] (HDFS-12585) Add description for config in Ozone config UI

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202608#comment-16202608 ] Chen Liang commented on HDFS-12585: --- Thanks [~ajayydv] for the clarification. Then I think maybe it's

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.003.patch fix asf license header missing in v003 patch. failed tests

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.004.patch Somehow Jenkins ran on v002 patch again, resubmit v003 patch

[jira] [Commented] (HDFS-12804) Use slf4j instead of log4j in FSEditLog

2017-11-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252875#comment-16252875 ] Chen Liang commented on HDFS-12804: --- Thanks for working on this [~msingh]! The patch LGTM, just one

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-11-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.007.patch update v007 patch. rewrote many places as lots of code has

[jira] [Commented] (HDFS-12877) Add open(PathHandle) with default buffersize

2017-11-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273190#comment-16273190 ] Chen Liang commented on HDFS-12877: --- The changes looks to me, but the failed tests seem related. Could

[jira] [Commented] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests

2017-11-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273354#comment-16273354 ] Chen Liang commented on HDFS-12838: --- Thanks for working on this [~msingh]! I think this is a very good

[jira] [Updated] (HDFS-12879) Ozone : add scm init command to document.

2017-11-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12879: -- Labels: newbie (was: ) > Ozone : add scm init command to document. >

[jira] [Updated] (HDFS-12879) Ozone : add scm init command to document.

2017-11-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12879: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-7240 > Ozone : add scm init command to

[jira] [Commented] (HDFS-12879) Ozone : add scm init command to document.

2017-11-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273609#comment-16273609 ] Chen Liang commented on HDFS-12879: --- There is another typo in {{OzoneCommandShell.md}}, which I think

[jira] [Commented] (HDFS-12877) Add open(PathHandle) with default buffersize

2017-11-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273618#comment-16273618 ] Chen Liang commented on HDFS-12877: --- Thanks [~chris.douglas] for the quick update! Makes sense to me. +1

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-11-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269775#comment-16269775 ] Chen Liang commented on HDFS-12799: --- Thanks [~elek] for the update! Looks like v002 patch needs to be

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274836#comment-16274836 ] Chen Liang commented on HDFS-12799: --- Thanks [~elek] for the update! Could you please fix the checkstyle

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Attachment: HDFS-12925-HDFS-7240.004.patch Latest Jenkins build failed again, resubmit v003 patch as

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Attachment: HDFS-12925-HDFS-7240.001.patch Post v001 patch. > Ozone: Container : Add key versioning

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Status: Patch Available (was: Open) > Ozone: Container : Add key versioning support-2 >

[jira] [Commented] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288193#comment-16288193 ] Chen Liang commented on HDFS-12751: --- Thanks [~nandakumar131] for the clarification! I totally missed

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.011.patch Fix the checkstyle warning. The javadoc and the asf license

[jira] [Updated] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12751: -- Attachment: HDFS-12751-HDFS-7240.001.patch Post v001 patch. > Ozone: SCM: update container allocated

[jira] [Updated] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12751: -- Status: Patch Available (was: In Progress) > Ozone: SCM: update container allocated size to container

[jira] [Commented] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288500#comment-16288500 ] Chen Liang commented on HDFS-12000: --- Thansk [~xyao] for checking the tests! I ran locally the tests you

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.006.patch Thanks [~xyao] for the review! Post v006 patch to fix the

[jira] [Created] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12925: - Summary: Ozone: Container : Add key versioning support-2 Key: HDFS-12925 URL: https://issues.apache.org/jira/browse/HDFS-12925 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12881: -- Fix Version/s: (was: 3.0.1) > Output streams closed with IOUtils suppressing write errors >

[jira] [Updated] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12881: -- Fix Version/s: 3.0.1 > Output streams closed with IOUtils suppressing write errors >

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Attachment: HDFS-12925-HDFS-7240.002.patch The output link from Jenkins seem dead, not sure why the

[jira] [Commented] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16291742#comment-16291742 ] Chen Liang commented on HDFS-12917: --- Thanks [~candychencan] for the catch, just one NIT, "which have

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Description: One component for versioning is assembling read IO vector, (please see 4.2 section of the

[jira] [Commented] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295772#comment-16295772 ] Chen Liang commented on HDFS-12932: --- Thanks [~csun] for the catch! I think maybe it's better to add a

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Attachment: HDFS-12925-HDFS-7240.003.patch v003 patch fixes the checkstyle and javadoc issue, findbug

[jira] [Assigned] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-12917: - Assignee: chencan > Fix description errors in testErasureCodingConf.xml >

[jira] [Commented] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293301#comment-16293301 ] Chen Liang commented on HDFS-12917: --- Thanks [~candychencan] for the updated patch! +1 on v002 patch,

[jira] [Updated] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12917: -- Resolution: Fixed Target Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293035#comment-16293035 ] Chen Liang commented on HDFS-12799: --- Thanks [~elek] for the update! Looks like there were compilation

[jira] [Comment Edited] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293273#comment-16293273 ] Chen Liang edited comment on HDFS-12925 at 12/15/17 9:31 PM: - v003 patch fixes

[jira] [Updated] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12751: -- Attachment: HDFS-12751-HDFS-7240.002.patch Fix checkstyle, the failed tests are unrelated, and passed

[jira] [Updated] (HDFS-12265) Ozone : better handling of operation fail due to chill mode

2017-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12265: -- Release Note: (was: Looks like this has been handled as part of HDFS-12387, close this JIRA.) >

[jira] [Resolved] (HDFS-12265) Ozone : better handling of operation fail due to chill mode

2017-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-12265. --- Resolution: Fixed Release Note: Looks like this has been handled as part of HDFS-12387, close

[jira] [Commented] (HDFS-12265) Ozone : better handling of operation fail due to chill mode

2017-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289691#comment-16289691 ] Chen Liang commented on HDFS-12265: --- Looks like this has been handled as part of HDFS-12387, close this

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.012.patch v012 patch to rebase. > Ozone: Container : Add key

[jira] [Comment Edited] (HDFS-12940) Ozone: KSM: TestKeySpaceManager#testExpiredOpenKey fails occasionally

2017-12-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297507#comment-16297507 ] Chen Liang edited comment on HDFS-12940 at 12/19/17 10:06 PM: -- Thanks

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297297#comment-16297297 ] Chen Liang commented on HDFS-12799: --- Committed to the feature branch, thanks [~elek] for the

[jira] [Updated] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12799: -- Resolution: Fixed Fix Version/s: ozone Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297290#comment-16297290 ] Chen Liang commented on HDFS-12799: --- Thanks [~elek] for the update! +1 on v005 patch, the failed tests

[jira] [Commented] (HDFS-12940) Ozone: KSM: TestKeySpaceManager#testExpiredOpenKey fails occasionally

2017-12-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297507#comment-16297507 ] Chen Liang commented on HDFS-12940: --- Thanks [~nandakumar131] for the catch! But when I ran test locally,

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-11-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259729#comment-16259729 ] Chen Liang commented on HDFS-12799: --- Thanks for working on this [~elek]. Returning current state does

[jira] [Commented] (HDFS-12826) Document Saying the RPC port, But it's required IPC port in Balancer Document.

2017-11-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259763#comment-16259763 ] Chen Liang commented on HDFS-12826: --- Thanks [~peruguusha] for the patch! Would it be a bit more precise

[jira] [Updated] (HDFS-12804) Use slf4j instead of log4j in FSEditLog

2017-11-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12804: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Use slf4j instead of log4j in

[jira] [Commented] (HDFS-12804) Use slf4j instead of log4j in FSEditLog

2017-11-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259818#comment-16259818 ] Chen Liang commented on HDFS-12804: --- Thanks [~msingh] for the update, I tested locally also,

[jira] [Updated] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12791: -- Fix Version/s: 3.1.0 > NameNode Fsck http Connection can timeout for directories with multiple levels >

[jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261474#comment-16261474 ] Chen Liang commented on HDFS-12791: --- [~zhz] Sorry I should have updated it. I believe it should be

[jira] [Commented] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-11-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241538#comment-16241538 ] Chen Liang commented on HDFS-11419: --- Hi [~cheersyang], Thanks for sharing and sorry for the delay on

[jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246944#comment-16246944 ] Chen Liang commented on HDFS-12791: --- Thanks for working on this [~msingh]! +1 on v001 patch, the failed

[jira] [Updated] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12791: -- Resolution: Fixed Status: Resolved (was: Patch Available) > NameNode Fsck http Connection can

<    6   7   8   9   10   11   12   13   14   15   >