[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144784#comment-16144784 ] Hadoop QA commented on HDFS-12354: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144762#comment-16144762 ] Yongjun Zhang commented on HDFS-12191: -- Uploaded rev5 to correct the config name in javadoc of the

[jira] [Updated] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12191: - Attachment: HDFS-12191.005.patch > Provide option to not capture the accessTime change of a file

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144748#comment-16144748 ] Yongjun Zhang commented on HDFS-12191: -- Thanks [~manojg]. {quote} There are quite a few thread sleep

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: HDFS-12354-HDFS-7240.002.patch > Ozone: Shuffle container list for datanode

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: (was: HDFS-12354-HDFS-7240.002.patch) > Ozone: Shuffle container list for datanode

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Attachment: HDFS-12369.01.patch After further looking I think the different exception is due to block

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Status: Patch Available (was: Open) > Edit log corruption due to hard lease recovery of not-closed file

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: HDFS-12354-HDFS-7240.002.patch > Ozone: Shuffle container list for datanode

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144688#comment-16144688 ] Yiqun Lin commented on HDFS-12354: -- Thanks for the review, [~cheersyang]! bq. Can we just maintain prefix

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144651#comment-16144651 ] Weiwei Yang commented on HDFS-12235: Hi [~yuanbo] Thanks for uploading your patch, I will review it

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144642#comment-16144642 ] Hadoop QA commented on HDFS-12363: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144641#comment-16144641 ] Weiwei Yang commented on HDFS-12367: Hi [~msingh] Thanks for picking this up, are you able to

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144634#comment-16144634 ] Weiwei Yang commented on HDFS-12354: Hi [~linyiqun] Thanks for posting the first patch, it looks very

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144632#comment-16144632 ] Junping Du commented on HDFS-11896: --- Thanks [~brahmareddy] for identify this not landing on

[jira] [Updated] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-08-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11896: -- Fix Version/s: (was: 2.8.3) > Non-dfsUsed will be doubled on dead node re-registration >

[jira] [Commented] (HDFS-12361) Ozone: SCM failed to start when a container metadata is empty

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144600#comment-16144600 ] Weiwei Yang commented on HDFS-12361: Thanks [~anu] for your quick response and commit :) > Ozone: SCM

[jira] [Commented] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144599#comment-16144599 ] Weiwei Yang commented on HDFS-12365: Thank you [~vagarychen] > Ozone: ListVolume displays incorrect

[jira] [Updated] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12363: - Attachment: HDFS-12363.02.patch Thanks for the review [~liuml07] and [~jojochuang]. Initially changed

[jira] [Updated] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12368: - Resolution: Duplicate Status: Resolved (was: Patch Available) +1 thanks [~vagarychen].

[jira] [Updated] (HDFS-11998) Enable DFSNetworkTopology as default

2017-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11998: - Fix Version/s: 2.9.0 Committed to branch-2 via HDFS-12368. Thanks [~vagarychen]. > Enable

[jira] [Commented] (HDFS-12293) DataNode should log file name on disk error

2017-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144534#comment-16144534 ] Hudson commented on HDFS-12293: --- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12256 (See

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Attachment: HDFS-12369.test.patch > Edit log corruption due to hard lease recovery of not-closed file >

[jira] [Comment Edited] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144529#comment-16144529 ] Xiao Chen edited comment on HDFS-12369 at 8/28/17 11:21 PM: Attaching a unit

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144529#comment-16144529 ] Xiao Chen commented on HDFS-12369: -- Attaching a unit test that sorta reproduces this - it ends up with an

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Description: HDFS-6257 and HDFS-7707 worked hard to prevent corruption from combinations of client

[jira] [Created] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12369: Summary: Edit log corruption due to hard lease recovery of not-closed file Key: HDFS-12369 URL: https://issues.apache.org/jira/browse/HDFS-12369 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12293) DataNode should log file name on disk error

2017-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12293: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (HDFS-12293) DataNode should log file name on disk error

2017-08-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144488#comment-16144488 ] Wei-Chiu Chuang commented on HDFS-12293: Thanks [~arpitagarwal] and [~ajayydv] +1 LGTM! >

[jira] [Commented] (HDFS-12293) DataNode should log file name on disk error

2017-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144481#comment-16144481 ] Arpit Agarwal commented on HDFS-12293: -- +1 for the v2 patch. [~jojochuang], does the patch look fine

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144411#comment-16144411 ] Arpit Agarwal commented on HDFS-10391: -- Calling NameNode.getServiceAddress from

[jira] [Commented] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144379#comment-16144379 ] Hadoop QA commented on HDFS-12368: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12361) Ozone: SCM failed to start when a container metadata is empty

2017-08-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12361: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12361) Ozone: SCM failed to start when a container metadata is empty

2017-08-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144286#comment-16144286 ] Anu Engineer commented on HDFS-12361: - +1, thanks for the fix. I will commit this shortly. > Ozone:

[jira] [Commented] (HDFS-12340) Ozone: C/C++ implementation of ozone client using curl

2017-08-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144258#comment-16144258 ] Anu Engineer commented on HDFS-12340: - [~shashikant] Thank you for sharing the work in progress. Some

[jira] [Commented] (HDFS-11398) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure still fails intermittently

2017-08-28 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144225#comment-16144225 ] George Huang commented on HDFS-11398: - We recently see this in house, seems related?

[jira] [Updated] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12368: -- Status: Patch Available (was: Open) > [branch-2] Enable DFSNetworkTopology as default >

[jira] [Updated] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12368: -- Attachment: HDFS-12368-branch-2.001.patch > [branch-2] Enable DFSNetworkTopology as default >

[jira] [Created] (HDFS-12368) [branch-2] Enable DFSNetworkTopology as default

2017-08-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12368: - Summary: [branch-2] Enable DFSNetworkTopology as default Key: HDFS-12368 URL: https://issues.apache.org/jira/browse/HDFS-12368 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144199#comment-16144199 ] Manoj Govindassamy commented on HDFS-12191: --- LGTM, +1. Thanks [~yzhangal]. Nits: *

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-10480: Issue Type: New Feature (was: Improvement) > Add an admin command to list currently open

[jira] [Updated] (HDFS-2538) option to disable fsck dots

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2538: --- Component/s: namenode > option to disable fsck dots > > >

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144144#comment-16144144 ] Chen Liang commented on HDFS-12321: --- The failed tests all passed in my local run. {{TestSQLQuery}} seems

[jira] [Assigned] (HDFS-12358) Handle IOException when transferring edit log to Journal current dir through JN sync

2017-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-12358: Assignee: Arpit Agarwal (was: Hanisha Koneru) > Handle IOException when transferring edit

[jira] [Assigned] (HDFS-12358) Handle IOException when transferring edit log to Journal current dir through JN sync

2017-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-12358: Assignee: Hanisha Koneru (was: Arpit Agarwal) > Handle IOException when transferring edit

[jira] [Commented] (HDFS-12358) Handle IOException when transferring edit log to Journal current dir through JN sync

2017-08-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144129#comment-16144129 ] Hanisha Koneru commented on HDFS-12358: --- Thanks for committing the patch, [~arpitagarwal] > Handle

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8312: --- Release Note: Permissions are now checked when moving a file to Trash. > Trash does not

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

2017-08-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8312: --- Release Note: (was: HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang

[jira] [Updated] (HDFS-12340) Ozone: C/C++ implementation of ozone client using curl

2017-08-28 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12340: --- Attachment: ozoneClient.C ozoneClient.h main.C The

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144103#comment-16144103 ] Wei-Chiu Chuang commented on HDFS-12363: Hi Xiao, thanks for reporting this bug. Looks legit to me

[jira] [Commented] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144096#comment-16144096 ] Hadoop QA commented on HDFS-12333: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144093#comment-16144093 ] Chen Liang commented on HDFS-12365: --- Thanks [~cheersyang] for the catch! The v001 patch LGTM, I've

[jira] [Updated] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12365: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: ListVolume displays

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2017-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144094#comment-16144094 ] Zhe Zhang commented on HDFS-9079: - Unassigning myself from the JIRA as I won't be able to work on it in the

[jira] [Assigned] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2017-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-9079: --- Assignee: (was: Zhe Zhang) > Erasure coding: preallocate multiple generation stamps and serialize

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144047#comment-16144047 ] Hadoop QA commented on HDFS-11096: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-08-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143965#comment-16143965 ] Sean Mackrory edited comment on HDFS-11096 at 8/28/17 4:40 PM: --- So Docker

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-08-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-11096: - Status: Patch Available (was: Open) > Support rolling upgrade between 2.x and 3.x >

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-08-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-11096: - Attachment: HDFS-11096.001.patch So Docker support has been added for the rolling-upgrade and

[jira] [Commented] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

2017-08-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143874#comment-16143874 ] Elek, Marton commented on HDFS-12333: - thx, the idea [~msingh], I improved the patch. Now the ozone

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143870#comment-16143870 ] Brahma Reddy Battula commented on HDFS-11896: - Pushed to {{branch-2.8.2}} as well. Compiled

[jira] [Updated] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11896: Fix Version/s: 2.8.2 > Non-dfsUsed will be doubled on dead node re-registration >

[jira] [Updated] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

2017-08-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12333: Attachment: HDFS-12333-HDFS-7240.003.patch > Ozone: Extend Datanode web interface with SCM

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-08-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143858#comment-16143858 ] Gergely Novák commented on HDFS-10391: -- I cannot reproduce the last failing unit test (it times out

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143847#comment-16143847 ] Hadoop QA commented on HDFS-12354: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12364) [branch-2.8.2] Fix the Compile Error after HDFS-12299

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12364: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2

[jira] [Updated] (HDFS-12364) [branch-2.8.2] Fix the Compile Error after HDFS-12299

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12364: Summary: [branch-2.8.2] Fix the Compile Error after HDFS-12299 (was:

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143804#comment-16143804 ] Hadoop QA commented on HDFS-12235: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143771#comment-16143771 ] Brahma Reddy Battula commented on HDFS-11896: - IMO, this should be backported to

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11738: - Fix Version/s: (was: 2.8.2) 2.8.3 > Hedged pread takes more time when

[jira] [Updated] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12352: - Resolution: Duplicate Status: Resolved (was: Patch Available) Had committed this in HDFS-11530.

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143736#comment-16143736 ] Yiqun Lin commented on HDFS-11530: -- Committed to branch-2 via HDFS-12352. Thanks [~vagarychen]! > Use

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Fix Version/s: 2.9.0 > Use HDFS specific network topology to choose datanode in >

[jira] [Commented] (HDFS-12084) Scheduled Count will not decrement when file is deleted before all IBR's received

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143735#comment-16143735 ] Brahma Reddy Battula commented on HDFS-12084: - [~kihwal] thanks for taking a look. bq. but I

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Attachment: HDFS-12354-HDFS-7240.001.patch Attach the initial patch. Additionally seperating the class

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12354: - Status: Patch Available (was: Open) > Ozone: Shuffle container list for datanode BlockDeletingService >

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143664#comment-16143664 ] Hadoop QA commented on HDFS-12258: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12364) [branch-2.8.2] Compile Error:TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12364: Priority: Blocker (was: Major) > [branch-2.8.2] Compile >

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-28 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12235: -- Attachment: HDFS-12235-HDFS-7240.002.patch upload v2 patch to rebase code and address

[jira] [Commented] (HDFS-12364) [branch-2.8.2] Compile Error:TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

2017-08-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143657#comment-16143657 ] Brahma Reddy Battula commented on HDFS-12364: - Test failures are unrelated, will commit soon.

[jira] [Commented] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143653#comment-16143653 ] Hadoop QA commented on HDFS-12366: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143632#comment-16143632 ] Hadoop QA commented on HDFS-11968: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-28 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12367: Assignee: Mukul Kumar Singh > Ozone: Too many open files error while running

[jira] [Commented] (HDFS-12210) Block Storage: volume creation times out while creating 3TB volume because of too many containers

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143571#comment-16143571 ] Hadoop QA commented on HDFS-12210: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143569#comment-16143569 ] Hadoop QA commented on HDFS-12329: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12364) [branch-2.8.2] Compile Error:TestClientProtocolForPipelineRecovery#testUpdatePipeLineAfterDNReg

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143561#comment-16143561 ] Hadoop QA commented on HDFS-12364: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143535#comment-16143535 ] Takanobu Asanuma commented on HDFS-11964: - Thanks for reviewing and the comment, [~drankye]! > We

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143530#comment-16143530 ] Yiqun Lin commented on HDFS-12354: -- I agree with your proposal, and will attach initial patch in two

[jira] [Updated] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-28 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12258: Attachment: HDFS-12258.06.patch Fix checkstyle issue, the test failures are not related to this patch.

[jira] [Commented] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143523#comment-16143523 ] Hadoop QA commented on HDFS-12365: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-28 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11968: - Attachment: HDFS-11968.004.patch > ViewFS: StoragePolicies commands fail with HDFS

[jira] [Commented] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143518#comment-16143518 ] Weiwei Yang commented on HDFS-12367: Looks like there are some resource leaks? :P > Ozone: Too many

[jira] [Created] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12367: -- Summary: Ozone: Too many open files error while running corona Key: HDFS-12367 URL: https://issues.apache.org/jira/browse/HDFS-12367 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12366: --- Status: Patch Available (was: Open) > Ozone: Refactor KSM metadata class names to avoid confusion >

[jira] [Updated] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12366: --- Attachment: HDFS-12366-HDFS-7240.001.patch > Ozone: Refactor KSM metadata class names to avoid

[jira] [Created] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12366: -- Summary: Ozone: Refactor KSM metadata class names to avoid confusion Key: HDFS-12366 URL: https://issues.apache.org/jira/browse/HDFS-12366 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12366: --- Description: Propose to rename 2 classes in package {{org.apache.hadoop.ozone.ksm}} *

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143514#comment-16143514 ] Hadoop QA commented on HDFS-12357: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12365: --- Status: Patch Available (was: Open) > Ozone: ListVolume displays incorrect createdOn time when the

[jira] [Updated] (HDFS-12365) Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient

2017-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12365: --- Attachment: HDFS-12365-HDFS-7240.001.patch Attached a pretty straight forward fix, it only adds a

  1   2   >