[jira] [Resolved] (HDFS-3821) Backport HDFS-3626 to branch-1 (Creating file with invalid path can corrupt edit log)

2017-11-03 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor resolved HDFS-3821. Resolution: Won't Fix > Backport HDFS-3626 to branch-1 (Creating file with invalid path can corrupt

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237350#comment-16237350 ] Weiwei Yang commented on HDFS-12443: Thanks [~linyiqun], the patch looks really good to me, it

[jira] [Commented] (HDFS-12770) Add doc about how to disable client socket cache

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237443#comment-16237443 ] Hadoop QA commented on HDFS-12770: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237451#comment-16237451 ] Kai Zheng commented on HDFS-11467: -- Thanks [~HuafengWang]! The latest patch LGTM and +1. > Support

[jira] [Commented] (HDFS-12739) Add Support for SCM --init command

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237374#comment-16237374 ] Hadoop QA commented on HDFS-12739: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-12771: -- Summary: Add genstamp and block size to metasave Corrupt blocks list Key: HDFS-12771 URL: https://issues.apache.org/jira/browse/HDFS-12771 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-11-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238056#comment-16238056 ] stack commented on HDFS-12711: -- This is excellent work. Would a kill -QUIT before you do actual kill of the

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12754: --- Attachment: HDFS-12754.002.patch Thank you for the comments [~yangjiandan]. I do an additional remove

[jira] [Updated] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12771: --- Status: Patch Available (was: Open) > Add genstamp and block size to metasave Corrupt blocks list >

[jira] [Updated] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12771: --- Attachment: HDFS-12771.001.patch v1 patch that uses block.toString() and getNumBytes() . > Add

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238117#comment-16238117 ] Íñigo Goiri commented on HDFS-12773: In addition to the safer FS implementation: * Added the test

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-11-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238181#comment-16238181 ] stack commented on HDFS-12711: -- bq. For now, though, I'm sort of tired at looking at this problem and will go

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238183#comment-16238183 ] Xiao Chen commented on HDFS-11467: -- +1 from me too, Ran failed tests locally, all passed. Committing

[jira] [Assigned] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-9240: Assignee: Virajith Jalaparti (was: Xiaoyu Yao) > Use Builder pattern for BlockLocation

[jira] [Updated] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12745: - Attachment: HDFS-12745-HDFS-7240.001.patch > Ozone: XceiverClientManager should cache

[jira] [Updated] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12745: - Status: Patch Available (was: Open) > Ozone: XceiverClientManager should cache objects

[jira] [Created] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
Íñigo Goiri created HDFS-12772: -- Summary: RBF: Track Router states Key: HDFS-12772 URL: https://issues.apache.org/jira/browse/HDFS-12772 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Description: HDFS-10630 introduced a filesystem implementation of the State Store for unit tests.

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238107#comment-16238107 ] Allen Wittenauer commented on HDFS-12711: - Thanks! I'll have to play around with sending a

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Patch Available (was: Open) > Use Builder pattern for BlockLocation constructors

[jira] [Comment Edited] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238168#comment-16238168 ] Virajith Jalaparti edited comment on HDFS-9240 at 11/3/17 6:50 PM: ---

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11467: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238187#comment-16238187 ] Xiao Chen commented on HDFS-11467: -- Committed to trunk and branch-3.0. Thanks [~HuafengWang] for

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238265#comment-16238265 ] Hudson commented on HDFS-11467: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13186 (See

[jira] [Updated] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Affects Version/s: 3.0.0 > RBF: Track Router states > > >

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Assignee: Íñigo Goiri Status: Patch Available (was: Open) > RBF: Improve State Store FS

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Priority: Normal (was: Trivial) > RBF: Improve State Store FS implementation >

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Attachment: HDFS-12773.000.patch > RBF: Improve State Store FS implementation >

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11246: --- Attachment: HDFS-11246.004.patch Revised patch addressing comments from Daryn. >

[jira] [Updated] (HDFS-12719) Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch

2017-11-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12719: - Status: Open (was: Patch Available) > Ozone: Fix checkstyle, javac, whitespace issues in

[jira] [Updated] (HDFS-12719) Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch

2017-11-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12719: - Status: Patch Available (was: Open) > Ozone: Fix checkstyle, javac, whitespace issues in

[jira] [Created] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
Íñigo Goiri created HDFS-12773: -- Summary: RBF: Improve State Store FS implementation Key: HDFS-12773 URL: https://issues.apache.org/jira/browse/HDFS-12773 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Description: To monitor the state of the cluster, we should track the state of the routers. This

[jira] [Commented] (HDFS-12763) DataStreamer should heartbeat during flush

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238081#comment-16238081 ] Hadoop QA commented on HDFS-12763: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Attachment: HDFS-9240.002.patch > Use Builder pattern for BlockLocation constructors >

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Open (was: Patch Available) > Use Builder pattern for BlockLocation constructors

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238175#comment-16238175 ] Hadoop QA commented on HDFS-12771: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238244#comment-16238244 ] Hadoop QA commented on HDFS-12754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238076#comment-16238076 ] Íñigo Goiri commented on HDFS-12773: Internally, we use the ZooKeeper implementation from HDFS-10631.

[jira] [Updated] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Description: _emphasized text_ > RBF: Track Router states > > >

[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238168#comment-16238168 ] Virajith Jalaparti commented on HDFS-9240: -- Thanks for taking a look [~xyao]. Posting new patch

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238268#comment-16238268 ] Kuhu Shukla commented on HDFS-12771: [~kihwal], could you share any review comments for this patch.

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237274#comment-16237274 ] Huafeng Wang commented on HDFS-11467: - The failed tests are irrelevant and they all passed locally.

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237280#comment-16237280 ] Hadoop QA commented on HDFS-12443: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238523#comment-16238523 ] Hadoop QA commented on HDFS-12772: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238568#comment-16238568 ] Virajith Jalaparti commented on HDFS-12665: --- Hi [~ehiggs], thanks for posting the new patch. A

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237685#comment-16237685 ] Allen Wittenauer commented on HDFS-12711: - Finally got a full qbt run on branch-2, thanks to

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238520#comment-16238520 ] Anu Engineer commented on HDFS-12734: - Sorry, my bad, not in case of Jenkins builds but if you are

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Resolution: Fixed Assignee: Chris Douglas Fix Version/s: 3.1.0 Status:

[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238580#comment-16238580 ] Hadoop QA commented on HDFS-9240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10467) Router-based HDFS federation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-10467: --- Fix Version/s: 2.9.0 > Router-based HDFS federation > > >

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237136#comment-16237136 ] Xiao Chen commented on HDFS-11467: -- FYI HFDS-12682 is committed. > Support ErasureCoding section in OIV

[jira] [Updated] (HDFS-12739) Add Support for SCM --init command

2017-11-03 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12739: --- Attachment: HDFS-12739-HDFS-7240.006.patch Addressed checkStyle issues. > Add

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237146#comment-16237146 ] Huafeng Wang commented on HDFS-11467: - Hi [~xiaochen], I just uploaded a new patch against the latest

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-11467: Attachment: HDFS-11467.003.patch > Support ErasureCoding section in OIV XML/ReverseXML >

[jira] [Created] (HDFS-12776) [READ] Increasing replication for PROVIDED files should create local replicas

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12776: - Summary: [READ] Increasing replication for PROVIDED files should create local replicas Key: HDFS-12776 URL: https://issues.apache.org/jira/browse/HDFS-12776

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238612#comment-16238612 ] Subru Krishnan commented on HDFS-11754: --- Moving out to 2.10.0 as 2.9.0 release is ongoing. > Make

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Description: As opposed to local blocks, each DN keeps track of all blocks in PROVIDED

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Description: As opposed to local blocks, each DN keeps track of all blocks in PROVIDED

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-11-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238671#comment-16238671 ] Tsz Wo Nicholas Sze commented on HDFS-12594: For RemoteIterator, since there is no change in

[jira] [Commented] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238682#comment-16238682 ] Hadoop QA commented on HDFS-12607: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238688#comment-16238688 ] Hudson commented on HDFS-12681: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13188 (See

[jira] [Commented] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238694#comment-16238694 ] Hadoop QA commented on HDFS-12774: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238598#comment-16238598 ] Xiaoyu Yao commented on HDFS-12774: --- Thanks [~nandakumar131] for the patch. It looks good to me. +1

[jira] [Created] (HDFS-12775) [READ] Fix capacity reporting for Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12775: - Summary: [READ] Fix capacity reporting for Provided volumes Key: HDFS-12775 URL: https://issues.apache.org/jira/browse/HDFS-12775 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-11-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238597#comment-16238597 ] Xiaoyu Yao commented on HDFS-12474: --- [~nandakumar131], can you rebase the patch as it does not apply

[jira] [Created] (HDFS-12777) [READ] Share URI prefix across Provided blocks to lower memory footprint.

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12777: - Summary: [READ] Share URI prefix across Provided blocks to lower memory footprint. Key: HDFS-12777 URL: https://issues.apache.org/jira/browse/HDFS-12777

[jira] [Updated] (HDFS-12775) [READ] Fix reporting for Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Summary: [READ] Fix reporting for Provided volumes (was: [READ] Fix capacity reporting

[jira] [Updated] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Summary: [READ] Fix reporting of Provided volumes (was: [READ] Fix reporting for

[jira] [Updated] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Description: Provided Volumes currently report infinite capacity and 0 space used.

[jira] [Created] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12779: - Summary: [READ] Allow cluster id to be specified to the Image generation tool Key: HDFS-12779 URL: https://issues.apache.org/jira/browse/HDFS-12779

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-11-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238670#comment-16238670 ] Tsz Wo Nicholas Sze commented on HDFS-12594: Some other comments on the patch. - Since there

[jira] [Updated] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated HDFS-11754: -- Target Version/s: 2.10.0 (was: 2.9.0) > Make FsServerDefaults cache configurable. >

[jira] [Created] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12778: - Summary: [READ] Report multiple locations for PROVIDED blocks Key: HDFS-12778 URL: https://issues.apache.org/jira/browse/HDFS-12778 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Summary: [READ] Reduce memory and CPU footprint for PROVIDED volumes. (was: [READ]

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Description: As opposed to local blocks, each DN keeps track of all blocks in PROVIDED

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238627#comment-16238627 ] Virajith Jalaparti commented on HDFS-12713: --- Please see [this

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238690#comment-16238690 ] Hadoop QA commented on HDFS-12685: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10528) Add logging to successful standby checkpointing

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238725#comment-16238725 ] Hadoop QA commented on HDFS-10528: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238289#comment-16238289 ] Kihwal Lee commented on HDFS-12771: --- +1 > Add genstamp and block size to metasave Corrupt blocks list

[jira] [Commented] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238318#comment-16238318 ] Íñigo Goiri commented on HDFS-12772: Currently it has: * Router state (including State Store

[jira] [Commented] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238337#comment-16238337 ] Hadoop QA commented on HDFS-12745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12774: --- Description: {{OzoneException}} has to be used in hadoop-hdfs-client, since we cannot refer classes

[jira] [Created] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12774: -- Summary: Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client Key: HDFS-12774 URL: https://issues.apache.org/jira/browse/HDFS-12774 Project:

[jira] [Commented] (HDFS-10419) Building HDFS on top of Ozone's storage containers

2017-11-03 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238379#comment-16238379 ] Sanjay Radia commented on HDFS-10419: - HDFS-5389 describes one approach of building a NN that scales

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238422#comment-16238422 ] Anu Engineer commented on HDFS-12734: - bq. This is not an option. mvn site needs to be used to be

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238328#comment-16238328 ] Virajith Jalaparti commented on HDFS-11902: --- The checkstyle issues are from {{DFSConfigKeys}}

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Status: Patch Available (was: Open) > [READ] FsVolumeImpl exception when scanning

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Merge

[jira] [Assigned] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-12685: - Assignee: Virajith Jalaparti > [READ] FsVolumeImpl exception when scanning

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Status: Open (was: Patch Available) > [READ] FsVolumeImpl exception when scanning

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238343#comment-16238343 ] Hudson commented on HDFS-12771: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13187 (See

[jira] [Commented] (HDFS-12549) Ozone: OzoneClient: Support for REST protocol

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238371#comment-16238371 ] Nanda kumar commented on HDFS-12549: Thanks [~xyao] for the review. bq. Please separate the broad

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238387#comment-16238387 ] Hadoop QA commented on HDFS-11246: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Attachment: HDFS-12607-HDFS-9806.003.patch > [READ] Even one dead datanode with

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238345#comment-16238345 ] Virajith Jalaparti commented on HDFS-12685: --- [~ehiggs], can you check if this patch avoids the

[jira] [Commented] (HDFS-12756) Ozone: Add datanodeID to heartbeat responses and container protocol

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238376#comment-16238376 ] Nanda kumar commented on HDFS-12756: Thanks [~anu] for the update. The patch is not applying anymore,

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238403#comment-16238403 ] Hadoop QA commented on HDFS-12685: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12774: --- Status: Patch Available (was: Open) > Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to

[jira] [Commented] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238418#comment-16238418 ] Nanda kumar commented on HDFS-12774: More info [here |

  1   2   >