[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12117: -- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) The

[jira] [Commented] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133957#comment-16133957 ] Hadoop QA commented on HDFS-12216: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12216: - Attachment: HDFS-12216-HDFS-7240.006.patch Thanks for the review [~anu], patch v6 address

[jira] [Commented] (HDFS-11988) Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version file

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133910#comment-16133910 ] Hadoop QA commented on HDFS-11988: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11066) Improve test coverage for ISA-L native coder

2017-08-18 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133909#comment-16133909 ] Kai Zheng commented on HDFS-11066: -- I just re-purposed this JIRA and narrowed it down to enable the

[jira] [Updated] (HDFS-11066) Improve test coverage for ISA-L native coder

2017-08-18 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11066: - Description: Some issues were introduced but not found in time due to lack of necessary Jenkins support

[jira] [Updated] (HDFS-11066) Improve test coverage for ISA-L native coder

2017-08-18 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11066: - Summary: Improve test coverage for ISA-L native coder (was: Improve test coverage for Java coder/ISA-L

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133906#comment-16133906 ] Hadoop QA commented on HDFS-11888: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12320) Add quantiles for transactions batched in Journal sync

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133894#comment-16133894 ] Hadoop QA commented on HDFS-12320: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9153) Pretty-format the output for DFSIO

2017-08-18 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133893#comment-16133893 ] Kai Zheng commented on HDFS-9153: - Hi [~shv], Thanks for pointing this. Yes "Total Throughput" isn't

[jira] [Commented] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133862#comment-16133862 ] Hadoop QA commented on HDFS-12325: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11988) Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version file

2017-08-18 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11988: -- Attachment: HDFS-11988.02.patch Thanks [~eddyxu] for the review. Attached patch v02

[jira] [Commented] (HDFS-11988) Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version file

2017-08-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133849#comment-16133849 ] Lei (Eddy) Xu commented on HDFS-11988: -- One nit: {code} 602: Assert.assertEquals("Snap3 and before

[jira] [Updated] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12325: -- Status: Patch Available (was: Open) > SFTPFileSystem operations should restore cwd >

[jira] [Updated] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12325: -- Attachment: HDFS-12325.001.patch > SFTPFileSystem operations should restore cwd >

[jira] [Created] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-18 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12325: - Summary: SFTPFileSystem operations should restore cwd Key: HDFS-12325 URL: https://issues.apache.org/jira/browse/HDFS-12325 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-08-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11467: --- Labels: hdfs-ec-3.0-must-do (was: ) > Support ErasureCodingPolicyManager section in OIV

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-08-18 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133793#comment-16133793 ] Subru Krishnan commented on HDFS-10631: --- Thanks [~elgoiri], +1 on the latest patch (v10). >

[jira] [Commented] (HDFS-12322) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom.

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133782#comment-16133782 ] Hadoop QA commented on HDFS-12322: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Status: Patch Available (was: Open) > Ozone: SCM: use container state machine for open containers

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-11888-HDFS-7240.001.patch > Ozone: SCM: use container state machine for open

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Summary: Ozone: SCM: use container state machine for open containers allocated for key/blcoks (was:

[jira] [Commented] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133737#comment-16133737 ] Anu Engineer commented on HDFS-12216: - [~msingh] Thanks for fixing this. However I think that the log

[jira] [Commented] (HDFS-12324) Ozone: TestQueryNode#testStaleNodesCount is failing.

2017-08-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133734#comment-16133734 ] Xiaoyu Yao commented on HDFS-12324: --- {code} Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time

[jira] [Created] (HDFS-12324) Ozone: TestQueryNode#testStaleNodesCount is failing.

2017-08-18 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12324: - Summary: Ozone: TestQueryNode#testStaleNodesCount is failing. Key: HDFS-12324 URL: https://issues.apache.org/jira/browse/HDFS-12324 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12320) Add quantiles for transactions batched in Journal sync

2017-08-18 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12320: -- Status: Patch Available (was: Open) > Add quantiles for transactions batched in Journal sync

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133725#comment-16133725 ] Hadoop QA commented on HDFS-12321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133714#comment-16133714 ] Hadoop QA commented on HDFS-12292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-18 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133699#comment-16133699 ] Kai Zheng commented on HDFS-1: -- bq. Also, if someone is going below DFSClient to read, they can also

[jira] [Commented] (HDFS-12293) DataNode should log file name on disk error

2017-08-18 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133698#comment-16133698 ] Ajay Kumar commented on HDFS-12293: --- [~jojochuang] could you please check the updated patch? > DataNode

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133670#comment-16133670 ] Hadoop QA commented on HDFS-12225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

2017-08-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Summary: NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

2017-08-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133590#comment-16133590 ] Erik Krogen commented on HDFS-10733: [~yangjiandan], you are absolutely right. I have filed HDFS-12323

[jira] [Created] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is longer than timeout

2017-08-18 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-12323: -- Summary: NameNode terminates after full GC thinking QJM unresponsive if full GC is longer than timeout Key: HDFS-12323 URL: https://issues.apache.org/jira/browse/HDFS-12323

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.002.patch Rebased with v002 patch. > Ozone : debug cli: add support

[jira] [Updated] (HDFS-12322) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom.

2017-08-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12322: - Status: Patch Available (was: Open) > [branch-2] Add storage type demand to into

[jira] [Updated] (HDFS-12322) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom.

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12322: -- Attachment: HDFS-12322-branch-2.001.patch > [branch-2] Add storage type demand to into

[jira] [Created] (HDFS-12322) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom.

2017-08-18 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12322: - Summary: [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom. Key: HDFS-12322 URL: https://issues.apache.org/jira/browse/HDFS-12322 Project: Hadoop

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133583#comment-16133583 ] Hadoop QA commented on HDFS-12321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133581#comment-16133581 ] Hadoop QA commented on HDFS-12216: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.001.patch Post v001 patch. Some notes: 1. refactored SQLCLI to

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Status: Patch Available (was: Open) > Ozone : debug cli: add support to load user-provided SQL query >

[jira] [Comment Edited] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-18 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133547#comment-16133547 ] Mikhail Erofeev edited comment on HDFS-12292 at 8/18/17 8:14 PM: - Hi

[jira] [Created] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-18 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12321: - Summary: Ozone : debug cli: add support to load user-provided SQL query Key: HDFS-12321 URL: https://issues.apache.org/jira/browse/HDFS-12321 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-08-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133545#comment-16133545 ] Arpit Agarwal edited comment on HDFS-11450 at 8/18/17 7:47 PM: --- bq. Seems

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-18 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133547#comment-16133547 ] Mikhail Erofeev commented on HDFS-12292: Hi [~cliang], thanks for pointing out to this. Indeed,

[jira] [Commented] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-08-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133545#comment-16133545 ] Arpit Agarwal commented on HDFS-11450: -- bq. Seems like this one also used HDFS-11419 rather than

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-18 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Attachment: HDFS-12292-004.patch > Federation: Support viewfs:// schema path for DfsAdmin

[jira] [Updated] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-08-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11450: - Fix Version/s: 2.9.0 > HDFS specific network topology classes with storage type info included >

[jira] [Updated] (HDFS-12311) [branch-2] HDFS specific network topology classes with storage type info included

2017-08-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12311: - Resolution: Done Status: Resolved (was: Patch Available) I've committed this to

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-18 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133525#comment-16133525 ] Surendra Singh Lilhore commented on HDFS-12225: --- bq. How about clear sps queues during sps

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-18 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-03.patch Thanks [~rakeshr] for review.

[jira] [Updated] (HDFS-12320) Add quantiles for transactions batched in Journal sync

2017-08-18 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12320: -- Attachment: HDFS-12320.001.patch > Add quantiles for transactions batched in Journal sync >

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133488#comment-16133488 ] Hadoop QA commented on HDFS-11738: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12320) Add quantiles for transactions batched in Journal sync

2017-08-18 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12320: -- Component/s: namenode metrics > Add quantiles for transactions batched in

[jira] [Created] (HDFS-12320) Add quantiles for transactions batched in Journal sync

2017-08-18 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-12320: - Summary: Add quantiles for transactions batched in Journal sync Key: HDFS-12320 URL: https://issues.apache.org/jira/browse/HDFS-12320 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133467#comment-16133467 ] John Zhuge commented on HDFS-11738: --- +1 LGTM pending pre-commit tests. Still typo: "no nodes to

[jira] [Resolved] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

2017-08-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-10531. Resolution: Duplicate > Add EC policy and storage policy related usage summarization function to

[jira] [Reopened] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

2017-08-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-10531: > Add EC policy and storage policy related usage summarization function to dfs > du command >

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133415#comment-16133415 ] Arpit Agarwal commented on HDFS-12319: -- Thanks for reporting this [~brahmareddy]. I haven't tried

[jira] [Updated] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12319: - Target Version/s: 3.0.0-beta1 > DirectoryScanner will throw IllegalStateException when Multiple

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133413#comment-16133413 ] Andrew Wang commented on HDFS-1: I'd hope that there aren't any clients circumventing DFSClient to

[jira] [Resolved] (HDFS-8387) Erasure Coding: Revisit the long and int datatypes usage in striping logic

2017-08-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8387. --- Resolution: Delivered Thanks Rakesh for working on this, resolving per above recommendation. >

[jira] [Updated] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12216: - Attachment: HDFS-12216-HDFS-7240.005.patch Patch v5 fixes the unit test failure in patch

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133351#comment-16133351 ] Xiao Chen edited comment on HDFS-10899 at 8/18/17 5:52 PM: --- Just wanted to

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133351#comment-16133351 ] Xiao Chen commented on HDFS-10899: -- Just wanted to update about the myths with the 0.001 not 99% symptom.

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133317#comment-16133317 ] Chen Liang commented on HDFS-12318: --- Seems this is a fairly tricky corner case, the check becomes

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11738: - Attachment: (was: HDFS-11738-05.patch) > Hedged pread takes more time when block moved from

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11738: - Attachment: HDFS-11738-05.patch > Hedged pread takes more time when block moved from initial

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11738: - Attachment: HDFS-11738-05.patch Updated the patch addressing [~jzhuge]'s comments. Please review.

[jira] [Commented] (HDFS-12311) [branch-2] HDFS specific network topology classes with storage type info included

2017-08-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133288#comment-16133288 ] Chen Liang commented on HDFS-12311: --- [~arpitagarwal] could you please take a look? Thanks! > [branch-2]

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-08-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133242#comment-16133242 ] Íñigo Goiri commented on HDFS-10631: Latest build seems fine. The 2 broken unit tests are unrelated to

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133189#comment-16133189 ] Hadoop QA commented on HDFS-12283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133033#comment-16133033 ] Hadoop QA commented on HDFS-12216: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-18 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12283: -- Attachment: HDFS-12283-HDFS-7240.005.patch Discussed with Weiwei, change some parameters of the APIs to

[jira] [Updated] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12319: Description: *Scenario:* Configure "*dfs.datanode.directoryscan.interval*" as *60*

[jira] [Updated] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12216: - Attachment: HDFS-12216-HDFS-7240.004.patch > Ozone: TestKeys is failing consistently >

[jira] [Created] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-18 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-12319: --- Summary: DirectoryScanner will throw IllegalStateException when Multiple BP's are present Key: HDFS-12319 URL: https://issues.apache.org/jira/browse/HDFS-12319

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16132030#comment-16132030 ] Hadoop QA commented on HDFS-12318: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Status: Patch Available (was: Open) > Fix IOException condition for openInfo in DFSInputStream >

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Attachment: HDFS-12318.patch > Fix IOException condition for openInfo in DFSInputStream >

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Description: when retriesForLastBlockLength == 0 and lastBlockBeingWrittenLength != -1, "openInfo" successfully

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Fix Version/s: (was: 3.0.0-beta1) > Fix IOException condition for openInfo in DFSInputStream >

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Fix Version/s: (was: 3.0.0-beta1) > Fix IOException condition for openInfo in DFSInputStream >

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Fix Version/s: 3.0.0-beta1 > Fix IOException condition for openInfo in DFSInputStream >

[jira] [Created] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-18 Thread legend (JIRA)
legend created HDFS-12318: - Summary: Fix IOException condition for openInfo in DFSInputStream Key: HDFS-12318 URL: https://issues.apache.org/jira/browse/HDFS-12318 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131975#comment-16131975 ] Hadoop QA commented on HDFS-12216: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8387) Erasure Coding: Revisit the long and int datatypes usage in striping logic

2017-08-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131957#comment-16131957 ] Rakesh R commented on HDFS-8387: bq. For the first case, since we mod by stripeSize (which is an int) the

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-18 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131912#comment-16131912 ] Kai Zheng commented on HDFS-1: -- Using the existing API to return data block locations ignoring parity

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131906#comment-16131906 ] Hadoop QA commented on HDFS-12283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131887#comment-16131887 ] Rakesh R commented on HDFS-12225: - I thought to use the count for recursive traversal logic, I agree for

[jira] [Updated] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12216: - Attachment: HDFS-12216-HDFS-7240.003.patch > Ozone: TestKeys is failing consistently >

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-18 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131867#comment-16131867 ] John Zhuge commented on HDFS-11738: --- The patch looks great! Only a few minor comments: * Keep the old

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131820#comment-16131820 ] Hadoop QA commented on HDFS-12258: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131801#comment-16131801 ] Akira Ajisaka commented on HDFS-11882: -- Umm. The test failure is related:

[jira] [Updated] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-18 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12283: -- Attachment: HDFS-12283-HDFS-7240.004.patch > Ozone: DeleteKey-5: Implement SCM DeletedBlockLog >

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131787#comment-16131787 ] Hadoop QA commented on HDFS-10631: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

2017-08-18 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10531: - Resolution: Fixed Status: Resolved (was: Patch Available) > Add EC policy and storage policy