[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-01-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814232#comment-15814232 ] Surendra Singh Lilhore commented on HDFS-11163: --- Thanks [~cnauroth] and [~szetszwo] for

[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11150: -- Attachment: HDFS-11150-HDFS-10285.006.patch Uploaded v6 patch: 1. Rebase my patch 2. Delete the code

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-01-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814077#comment-15814077 ] Tsz Wo Nicholas Sze commented on HDFS-11163: > ... It will require an additional

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814033#comment-15814033 ] Hadoop QA commented on HDFS-9391: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814020#comment-15814020 ] SammiChen edited comment on HDFS-11072 at 1/10/17 6:08 AM: --- Thanks

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814020#comment-15814020 ] SammiChen commented on HDFS-11072: -- Thanks [~andrew.wang] ! I agree with the general comment. Will

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v7.patch > Add ability to unset and change directory EC policy >

[jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813865#comment-15813865 ] Yongjun Zhang commented on HDFS-11306: -- Hi [~jojochuang], Thanks much for working on this issue!

[jira] [Commented] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD and unused import from HdfsServerConstants

2017-01-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813846#comment-15813846 ] Yiqun Lin commented on HDFS-9935: - I have taken a quick check for this in branch-2 and branch-2.8, I found

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813791#comment-15813791 ] Yuanbo Liu commented on HDFS-11150: --- [~umamaheswararao] Sure. Thanks for your reminder. > [SPS]:

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813708#comment-15813708 ] Manoj Govindassamy commented on HDFS-9391: -- Thanks [~mingma]. Attached branch-2.01.patch. Thanks

[jira] [Updated] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9391: - Attachment: HDFS-9391-branch-2.01.patch > Update webUI/JMX to display maintenance state

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813659#comment-15813659 ] Hudson commented on HDFS-11273: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11095 (See

[jira] [Comment Edited] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813646#comment-15813646 ] Weiwei Yang edited comment on HDFS-6874 at 1/10/17 2:52 AM: Chatted with

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6874: -- Fix Version/s: (was: 2.9.0) > Add GETFILEBLOCKLOCATIONS operation to HttpFS >

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813646#comment-15813646 ] Weiwei Yang commented on HDFS-6874: --- Chatted with [~clamb] offline, he mentioned he was not near with

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2017-01-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813615#comment-15813615 ] Anu Engineer commented on HDFS-7343: bq. Also, it makes SSM more stable as these data stored in NN.

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813607#comment-15813607 ] Brahma Reddy Battula commented on HDFS-11308: - bq.nc is alias of ncat which does not have "-z"

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813598#comment-15813598 ] Hadoop QA commented on HDFS-7967: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11268) Persist erasure coding policy ID in FSImage

2017-01-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11268: --- Priority: Critical (was: Major) Component/s: erasure-coding Issue Type: Bug (was:

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2017-01-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813585#comment-15813585 ] Andrew Wang commented on HDFS-10759: Thanks for the rev Ewan. Overall this looks really good, just

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-11273: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-01-09 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813527#comment-15813527 ] Chen Zhang commented on HDFS-11303: --- Stack, thanks for your comments. Yes, the test is just to verify,

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2017-01-09 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813506#comment-15813506 ] Wei Zhou commented on HDFS-7343: {quote} though I'd encourage you to think about how far we can get with a

[jira] [Comment Edited] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2017-01-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813493#comment-15813493 ] Xiaobing Zhou edited comment on HDFS-11194 at 1/10/17 1:38 AM: --- Thank you

[jira] [Commented] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2017-01-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813493#comment-15813493 ] Xiaobing Zhou commented on HDFS-11194: -- Thank you [~arpitagarwal] for the patch. I've some comments.

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813481#comment-15813481 ] Ming Ma commented on HDFS-9391: --- +1. Manoj, given the patch doesn't apply directly to branch-2, can you

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813468#comment-15813468 ] Andrew Wang commented on HDFS-11072: I'm almost +1, thanks for the quick rev Sammi, * In the new

[jira] [Commented] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813396#comment-15813396 ] Hadoop QA commented on HDFS-11305: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11309) chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-09 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11309: -- Summary: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target Key: HDFS-11309 URL:

[jira] [Updated] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813354#comment-15813354 ] Yongjun Zhang commented on HDFS-11292: -- Thanks [~jojochuang] much for the review! I committed to

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813330#comment-15813330 ] Manoj Govindassamy commented on HDFS-9391: -- Test failures are not related to the patch. They are

[jira] [Commented] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813317#comment-15813317 ] Hudson commented on HDFS-11292: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11093 (See

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813259#comment-15813259 ] Hadoop QA commented on HDFS-9391: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813250#comment-15813250 ] Hadoop QA commented on HDFS-11306: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813252#comment-15813252 ] Uma Maheswara Rao G commented on HDFS-11150: [~yuanbo], please proceed with your patch now.

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Attachment: HDFS-7967.branch-2.002.patch HDFS-7967.branch-2.8.002.patch Use

[jira] [Commented] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813212#comment-15813212 ] Hadoop QA commented on HDFS-11299: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813207#comment-15813207 ] Hadoop QA commented on HDFS-11209: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Attachment: HDFS-11305.HDFS-8707.001.patch Cleaned up white spaces. > libhdfs++: Log Datanode

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813155#comment-15813155 ] Hadoop QA commented on HDFS-11273: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813153#comment-15813153 ] James Clampffer commented on HDFS-11305: Code looks good to me, would you mind just clearing up

[jira] [Commented] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813143#comment-15813143 ] Hadoop QA commented on HDFS-11305: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813132#comment-15813132 ] Wei-Chiu Chuang commented on HDFS-11308: (and more portable) > NameNode doFence state judgment

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813129#comment-15813129 ] tangshangwen commented on HDFS-11308: - ok, thank you for your comments! > NameNode doFence state

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813118#comment-15813118 ] Wei-Chiu Chuang commented on HDFS-11308: I don't know if there's standard/specification for

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813108#comment-15813108 ] Masatake Iwasaki commented on HDFS-11308: - nc is alias of ncat which does not have "-z" option in

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813104#comment-15813104 ] Masatake Iwasaki commented on HDFS-11308: - Since "nc -z" is used to check that the process is

[jira] [Commented] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813078#comment-15813078 ] Wei-Chiu Chuang commented on HDFS-11292: +1. The failed tests cannot be reproduced in my local

[jira] [Updated] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

2017-01-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11293: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

2017-01-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813069#comment-15813069 ] Uma Maheswara Rao G commented on HDFS-11293: I have just committed this to branch. Thanks

[jira] [Commented] (HDFS-11028) libhdfs++: FileHandleImpl::CancelOperations needs to be able to cancel pending connections

2017-01-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813059#comment-15813059 ] James Clampffer commented on HDFS-11028: In case we needed another example of why "delete this"

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813039#comment-15813039 ] tangshangwen commented on HDFS-11308: - Hi [~jojochuang], Do you think we should judge the return value

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813035#comment-15813035 ] tangshangwen commented on HDFS-11308: - Ok, thank you ~ [~jojochuang] > NameNode doFence state

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813031#comment-15813031 ] Hadoop QA commented on HDFS-7967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813026#comment-15813026 ] Wei-Chiu Chuang commented on HDFS-11308: I don't have a CentOS 7 box available. But it looks like

[jira] [Commented] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813013#comment-15813013 ] Xiaoyu Yao commented on HDFS-11299: --- Thanks [~hanishakoneru] for updating the patch and [~arpitagarwal]

[jira] [Updated] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9391: - Attachment: HDFS-9391.04.patch Attached v04 patch to fix the LeavingServiceStatus and use

[jira] [Updated] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated HDFS-11308: Description: In our Cluster, I found some abnormal in ZKFC log {noformat}

[jira] [Created] (HDFS-11308) NameNode doFence state judgment problem

2017-01-09 Thread tangshangwen (JIRA)
tangshangwen created HDFS-11308: --- Summary: NameNode doFence state judgment problem Key: HDFS-11308 URL: https://issues.apache.org/jira/browse/HDFS-11308 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-09 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HDFS-11307: --- Summary: The rpc to portmap service for NFS has hardcoded timeout. Key: HDFS-11307 URL: https://issues.apache.org/jira/browse/HDFS-11307 Project:

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812983#comment-15812983 ] Xiaoyu Yao commented on HDFS-11209: --- I've also manually tested on a cluster with rolling upgrade

[jira] [Updated] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11209: -- Attachment: HDFS-11209.02.patch Fix the checkstyle and adding unit test. > SNN can't checkpoint when

[jira] [Commented] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812955#comment-15812955 ] Arpit Agarwal commented on HDFS-11299: -- Thanks [~hanishakoneru]. +1 pending Jenkins. Looks like

[jira] [Updated] (HDFS-11306) Print remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11306: --- Summary: Print remaining edit logs from buffer if edit log can't be rolled. (was: Dump

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Attachment: HDFS-11305.HDFS-8707.000.patch 000.patch adds a debug log in

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Status: Patch Available (was: Open) > libhdfs++: Log Datanode information when reading an HDFS block

[jira] [Updated] (HDFS-11306) Dump remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11306: --- Status: Patch Available (was: Open) > Dump remaining edit logs from buffer if edit log can't

[jira] [Updated] (HDFS-11306) Dump remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11306: --- Attachment: HDFS-11306.001.patch Upload patch v001. This patch adds a private method that

[jira] [Created] (HDFS-11306) Dump remaining edit logs from buffer if edit log can't be rolled.

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11306: -- Summary: Dump remaining edit logs from buffer if edit log can't be rolled. Key: HDFS-11306 URL: https://issues.apache.org/jira/browse/HDFS-11306 Project: Hadoop

[jira] [Comment Edited] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812904#comment-15812904 ] Manoj Govindassamy edited comment on HDFS-9391 at 1/9/17 9:30 PM: -- Sure.

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812904#comment-15812904 ] Manoj Govindassamy commented on HDFS-9391: -- Sure. Its about whether we should include all blocks

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812883#comment-15812883 ] Hadoop QA commented on HDFS-11209: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Summary: libhdfs++: Log Datanode information when reading an HDFS block (was: Log Datanode

[jira] [Created] (HDFS-11305) Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
Xiaowei Zhu created HDFS-11305: -- Summary: Log Datanode information when reading an HDFS block Key: HDFS-11305 URL: https://issues.apache.org/jira/browse/HDFS-11305 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-09 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11299: -- Attachment: HDFS-11299.002.patch Thank you [~xyao] and [~arpitagarwal] for reviewing the patch

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-09 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11273: -- Attachment: HDFS-11273.004.patch > Move TransferFsImage#doGetUrl function to a Util class >

[jira] [Commented] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812794#comment-15812794 ] Hadoop QA commented on HDFS-11293: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812791#comment-15812791 ] Allen Wittenauer commented on HDFS-7967: Sorry. :( I tried hard to make hyphens as separators work

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Attachment: HDFS-7967.branch-2.001.patch HDFS-7967.branch-2.8.001.patch Renamed patches

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812642#comment-15812642 ] Ming Ma commented on HDFS-9391: --- Thanks Manoj. I just found something related to our discussion. For any

[jira] [Comment Edited] (HDFS-11304) Namenode fails to start, even edit log available in the journal node

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812634#comment-15812634 ] Wei-Chiu Chuang edited comment on HDFS-11304 at 1/9/17 7:38 PM: Thanks for

[jira] [Updated] (HDFS-11304) Namenode fails to start, even edit log available in the journal node

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11304: --- Priority: Major (was: Minor) > Namenode fails to start, even edit log available in the

[jira] [Commented] (HDFS-11304) Namenode fails to start, even edit log available in the journal node

2017-01-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812634#comment-15812634 ] Wei-Chiu Chuang commented on HDFS-11304: Thanks for reporting the issue, [~kpalanisamy]. If a

[jira] [Updated] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11209: -- Attachment: HDFS-11209.01.patch Fix the build issue. > SNN can't checkpoint when rolling upgrade is

[jira] [Commented] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812624#comment-15812624 ] Hadoop QA commented on HDFS-11209: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812618#comment-15812618 ] Hadoop QA commented on HDFS-7967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11301) Double wrapping over RandomAccessFile in LocalReplicaInPipeline#createStreams

2017-01-09 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812602#comment-15812602 ] Hanisha Koneru commented on HDFS-11301: --- Thank you [~arpitagarwal]. > Double wrapping over

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812601#comment-15812601 ] Chris Nauroth commented on HDFS-11163: -- [~surendrasingh], thank you for the patch. This looks

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Attachment: HDFS-7967.branch-2-1.patch HDFS-7967.branch-2.8-1.patch Simple change from

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

2017-01-09 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812572#comment-15812572 ] stack commented on HDFS-11303: -- Patch LGTM. Your patch allows that the primary read might still complete

[jira] [Updated] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11209: -- Attachment: HDFS-11209.00.patch Attach a patch to check the NN rolling upgrade status before update the

[jira] [Updated] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2017-01-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11209: -- Status: Patch Available (was: Open) > SNN can't checkpoint when rolling upgrade is not finalized >

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

2017-01-09 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812538#comment-15812538 ] Vinitha Reddy Gankidi commented on HDFS-10733: -- [~kihwal] Thanks for the great suggestion.

[jira] [Updated] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

2017-01-09 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10733: - Attachment: HDFS-10733.001.patch > NameNode terminated after full GC thinking QJM

[jira] [Commented] (HDFS-11301) Double wrapping over RandomAccessFile in LocalReplicaInPipeline#createStreams

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812524#comment-15812524 ] Hudson commented on HDFS-11301: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11091 (See

[jira] [Commented] (HDFS-11299) Support multiple Datanode File IO hooks

2017-01-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812501#comment-15812501 ] Arpit Agarwal commented on HDFS-11299: -- Thank you for the updated patch [~hanishakoneru]. In addition

[jira] [Updated] (HDFS-11301) Double wrapping over RandomAccessFile in LocalReplicaInPipeline#createStreams

2017-01-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11301: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11293) [SPS]: Local DN should be given preference as source node, when target available in same node

2017-01-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812385#comment-15812385 ] Rakesh R commented on HDFS-11293: - +1 on the latest patch. Pending Jenkins. > [SPS]: Local DN should be

  1   2   >