[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Status: Patch Available (was: Open) > [SPS]: chooseTargetTypeInSameNode should pass

[jira] [Updated] (HDFS-11309) [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11309: --- Attachment: HDFS-11309-HDFS-10285-00.patch Attached the patch. Also took chance to

[jira] [Commented] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820310#comment-15820310 ] Hadoop QA commented on HDFS-11307: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11336: --- Summary: [SPS]: Remove xAttrs when movements done or SPS disabled (was: [SPS]: Clean

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Status: Open (was: Patch Available) > The rpc to portmap service for NFS has hardcoded

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Status: Patch Available (was: Open) > The rpc to portmap service for NFS has hardcoded

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Attachment: HDFS-11307.003.patch Annotated the getter for portmapUdpTimeoutMillis > The

[jira] [Created] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2017-01-11 Thread Wei Zhou (JIRA)
Wei Zhou created HDFS-11338: --- Summary: [SPS]: Fix timeout issue in unit tests caused by longger NN down time Key: HDFS-11338 URL: https://issues.apache.org/jira/browse/HDFS-11338 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Attachment: HDFS-11337-branch-2.02.patch > [branch-2] Add instrumentation hooks around Datanode

[jira] [Commented] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820171#comment-15820171 ] Hadoop QA commented on HDFS-11337: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Attachment: (was: HDFS-10958-branch-2.01.patch) > [branch-2] Add instrumentation hooks around

[jira] [Issue Comment Deleted] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Attachment: HDFS-11337-branch-2.01.patch > [branch-2] Add instrumentation hooks around Datanode

[jira] [Commented] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820164#comment-15820164 ] Yiqun Lin commented on HDFS-11333: -- Good catch, [~jojochuang]. The patch LGTM. +1. Seems there is an

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820149#comment-15820149 ] Hadoop QA commented on HDFS-11316: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820137#comment-15820137 ] Arpit Agarwal edited comment on HDFS-10958 at 1/12/17 4:29 AM: --- Cloned this

[jira] [Commented] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820142#comment-15820142 ] Hadoop QA commented on HDFS-11337: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820137#comment-15820137 ] Arpit Agarwal commented on HDFS-10958: -- Cloned this as HDFS-11337 for the branch-2 backport. The

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Status: Patch Available (was: Open) > [branch-2] Add instrumentation hooks around Datanode disk

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Attachment: HDFS-10958-branch-2.01.patch > [branch-2] Add instrumentation hooks around Datanode

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Target Version/s: 2.9.0 > [branch-2] Add instrumentation hooks around Datanode disk IO >

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Description: Cloned from HDFS-10958 to verify the branch-2 backport. (was: This ticket is opened

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11337: - Fix Version/s: (was: 3.0.0-alpha2) > [branch-2] Add instrumentation hooks around Datanode

[jira] [Created] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2017-01-11 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11337: Summary: [branch-2] Add instrumentation hooks around Datanode disk IO Key: HDFS-11337 URL: https://issues.apache.org/jira/browse/HDFS-11337 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

2017-01-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11186: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-11336) [SPS]: Clean up SPS xAttr in a proper situation

2017-01-11 Thread Yuanbo Liu (JIRA)
Yuanbo Liu created HDFS-11336: - Summary: [SPS]: Clean up SPS xAttr in a proper situation Key: HDFS-11336 URL: https://issues.apache.org/jira/browse/HDFS-11336 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-11 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819978#comment-15819978 ] Yuanbo Liu commented on HDFS-11150: --- Thanks, raise another JIRA to remove xAttr > [SPS]: Provide

[jira] [Commented] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819962#comment-15819962 ] Hadoop QA commented on HDFS-11335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11304) Namenode fails to start, even edit log available in the journal node

2017-01-11 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819911#comment-15819911 ] Greg Senia commented on HDFS-11304: --- I am seeing this also in our environment after upgrading to HDP

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

2017-01-11 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819914#comment-15819914 ] Wei Zhou commented on HDFS-11186: - The unit test failures are not related to this patch. > [SPS]: Daemon

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819861#comment-15819861 ] Arpit Agarwal commented on HDFS-11316: -- +1 > TestDataNodeVolumeFailure fails frequently >

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819854#comment-15819854 ] Yiqun Lin commented on HDFS-11316: -- Thanks [~arpitagarwal], I am excited to have my first commit, :). I

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819839#comment-15819839 ] Arpit Agarwal commented on HDFS-11316: -- +1 pending Jenkins. I'll let you use your new committer bit

[jira] [Updated] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11316: - Attachment: HDFS-11316.002.patch > TestDataNodeVolumeFailure fails frequently >

[jira] [Updated] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11316: - Attachment: (was: HDFS-11316.002.patch) > TestDataNodeVolumeFailure fails frequently >

[jira] [Updated] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11316: - Attachment: HDFS-11316.002.patch > TestDataNodeVolumeFailure fails frequently >

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819835#comment-15819835 ] Yiqun Lin commented on HDFS-11316: -- Thanks [~arpitagarwal] for the review. The comment makes sense for

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2017-01-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819779#comment-15819779 ] Jing Zhao commented on HDFS-4025: - Thanks for updating the patch, [~hkoneru]. Some further comments: # We

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819717#comment-15819717 ] Andrew Wang commented on HDFS-10637: Similar question here as to on HDFS-10636, is this really an

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819714#comment-15819714 ] Andrew Wang commented on HDFS-10636: Question, is this JIRA actually incompatible? I did a quick skim,

[jira] [Commented] (HDFS-11259) Update fsck to display maintenance state info

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819709#comment-15819709 ] Andrew Wang commented on HDFS-11259: I took a quick look at this patch, it looks like it

[jira] [Updated] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11334: --- Summary: [SPS]: NN switch and rescheduling movements can lead to have more than one

[jira] [Commented] (HDFS-11259) Update fsck to display maintenance state info

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819681#comment-15819681 ] Andrew Wang commented on HDFS-11259: [~manojg] could you add a release note for this incompatible

[jira] [Updated] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

2017-01-11 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11335: -- Attachment: HDFS-11335.01.patch Attached v01 patch to remove redundant client threshold

[jira] [Updated] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

2017-01-11 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11335: -- Status: Patch Available (was: Open) > Remove

[jira] [Commented] (HDFS-11312) Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto

2017-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819626#comment-15819626 ] Junping Du commented on HDFS-11312: --- Merge to branch-2.8.0. > Fix incompatible tag number change for

[jira] [Created] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

2017-01-11 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11335: - Summary: Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf Key: HDFS-11335 URL: https://issues.apache.org/jira/browse/HDFS-11335

[jira] [Comment Edited] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-11 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819526#comment-15819526 ] Manoj Govindassamy edited comment on HDFS-10930 at 1/11/17 11:41 PM: -

[jira] [Updated] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10685: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to HDFS-8707.

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819548#comment-15819548 ] Hadoop QA commented on HDFS-7967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819544#comment-15819544 ] Hadoop QA commented on HDFS-11333: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11312) Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819535#comment-15819535 ] Hudson commented on HDFS-11312: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11109 (See

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819534#comment-15819534 ] Andrew Wang commented on HDFS-11170: Hi [~zhouwei], thanks for revving, haven't looked at the patch

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-11 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819526#comment-15819526 ] Manoj Govindassamy commented on HDFS-10930: --- Got it. Thanks [~arpitagarwal]. > Refactor: Wrap

[jira] [Comment Edited] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-11 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819522#comment-15819522 ] Manoj Govindassamy edited comment on HDFS-10930 at 1/11/17 11:27 PM: -

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819520#comment-15819520 ] Andrew Wang commented on HDFS-9260: --- FWIW this has been in a released version of CDH for 10 months, and

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-11 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819522#comment-15819522 ] Manoj Govindassamy commented on HDFS-10930: --- I did check ReplicaOutputStreams and

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819510#comment-15819510 ] Arpit Agarwal commented on HDFS-10930: -- Hi [~manojg], the log message was removed by HDFS-10958.

[jira] [Updated] (HDFS-11312) Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11312: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819480#comment-15819480 ] Xiaoyu Yao commented on HDFS-10930: --- [~manojg], the Slow logging was moved to ReplicaOutputStreams.java,

[jira] [Commented] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

2017-01-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819479#comment-15819479 ] Zhe Zhang commented on HDFS-8031: - Thanks for taking care of this Andrew! I think it's a good idea to move

[jira] [Updated] (HDFS-11312) Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11312: --- Summary: Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto (was: Discrepancy in

[jira] [Updated] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

2017-01-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8031: Assignee: (was: Zhe Zhang) > Follow-on work for erasure coding phase I (striping layout) >

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2017-01-11 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819461#comment-15819461 ] Manoj Govindassamy commented on HDFS-10930: --- [~xyao], [~arpitagarwal], When writing data to

[jira] [Updated] (HDFS-11334) Handle the case when NN switch and rescheduling movements can lead to have more than one coordinator for same file block

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11334: --- Description: I am summarizing the scenarios here what Rakesh and me discussed

[jira] [Created] (HDFS-11334) Handle the case when NN switch and rescheduling movements can lead to have more than one coordinator for same file block

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11334: -- Summary: Handle the case when NN switch and rescheduling movements can lead to have more than one coordinator for same file block Key: HDFS-11334 URL:

[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11333: --- Assignee: Wei-Chiu Chuang Status: Patch Available (was: Open) > Namenode unable to

[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11150: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11333: --- Labels: supportability (was: ) > Namenode unable to start if plugins can not be found >

[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11333: --- Attachment: HDFS-11333.001.patch Attach a patch with a simple unit test. > Namenode unable

[jira] [Created] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11333: -- Summary: Namenode unable to start if plugins can not be found Key: HDFS-11333 URL: https://issues.apache.org/jira/browse/HDFS-11333 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819282#comment-15819282 ] Uma Maheswara Rao G commented on HDFS-11150: +1 on the latest patch from me too. Committing to

[jira] [Commented] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819277#comment-15819277 ] Jitendra Nath Pandey commented on HDFS-11307: - Since {{getPortmapUdpTimeoutMillis}} is used

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-01-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819266#comment-15819266 ] Chris Nauroth commented on HDFS-11163: -- bq. ...HdfsLocatedFileStatus already has the resolved storage

[jira] [Commented] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

2017-01-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819253#comment-15819253 ] Konstantin Shvachko commented on HDFS-10733: +1 on the latest patch. Failed tests passed

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819157#comment-15819157 ] Ray Chiang commented on HDFS-11096: --- FYI, protobuf compatibility rules are documented at: [Protocol

[jira] [Commented] (HDFS-9409) DataNode shutdown does not guarantee full shutdown of all threads due to race condition.

2017-01-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819152#comment-15819152 ] Kihwal Lee commented on HDFS-9409: -- {{BlockScanner}} is the same way. It removes a thread from its

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Attachment: HDFS-7967.branch-2.8.003.patch One last time. Removed the yahoo stuff. > Reduce the

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818970#comment-15818970 ] Arpit Agarwal commented on HDFS-11316: -- Looks good, thanks for addressing this [~linyiqun]. I think

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818861#comment-15818861 ] Kihwal Lee commented on HDFS-7967: -- The 2.8 patch doesn't seem right. > Reduce the performance impact of

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818847#comment-15818847 ] Rakesh R commented on HDFS-11150: - Thanks [~yuanbo] for the continuous effort, +1 latest patch looks good

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818732#comment-15818732 ] Hadoop QA commented on HDFS-10391: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818670#comment-15818670 ] Hadoop QA commented on HDFS-11307: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-11317) Modify DataNodeDescriptor() to not call UpdateHeartBeatState

2017-01-11 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-11317: -- Summary: Modify DataNodeDescriptor() to not call UpdateHeartBeatState Key: HDFS-11317 URL: https://issues.apache.org/jira/browse/HDFS-11317 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Status: Open (was: Patch Available) > The rpc to portmap service for NFS has hardcoded

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Status: Patch Available (was: Open) > The rpc to portmap service for NFS has hardcoded

[jira] [Updated] (HDFS-11307) The rpc to portmap service for NFS has hardcoded timeout.

2017-01-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11307: - Attachment: HDFS-11307.002.patch handled checkstyle issue and added a unit test > The

[jira] [Commented] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD and unused import from HdfsServerConstants

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818482#comment-15818482 ] Hudson commented on HDFS-9935: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11106 (See

[jira] [Updated] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD and unused import from HdfsServerConstants

2017-01-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9935: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10391) Always enable NameNode service RPC port

2017-01-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-10391: - Hadoop Flags: Incompatible change Affects Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818419#comment-15818419 ] Hadoop QA commented on HDFS-11316: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10391) Always enable NameNode service RPC port

2017-01-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-10391: - Attachment: HDFS-10391.001.patch > Always enable NameNode service RPC port >

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-01-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818435#comment-15818435 ] Gergely Novák commented on HDFS-10391: -- Attached an initial patch for this. I'd really appreciate if

[jira] [Commented] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD and unused import from HdfsServerConstants

2017-01-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818434#comment-15818434 ] Brahma Reddy Battula commented on HDFS-9935: bq.If we're sure this change has no compatibility

[jira] [Assigned] (HDFS-10391) Always enable NameNode service RPC port

2017-01-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned HDFS-10391: Assignee: Gergely Novák (was: Arpit Agarwal) > Always enable NameNode service RPC port >

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-01-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818408#comment-15818408 ] Surendra Singh Lilhore commented on HDFS-11163: --- bq. If the storage policy is unspecified

[jira] [Commented] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818251#comment-15818251 ] Hadoop QA commented on HDFS-11186: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818213#comment-15818213 ] Yiqun Lin commented on HDFS-11316: -- Hi [~liuml07], do you have some further comments for this as I see

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818142#comment-15818142 ] Hadoop QA commented on HDFS-11150: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11316) TestDataNodeVolumeFailure fails frequently

2017-01-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11316: - Attachment: HDFS-11316.001.patch > TestDataNodeVolumeFailure fails frequently >

  1   2   >