[jira] [Created] (HDFS-12700) fix datanode link that can not be accessed in dfshealth.html

2017-10-24 Thread fang zhenyi (JIRA)
fang zhenyi created HDFS-12700: -- Summary: fix datanode link that can not be accessed in dfshealth.html Key: HDFS-12700 URL: https://issues.apache.org/jira/browse/HDFS-12700 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216371#comment-16216371 ] Hadoop QA commented on HDFS-12690: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216423#comment-16216423 ] Hadoop QA commented on HDFS-12692: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12700) Fix datanode link that can not be accessed in dfshealth.html

2017-10-24 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-12700: --- Summary: Fix datanode link that can not be accessed in dfshealth.html (was: fix datanode link

[jira] [Updated] (HDFS-12684) Ozone: SCMMXBean NodeCount is overlapping with NodeManagerMXBean

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12684: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-12700) Fix datanode link that can not be accessed in dfshealth.html

2017-10-24 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-12700: --- Status: Patch Available (was: Open) > Fix datanode link that can not be accessed in dfshealth.html

[jira] [Commented] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216399#comment-16216399 ] Hadoop QA commented on HDFS-12588: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12684) Ozone: SCMMXBean NodeCount is overlapping with NodeManagerMXBean

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216364#comment-16216364 ] Weiwei Yang commented on HDFS-12684: Thanks [~anu], the UT failures were not related to this patch, I

[jira] [Commented] (HDFS-12664) Ozone: Documentation: Add version specific documentation site to KSM

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216376#comment-16216376 ] Hadoop QA commented on HDFS-12664: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12700) Fix datanode link that can not be accessed in dfshealth.html

2017-10-24 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-12700: --- Attachment: HDFS-12700.000.patch > Fix datanode link that can not be accessed in dfshealth.html >

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216401#comment-16216401 ] Yiqun Lin commented on HDFS-11468: -- Thanks [~cheersyang], comments make sense to me. Attach the new

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Attachment: HDFS-11468-HDFS-7240.006.patch > Ozone: SCM: Add Node Metrics for SCM >

[jira] [Commented] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-24 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216606#comment-16216606 ] Lokesh Jain commented on HDFS-12521: This is a sample json output. There is no extra information

[jira] [Updated] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12310: -- Attachment: HDFS-12310-HDFS-10285-04.patch > [SPS]: Provide an option to track

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216656#comment-16216656 ] Surendra Singh Lilhore commented on HDFS-12310: --- Attached V4 patch.. bq. Please fix the

[jira] [Assigned] (HDFS-12046) Hadoop CRC implementation using Intel ISA-L library

2017-10-24 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12046: Assignee: SammiChen (was: luhuichun) > Hadoop CRC implementation using Intel ISA-L library >

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216485#comment-16216485 ] Hadoop QA commented on HDFS-12699: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-24 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216518#comment-16216518 ] Ewan Higgs commented on HDFS-12594: --- Some minor things on a first pass: {code} + if

[jira] [Commented] (HDFS-12700) Fix datanode link that can not be accessed in dfshealth.html

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216582#comment-16216582 ] Hadoop QA commented on HDFS-12700: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-24 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216606#comment-16216606 ] Lokesh Jain edited comment on HDFS-12521 at 10/24/17 10:22 AM: --- This is a

[jira] [Updated] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-24 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12678: --- Attachment: HDFS-12678-HDFS-7240.001.patch Added quantile statistics for volume create, bucket

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216706#comment-16216706 ] Hadoop QA commented on HDFS-11468: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12692: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Resolved] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin resolved HDFS-12691. -- Resolution: Later > Ozone: Decrease interval time of SCMBlockDeletingService for improving the >

[jira] [Updated] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-24 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12678: --- Status: Patch Available (was: Open) > Ozone: Corona: Add statistical information to json output >

[jira] [Commented] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216743#comment-16216743 ] Yiqun Lin commented on HDFS-12691: -- Agree on your proposal, [~cheersyang]. I'd like to close this JIRA

[jira] [Assigned] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-12443: Assignee: Yiqun Lin (was: Weiwei Yang) > Ozone: Improve SCM block deletion throttling algorithm

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216746#comment-16216746 ] Yiqun Lin commented on HDFS-12443: -- >From the discussion in HDFS-12691, reassign this JIRA to me. >

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216747#comment-16216747 ] Weiwei Yang commented on HDFS-11468: LGTM, +1 to the v6 patch, thanks [~linyiqun]. > Ozone: SCM: Add

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216760#comment-16216760 ] Weiwei Yang commented on HDFS-12443: Thanks for taking over [~linyiqun]. Some more background,

[jira] [Created] (HDFS-12701) More fine-grained locks in ShortCircuitCache

2017-10-24 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12701: -- Summary: More fine-grained locks in ShortCircuitCache Key: HDFS-12701 URL: https://issues.apache.org/jira/browse/HDFS-12701 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-12701) More fine-grained locks in ShortCircuitCache

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216795#comment-16216795 ] Weiwei Yang edited comment on HDFS-12701 at 10/24/17 12:20 PM: --- In a jstack

[jira] [Commented] (HDFS-12701) More fine-grained locks in ShortCircuitCache

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216795#comment-16216795 ] Weiwei Yang commented on HDFS-12701: In a jstack dump, there are more than 50 threads waiting on

[jira] [Updated] (HDFS-12701) More fine-grained locks in ShortCircuitCache

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12701: --- Affects Version/s: 3.0.0-beta1 > More fine-grained locks in ShortCircuitCache >

[jira] [Updated] (HDFS-12701) More fine-grained locks in ShortCircuitCache

2017-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12701: --- Description: When cluster is heavily loaded and short-circuit read is enabled, we found HBase

[jira] [Comment Edited] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217109#comment-16217109 ] Elek, Marton edited comment on HDFS-12678 at 10/24/17 3:30 PM: --- I am not

[jira] [Assigned] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton reassigned HDFS-12702: --- Assignee: Elek, Marton > Ozone: Add hugo to the dev docker image >

[jira] [Created] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12702: --- Summary: Ozone: Add hugo to the dev docker image Key: HDFS-12702 URL: https://issues.apache.org/jira/browse/HDFS-12702 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216988#comment-16216988 ] Hadoop QA commented on HDFS-12310: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12693) Ozone: Enable XFrame options for KSM/SCM web ui

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216991#comment-16216991 ] Elek, Marton commented on HDFS-12693: - yes, it could be useful when a cluster management tool (like

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217010#comment-16217010 ] Hadoop QA commented on HDFS-12594: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11807) libhdfs++: Get minidfscluster tests running under valgrind

2017-10-24 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-11807: - Attachment: HDFS-11807.HDFS-8707.002.patch In this patch I replaced getenv("USER") with

[jira] [Commented] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217109#comment-16217109 ] Elek, Marton commented on HDFS-12678: - I am not sure, but as I understood we need to import the NOTICE

[jira] [Commented] (HDFS-12684) Ozone: SCMMXBean NodeCount is overlapping with NodeManagerMXBean

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217012#comment-16217012 ] Elek, Marton commented on HDFS-12684: - Note: I checked the scm web ui it uses the SCMNodeManager bean

[jira] [Updated] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12702: Attachment: HDFS-12702-HDFS-7240.001.patch *DON'T COMMIT* the version 001, please I added an

[jira] [Updated] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12702: Status: Patch Available (was: Open) > Ozone: Add hugo to the dev docker image >

[jira] [Commented] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217144#comment-16217144 ] Hadoop QA commented on HDFS-12678: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12704) FBR may corrupt block state

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12704: -- Summary: FBR may corrupt block state Key: HDFS-12704 URL: https://issues.apache.org/jira/browse/HDFS-12704 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.01.patch > Ozone services must stay disabled in secure

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.01.patch > Ozone services must stay disabled in secure

[jira] [Created] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12705: -- Summary: WebHdfsFileSystem exceptions should retain the caused by exception Key: HDFS-12705 URL: https://issues.apache.org/jira/browse/HDFS-12705 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12704) FBR may corrupt block state

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217230#comment-16217230 ] Daryn Sharp commented on HDFS-12704: During a decomm of a faulty nodem the NNs frequently reported

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217252#comment-16217252 ] Íñigo Goiri commented on HDFS-12699: The failed unit tests is not related. branch-2 didn't build but

[jira] [Commented] (HDFS-11807) libhdfs++: Get minidfscluster tests running under valgrind

2017-10-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217316#comment-16217316 ] James Clampffer commented on HDFS-11807: Most recent change fixes the hang, thanks. Some

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217361#comment-16217361 ] Xiao Chen commented on HDFS-12482: -- Thanks Eddy for the new rev. Doc example looks great! Agree {{<=0}}

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-24 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217386#comment-16217386 ] Manoj Govindassamy commented on HDFS-12544: --- [~yzhangal], 1. Yes, just like the files moved out

[jira] [Commented] (HDFS-11743) Revert the incompatible fsck reporting output in HDFS-7933 from branch-2.7

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217178#comment-16217178 ] Zhe Zhang commented on HDFS-11743: -- Thanks [~xiaochen] and [~brahmareddy] for the discussion (and sorry I

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.00.patch > Ozone services must stay disabled in secure

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.01.patch) > Ozone services must stay

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.01.patch > Ozone services must stay disabled in secure

[jira] [Created] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12703: -- Summary: Exceptions are fatal to decommissioning monitor Key: HDFS-12703 URL: https://issues.apache.org/jira/browse/HDFS-12703 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Status: Patch Available (was: In Progress) > Ozone services must stay disabled in

[jira] [Commented] (HDFS-12700) Fix datanode link that can not be accessed in dfshealth.html

2017-10-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217397#comment-16217397 ] Arpit Agarwal commented on HDFS-12700: -- Hi [~zhenyi], it's generally better to use hostnames as they

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217222#comment-16217222 ] Hadoop QA commented on HDFS-12702: -- (!) A patch to the testing environment has been detected.

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.01.patch) > Ozone services must stay

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217402#comment-16217402 ] Daryn Sharp commented on HDFS-12638: Might want to investigate the lifecycle handling of

[jira] [Commented] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217588#comment-16217588 ] Wei-Chiu Chuang commented on HDFS-12686: Missed target version for this ec blocker. [~Sammi]

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217465#comment-16217465 ] Hadoop QA commented on HDFS-12697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDFS-12705: - Assignee: Hanisha Koneru > WebHdfsFileSystem exceptions should retain the caused by

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.01.patch) > Ozone services must stay

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.00.patch) > Ozone services must stay

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-12697-HDFS-7240.01.patch > Ozone services must stay disabled in secure

[jira] [Created] (HDFS-12706) Allow overriding HADOOP_SHELL_EXECNAME

2017-10-24 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-12706: Summary: Allow overriding HADOOP_SHELL_EXECNAME Key: HDFS-12706 URL: https://issues.apache.org/jira/browse/HDFS-12706 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12686: --- Target Version/s: 3.0.0 > Erasure coding system policy state is not correctly saved and

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217479#comment-16217479 ] Hadoop QA commented on HDFS-12702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Patch Available (was: Open) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Open (was: Patch Available) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Resolved] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-12686. -- Resolution: Duplicate Since HDFS-12682 should be able to handle this, and it's pretty hard to split

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217729#comment-16217729 ] Hadoop QA commented on HDFS-12482: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12705: -- Attachment: HDFS-12705.001.patch Thanks Daryn for filing the bug. Uploaded a simple patch to

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1621#comment-1621 ] Zhe Zhang commented on HDFS-12502: -- For some reason we were getting over 600k~700k FilesInGetListing per

[jira] [Updated] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12502: - Fix Version/s: (was: 3.1.0) (was: 3.0.0) (was: 2.8.3)

[jira] [Comment Edited] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1621#comment-1621 ] Zhe Zhang edited comment on HDFS-12502 at 10/24/17 10:07 PM: - For some reason

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217794#comment-16217794 ] Bharat Viswanadham commented on HDFS-12697: --- [~anu] Yes both are same. > Ozone services must

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2017-10-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217817#comment-16217817 ] John Zhuge commented on HDFS-3296: -- TestDomainSocket#testAsyncCloseDuringWrite failure: {noformat}

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217862#comment-16217862 ] Wei Yan commented on HDFS-12502: {quote} We should probably also extend fair call queue to consider the

[jira] [Commented] (HDFS-12653) Implement toArray() and subArray() for ReadOnlyList

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217697#comment-16217697 ] Daryn Sharp commented on HDFS-12653: How do you intend to use this with the inode attr provider? It

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217740#comment-16217740 ] Daryn Sharp commented on HDFS-12502: I'd prefer to see it reverted while we figure out how to add it

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-12697-HDFS-7240.02.patch > Ozone services must stay disabled in secure

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217788#comment-16217788 ] Anu Engineer commented on HDFS-12697: - +1 for version 4 in the review board. is the V2 patch here the

[jira] [Updated] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12702: Attachment: HDFS-12702-HDFS-7240.002.patch Final patch is uploaded. The previous one worked well

[jira] [Comment Edited] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1621#comment-1621 ] Zhe Zhang edited comment on HDFS-12502 at 10/24/17 9:59 PM: For some reason we

[jira] [Updated] (HDFS-12707) start-all script is missing ozone start

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12707: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-7240 > start-all script is

[jira] [Created] (HDFS-12707) start-all script is missing ozone start

2017-10-24 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12707: - Summary: start-all script is missing ozone start Key: HDFS-12707 URL: https://issues.apache.org/jira/browse/HDFS-12707 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217837#comment-16217837 ] Tsz Wo Nicholas Sze commented on HDFS-12594: Indeed, we have a few options here: #

[jira] [Assigned] (HDFS-12707) start-all script is missing ozone start

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12707: - Assignee: Bharat Viswanadham > start-all script is missing ozone start >

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217844#comment-16217844 ] Hadoop QA commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2017-10-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-3296: - Attachment: HDFS-3296.004.patch I'd like to share a patch I have been using. Not totally polished or

  1   2   >