[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952055#comment-15952055 ] Hadoop QA commented on HDFS-11519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951976#comment-15951976 ] Tsz Wo Nicholas Sze edited comment on HDFS-11519 at 4/1/17 3:41 AM:

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Attachment: HDFS-11519-HDFS-7240.20170401.patch > Ozone: Implement XceiverServerSpi

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Attachment: (was: HDFS-11519-HDFS-7240.20170401.patch) > Ozone: Implement

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Attachment: HDFS-11519-HDFS-7240.20170401.patch HDFS-11519-HDFS-7240.20170401.patch:

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951975#comment-15951975 ] Tsz Wo Nicholas Sze commented on HDFS-11519: Thanks for the comments, [~xyao]. > Line 44:

[jira] [Commented] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951952#comment-15951952 ] Hadoop QA commented on HDFS-10706: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-03-31 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951943#comment-15951943 ] SammiChen commented on HDFS-11604: -- Thanks Kai for the comments! bq. We need a header as comment to list

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951928#comment-15951928 ] Hadoop QA commented on HDFS-10533: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11607) minor change in HDFS Erasure Coding document

2017-03-31 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951895#comment-15951895 ] Yeliang Cang commented on HDFS-11607: - [~andrew.wang]], yes, it is indeed ambiguous. But I still think

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: (was: HDFS-10533.0012.patch) > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.0012.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.012.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: (was: HDFS-10533.0012.patch) > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.0012.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Status: Open (was: Patch Available) > Add tool generating FSImage from external store

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Status: Patch Available (was: Open) > Add tool generating FSImage from external store

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Attachment: HDFS-10706-HDFS-9806.005.patch Fixed checkstyle issues. > Add tool

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-03-31 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951891#comment-15951891 ] Kai Zheng commented on HDFS-11604: -- Some comments: * We can use the name {{ec_policy_sample.xml}}

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-03-31 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951882#comment-15951882 ] Kai Zheng commented on HDFS-11604: -- Thanks [~Sammi] for the quick work. For each discussion, put the

[jira] [Comment Edited] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-03-31 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951882#comment-15951882 ] Kai Zheng edited comment on HDFS-11604 at 4/1/17 12:53 AM: --- Thanks [~Sammi] for

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951876#comment-15951876 ] Hadoop QA commented on HDFS-10533: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11598) Improve -setrep for Erasure Coded files

2017-03-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951830#comment-15951830 ] Wei-Chiu Chuang commented on HDFS-11598: Hello [~linyiqun] thanks for your quick patch! This is

[jira] [Commented] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951824#comment-15951824 ] Hadoop QA commented on HDFS-11582: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.011.patch > Make DistCpOptions class immutable >

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951818#comment-15951818 ] Mingliang Liu commented on HDFS-10533: -- I'll commit after another clean Jenkins run. > Make

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.0011.patch > Make DistCpOptions class immutable >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: (was: HDFS-10533.0011.patch) > Make DistCpOptions class immutable >

[jira] [Commented] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951806#comment-15951806 ] Hadoop QA commented on HDFS-10706: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11564) Ozone: SCM: Add Comparable Metric Support

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951797#comment-15951797 ] Hadoop QA commented on HDFS-11564: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951793#comment-15951793 ] Xiaobing Zhou commented on HDFS-11608: -- You are right [~xyao], thanks, I've made the change in place.

[jira] [Comment Edited] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951715#comment-15951715 ] Xiaobing Zhou edited comment on HDFS-11608 at 3/31/17 11:17 PM: After some

[jira] [Commented] (HDFS-11515) -du throws ConcurrentModificationException

2017-03-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951783#comment-15951783 ] Wei-Chiu Chuang commented on HDFS-11515: The latest patch is good, and I just saw a few nits: In

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951768#comment-15951768 ] Hadoop QA commented on HDFS-10533: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951756#comment-15951756 ] Hadoop QA commented on HDFS-11608: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951730#comment-15951730 ] Xiaoyu Yao commented on HDFS-11608: --- Thanks for the analysis [~xiaobingo]. bq. i.e. bodySize is

[jira] [Updated] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11608: - Status: Patch Available (was: Open) > HDFS write crashed in the case of huge block size >

[jira] [Updated] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11608: - Attachment: HDFS-11608.000.patch Posted initial patch, will try to add some tests in the next. >

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2017-03-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.010.patch Rebase from {{trunk}} and resolve conflicts with [HADOOP-11794].

[jira] [Commented] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951715#comment-15951715 ] Xiaobing Zhou commented on HDFS-11608: -- After some debugging, it turns out it's related to Integer

[jira] [Updated] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-03-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11582: -- Attachment: HDFS-11582-HDFS-7240.005.patch Thanks [~msingh] for the comments! Post v005 patch to

[jira] [Updated] (HDFS-11591) Block Storage: fix TestCBlockServer test cleanup

2017-03-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11591: -- Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 > Block Storage: fix TestCBlockServer test cleanup

[jira] [Commented] (HDFS-11190) Namenode support for data stored in external stores.

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951697#comment-15951697 ] Hadoop QA commented on HDFS-11190: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11062) Ozone:SCM: Explore if we can remove nullcommand

2017-03-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951690#comment-15951690 ] Xiaoyu Yao commented on HDFS-11062: --- Thanks [~yuanbo] for working on this. The patch looks good to me

[jira] [Updated] (HDFS-11591) Block Storage: fix TestCBlockServer test cleanup

2017-03-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11591: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Block Storage: fix

[jira] [Commented] (HDFS-11591) Block Storage: fix TestCBlockServer test cleanup

2017-03-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951684#comment-15951684 ] Chen Liang commented on HDFS-11591: --- +1, the failed tests are unrelated. committed to the feature

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Status: Patch Available (was: Open) > Add tool generating FSImage from external store

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Status: Open (was: Patch Available) > Add tool generating FSImage from external store

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Attachment: HDFS-10706-HDFS-9806.004.patch Made some minor changes to the earlier patch

[jira] [Updated] (HDFS-11564) Ozone: SCM: Add Comparable Metric Support

2017-03-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11564: Attachment: HDFS-11564-HDFS-7240.004.patch [~xyao] Thanks for the review. I have updated the patch

[jira] [Commented] (HDFS-11560) Expose slow disks via NameNode JMX

2017-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951664#comment-15951664 ] Hudson commented on HDFS-11560: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11511 (See

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Status: Patch Available (was: Open) > Namenode support for data stored in external

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Status: Open (was: Patch Available) > Namenode support for data stored in external

[jira] [Commented] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951636#comment-15951636 ] Hudson commented on HDFS-11603: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11510 (See

[jira] [Commented] (HDFS-11566) Ozone: Document missing metrics for container operations

2017-03-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951628#comment-15951628 ] Xiaoyu Yao commented on HDFS-11566: --- Agree with [~anu]. There is a metrics.md in the reference section

[jira] [Updated] (HDFS-11560) Expose slow disks via NameNode JMX

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11560: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Comment Edited] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-03-31 Thread Karan Mehta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951482#comment-15951482 ] Karan Mehta edited comment on HDFS-11583 at 3/31/17 8:45 PM: - Just for FYI,

[jira] [Updated] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951594#comment-15951594 ] Hadoop QA commented on HDFS-11603: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11609) Some blocks can be permanently lost if nodes are decommissioned while dead

2017-03-31 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951587#comment-15951587 ] Kihwal Lee commented on HDFS-11609: --- h3. Inability to correctly guess the previous replication priority

[jira] [Commented] (HDFS-11560) Expose slow disks via NameNode JMX

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951571#comment-15951571 ] Hadoop QA commented on HDFS-11560: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951495#comment-15951495 ] Hadoop QA commented on HDFS-11603: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11607) minor change in HDFS Erasure Coding document

2017-03-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951493#comment-15951493 ] Andrew Wang commented on HDFS-11607: I think it's ambiguous, since wikipedia says it abbreviates to

[jira] [Comment Edited] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-03-31 Thread Karan Mehta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951482#comment-15951482 ] Karan Mehta edited comment on HDFS-11583 at 3/31/17 6:53 PM: - Just for FYI,

[jira] [Commented] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-03-31 Thread Karan Mehta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951482#comment-15951482 ] Karan Mehta commented on HDFS-11583: Just for FYI, Current Phoenix uses HBase-1.2.3 and Hadoop -

[jira] [Commented] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951472#comment-15951472 ] Arpit Agarwal commented on HDFS-11608: -- Thanks for reporting this [~xiaobingo]. Here are the client

[jira] [Commented] (HDFS-11564) Ozone: SCM: Add Comparable Metric Support

2017-03-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951471#comment-15951471 ] Xiaoyu Yao commented on HDFS-11564: --- Thanks [~anu] for working on this. The patch looks good to me

[jira] [Commented] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951470#comment-15951470 ] Xiaobing Zhou commented on HDFS-11608: -- Posted it [~jojochuang], thanks. > HDFS write crashed in the

[jira] [Commented] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-03-31 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951468#comment-15951468 ] Jitendra Nath Pandey commented on HDFS-11603: - +1 > Improve slow mirror/disk warnings in

[jira] [Updated] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11608: - Description: We've seen HDFS write crashes in the case of huge block size. For example, writing

[jira] [Updated] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11608: - Description: We've seen HDFS write crashes in the case of huge block size. For example, writing

[jira] [Assigned] (HDFS-11609) Some blocks can be permanently lost if nodes are decommissioned while dead

2017-03-31 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-11609: - Assignee: Kihwal Lee > Some blocks can be permanently lost if nodes are decommissioned while

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2017-03-31 Thread Karan Mehta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951461#comment-15951461 ] Karan Mehta commented on HDFS-7054: --- bq. detach should be used here to pass responsibility to close the

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2017-03-31 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951459#comment-15951459 ] Daryn Sharp commented on HDFS-9260: --- I have no doubt this patch "works". If you are collecting GC

[jira] [Created] (HDFS-11609) Some blocks can be permanently lost if nodes are decommissioned while dead

2017-03-31 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11609: - Summary: Some blocks can be permanently lost if nodes are decommissioned while dead Key: HDFS-11609 URL: https://issues.apache.org/jira/browse/HDFS-11609 Project: Hadoop

[jira] [Updated] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Description: The slow mirror warnings in the DataNode BlockReceiver should include the

[jira] [Updated] (HDFS-11603) Make slow mirror/disk warnings in BlockReceiver more useful

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Attachment: HDFS-11603.03.patch Good point. The v03 patch logs all the downstream DataNodes. >

[jira] [Updated] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Summary: Improve slow mirror/disk warnings in BlockReceiver (was: Make slow mirror/disk warnings

[jira] [Commented] (HDFS-10848) Move hadoop-hdfs-native-client module into hadoop-hdfs-client

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951447#comment-15951447 ] Hadoop QA commented on HDFS-10848: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11557) Empty directories may be recursively deleted without being listable

2017-03-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951442#comment-15951442 ] Chen Liang commented on HDFS-11557: --- Interesting to see there seems to be a difference between "rm -r"

[jira] [Commented] (HDFS-11560) Expose slow disks via NameNode JMX

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951436#comment-15951436 ] Arpit Agarwal commented on HDFS-11560: -- Thanks [~hanishakoneru]. +1 for the v2 patch, pending

[jira] [Updated] (HDFS-11560) Expose slow disks via NameNode JMX

2017-03-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11560: -- Attachment: HDFS-11560.002.patch Thank you [~arpitagarwal]. I have fixed the unit test in patch

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Attachment: HDFS-11190-HDFS-9806.001.patch > Namenode support for data stored in

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Attachment: (was: HDFS-11190-HDFS-9806.001.patch) > Namenode support for data

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Status: Patch Available (was: Open) > Namenode support for data stored in external

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951414#comment-15951414 ] Konstantin Shvachko commented on HDFS-11384: Yup, I was thinking the same last night. You need

[jira] [Commented] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951391#comment-15951391 ] Wei-Chiu Chuang commented on HDFS-11608: Hello [~xiaobingo]. Thanks for filing the jira. If it is

[jira] [Comment Edited] (HDFS-11603) Make slow mirror/disk warnings in BlockReceiver more useful

2017-03-31 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951380#comment-15951380 ] Jitendra Nath Pandey edited comment on HDFS-11603 at 3/31/17 5:54 PM: --

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951389#comment-15951389 ] Anu Engineer commented on HDFS-11519: - +1 from me too. [~szetszwo] This is a huge step for Ozone.

[jira] [Commented] (HDFS-11603) Make slow mirror/disk warnings in BlockReceiver more useful

2017-03-31 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951380#comment-15951380 ] Jitendra Nath Pandey commented on HDFS-11603: - +1 for the patch. > Make slow mirror/disk

[jira] [Updated] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11608: - Affects Version/s: 2.8.0 > HDFS write crashed in the case of huge block size >

[jira] [Updated] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11608: - Component/s: hdfs-client > HDFS write crashed in the case of huge block size >

[jira] [Created] (HDFS-11608) HDFS write crashed in the case of huge block size

2017-03-31 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11608: Summary: HDFS write crashed in the case of huge block size Key: HDFS-11608 URL: https://issues.apache.org/jira/browse/HDFS-11608 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2017-03-31 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951366#comment-15951366 ] Virajith Jalaparti commented on HDFS-6708: -- Yes, {{TestDataNodeVolumeFailureReporting}} times out

[jira] [Updated] (HDFS-10848) Move hadoop-hdfs-native-client module into hadoop-hdfs-client

2017-03-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10848: --- Status: Patch Available (was: Open) Thanks for the patch. Submitted it for you to trigger

[jira] [Updated] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Attachment: storage-container-manager-cli-v002.pdf Uploading v2 of the design spec. This revision

[jira] [Commented] (HDFS-11356) figure out what to do about hadoop-hdfs-project/hadoop-hdfs/src/main/native

2017-03-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951335#comment-15951335 ] Wei-Chiu Chuang commented on HDFS-11356: Hi Allen, thanks for the comment. bq. I believe the

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951322#comment-15951322 ] Xiaoyu Yao commented on HDFS-11519: --- Thanks [~szetszwo] for working on this. The latest patch looks

[jira] [Updated] (HDFS-11603) Make slow mirror/disk warnings in BlockReceiver more useful

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Attachment: HDFS-11603.02.patch v2 patch addresses the checkstyle and whitespace issues. The

[jira] [Commented] (HDFS-11560) Expose slow disks via NameNode JMX

2017-03-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951263#comment-15951263 ] Arpit Agarwal commented on HDFS-11560: -- The patch lgtm. One comment on the unit test. In

  1   2   >