[jira] [Comment Edited] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390881#comment-16390881 ] Weiwei Wu edited comment on HDFS-13212 at 3/8/18 7:54 AM: -- [~elgoiri], Thanks for

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390881#comment-16390881 ] Weiwei Wu commented on HDFS-13212: -- [~elgoiri], Thanks for you review.Update a new patch. > RBF: Fix

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Wu updated HDFS-13212: - Attachment: HDFS-13212-007.patch > RBF: Fix router location cache issue >

[jira] [Commented] (HDFS-13247) FileInputStream not closed when read the checksum header from the meta file

2018-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390867#comment-16390867 ] John Zhuge commented on HDFS-13247: --- Please check out 

[jira] [Created] (HDFS-13247) FileInputStream not closed when read the checksum header from the meta file

2018-03-07 Thread liaoyuxiangqin (JIRA)
liaoyuxiangqin created HDFS-13247: - Summary: FileInputStream not closed when read the checksum header from the meta file Key: HDFS-13247 URL: https://issues.apache.org/jira/browse/HDFS-13247 Project:

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390861#comment-16390861 ] genericqa commented on HDFS-13230: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.03.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Status: Patch Available (was: In Progress) > WebHdfs file path gets truncated when having

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Status: In Progress (was: Patch Available) > WebHdfs file path gets truncated when having

[jira] [Commented] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390849#comment-16390849 ] Yiqun Lin commented on HDFS-13240: -- Attach the patch to address all. > RBF: Update some inaccurate

[jira] [Updated] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13240: - Status: Patch Available (was: Open) > RBF: Update some inaccurate document descriptions >

[jira] [Updated] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13240: - Attachment: HDFS-13240.001.patch > RBF: Update some inaccurate document descriptions >

[jira] [Commented] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-07 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390833#comment-16390833 ] wangzhiyuan commented on HDFS-13233: Hi [~elgoiri], there is a little difference between patch 2 and

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390828#comment-16390828 ] Íñigo Goiri commented on HDFS-13212: Thanks [~wuweiwei] for [^HDFS-13212-006.patch]. I would check

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390820#comment-16390820 ] genericqa commented on HDFS-13212: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389833#comment-16389833 ] Íñigo Goiri edited comment on HDFS-13212 at 3/8/18 6:33 AM: Thanks [~wuweiwei]

[jira] [Updated] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-07 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13246: -- Attachment: HDFS-13246.001.patch > FileInputStream redundant closes in readReplicasFromCache >

[jira] [Updated] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-07 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13246: -- Status: Patch Available (was: Open) > FileInputStream redundant closes in

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390803#comment-16390803 ] SammiChen commented on HDFS-11600: -- Hi [~rakeshr], do you have time to help review the patch? >

[jira] [Created] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-07 Thread liaoyuxiangqin (JIRA)
liaoyuxiangqin created HDFS-13246: - Summary: FileInputStream redundant closes in readReplicasFromCache Key: HDFS-13246 URL: https://issues.apache.org/jira/browse/HDFS-13246 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390789#comment-16390789 ] genericqa commented on HDFS-13056: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2018-03-07 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390786#comment-16390786 ] lufei commented on HDFS-12999: -- It was my mistake to set this issue's fix version. [~leftnoteasy],thanks for

[jira] [Commented] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390772#comment-16390772 ] Zephyr Guo commented on HDFS-13243: --- Attach v2 patch to fix NoSuchMethodException > Get CorruptBlock

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated HDFS-13243: -- Attachment: HDFS-13243-v2.patch > Get CorruptBlock because of calling close and sync in same time >

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.03.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390739#comment-16390739 ] He Xiaoqiao commented on HDFS-13234: Thanks [~kihwal],[~elgoiri] for your comments. {quote}How big is

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390737#comment-16390737 ] genericqa commented on HDFS-13226: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390736#comment-16390736 ] genericqa commented on HDFS-11600: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13244) Add stack, conf, metrics links to utilities dropdown in NN webUI

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390734#comment-16390734 ] Ajay Kumar commented on HDFS-13244: --- +1 non-binding. tested in local machine. > Add stack, conf,

[jira] [Updated] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13230: Attachment: HDFS-13230.001.patch > RBF: ConnectionManager's cleanup task will compare each pool's own

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390730#comment-16390730 ] Chao Sun commented on HDFS-13230: - Thanks [~ywskycn] for taking a look. I think those two lines are within

[jira] [Created] (HDFS-13245) RBF: State store DBMS implementation

2018-03-07 Thread maobaolong (JIRA)
maobaolong created HDFS-13245: - Summary: RBF: State store DBMS implementation Key: HDFS-13245 URL: https://issues.apache.org/jira/browse/HDFS-13245 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390704#comment-16390704 ] Wangda Tan commented on HDFS-12999: --- [~figo], removed fix version, it should be only set by committer

[jira] [Updated] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12999: -- Fix Version/s: (was: 3.1.0) > When reach the end of the block group, it may not need to flush all

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390698#comment-16390698 ] Weiwei Wu commented on HDFS-13212: -- Add an assert to check the default location and fix the check style

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390697#comment-16390697 ] maobaolong commented on HDFS-13226: ---  My next patch will base on v003, let me complete the doc and test

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Wu updated HDFS-13212: - Attachment: HDFS-13212-006.patch > RBF: Fix router location cache issue >

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390628#comment-16390628 ] Yiqun Lin commented on HDFS-13226: -- {quote}and the end user really want to realize what mistake he has

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390621#comment-16390621 ] genericqa commented on HDFS-13230: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390619#comment-16390619 ] maobaolong commented on HDFS-13226: --- [~linyiqun] So, what about v003 patch, it fit the 

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Patch Available (was: Open) > Expose file-level composite CRCs in HDFS which are comparable

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390617#comment-16390617 ] Dennis Huo commented on HDFS-13056: --- Some observations - the FileSystem interface doesn't appear to

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Open (was: Patch Available) > Expose file-level composite CRCs in HDFS which are comparable

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056.008.patch > Expose file-level composite CRCs in HDFS which are comparable across

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056-branch-2.8.005.patch > Expose file-level composite CRCs in HDFS which are

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390615#comment-16390615 ] Yiqun Lin edited comment on HDFS-13226 at 3/8/18 2:25 AM: -- Just looking into the

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390615#comment-16390615 ] Yiqun Lin commented on HDFS-13226: -- Just looking into the v004 patch. I don't think it's a appropriate

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated HDFS-13243: -- Description: HDFS File might get broken because of corrupt block(s) that could be produced by calling

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated HDFS-13243: -- Summary: Get CorruptBlock because of calling close and sync in same time (was: File might get broken

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390595#comment-16390595 ] Íñigo Goiri commented on HDFS-13226: I'd be OK switching to using {void}, we intenrally don't have

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390570#comment-16390570 ] maobaolong commented on HDFS-13226: --- [~elgoiri] I think we should check the exception for the unit test,

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390566#comment-16390566 ] Íñigo Goiri commented on HDFS-13226: In [^HDFS-13226.004.patch], for the unit test, should we check

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390567#comment-16390567 ] maobaolong commented on HDFS-13226: --- As the Router has not been used widely, we maybe can correct this

[jira] [Updated] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13226: -- Attachment: HDFS-13226.004.patch HDFS-13226.003.patch > RBF: We should throw the

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390561#comment-16390561 ] genericqa commented on HDFS-13239: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390559#comment-16390559 ] Wei Yan commented on HDFS-13230: In general LGTM. Some minors: (1) We can just remove the "TODO" line,

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:06 AM: --- [~elgoiri] Yeah, i

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:04 AM: --- [~elgoiri] Yeah, i

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390543#comment-16390543 ] Íñigo Goiri commented on HDFS-13226: Let's keep the return to boolean for now; just for backwards

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:04 AM: --- [~elgoiri] Yeah, i

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:03 AM: --- [~elgoiri] Yeah, i

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.01.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390539#comment-16390539 ] Chao Sun commented on HDFS-13230: - Yes, I was going to complete that. The approach I was thinking is to

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390537#comment-16390537 ] maobaolong commented on HDFS-13226: --- [~elgoiri] Yeah, i think throw the IllegalArgumentException is the

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390523#comment-16390523 ] Íñigo Goiri commented on HDFS-13230: {quote} The cleanup method is actually moved out from CleanupTask

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390508#comment-16390508 ] Chao Sun commented on HDFS-13230: - Thanks [~elgoiri] for the review and explanations. The {{cleanup}}

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390446#comment-16390446 ] Íñigo Goiri commented on HDFS-13230: Thanks [~csun] for [^HDFS-13230.000.patch]. Can we leave

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390398#comment-16390398 ] Chao Sun commented on HDFS-13230: - Attaching patch v0. Found that I need to change a few places in the

[jira] [Updated] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13230: Status: Patch Available (was: Open) > RBF: ConnectionManager's cleanup task will compare each pool's own

[jira] [Updated] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13230: Attachment: HDFS-13230.000.patch > RBF: ConnectionManager's cleanup task will compare each pool's own

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390395#comment-16390395 ] genericqa commented on HDFS-11394: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390391#comment-16390391 ] Hudson commented on HDFS-13225: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13791 (See

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390388#comment-16390388 ] Wei Yan commented on HDFS-13232: Thanks [~elgoiri] > RBF: ConnectionPool should return first usable

[jira] [Assigned] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Ekanth S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ekanth S reassigned HDFS-13232: --- Assignee: Ekanth S (was: Wei Yan) > RBF: ConnectionPool should return first usable connection >

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390385#comment-16390385 ] Íñigo Goiri commented on HDFS-13232: Added, he should be able to assign himself to JIRAs now. > RBF:

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390380#comment-16390380 ] Wei Yan commented on HDFS-13232: [~elgoiri] could u help add  [~ekanth] to the contributor list? I think I

[jira] [Assigned] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned HDFS-13232: -- Assignee: Wei Yan > RBF: ConnectionPool should return first usable connection >

[jira] [Assigned] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned HDFS-13232: -- Assignee: (was: Wei Yan) > RBF: ConnectionPool should return first usable connection >

[jira] [Updated] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13225: -- Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13225: -- Fix Version/s: 3.2.0 3.0.2 > StripeReader#checkMissingBlocks() 's

[jira] [Updated] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13225: -- Fix Version/s: 3.1.0 > StripeReader#checkMissingBlocks() 's IOException info is incomplete >

[jira] [Commented] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390344#comment-16390344 ] Hanisha Koneru commented on HDFS-13225: --- Thanks for the contribution [~figo]. Committed to trunk,

[jira] [Commented] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390329#comment-16390329 ] Hanisha Koneru commented on HDFS-13225: --- Patch v02 LGTM. +1. > StripeReader#checkMissingBlocks() 's

[jira] [Updated] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13239: -- Status: Patch Available (was: In Progress) > Fix non-empty dir warning message when

[jira] [Updated] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13239: -- Attachment: HDFS-13239.00.patch > Fix non-empty dir warning message when setting

[jira] [Work started] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13239 started by Bharat Viswanadham. - > Fix non-empty dir warning message when setting default EC policy >

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390298#comment-16390298 ] Kihwal Lee commented on HDFS-13234: --- New conf objects are created to prevent unintended conf update

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390272#comment-16390272 ] Dennis Huo commented on HDFS-13056: --- Good catch, thanks for the report, [~ajayydv]. I actually do

[jira] [Commented] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390210#comment-16390210 ] Hudson commented on HDFS-13176: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13790 (See

[jira] [Commented] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390173#comment-16390173 ] Sean Mackrory commented on HDFS-13176: -- I've pushed this to trunk. This would be good in branch-2, as

[jira] [Comment Edited] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390170#comment-16390170 ] Ajay Kumar edited comment on HDFS-13056 at 3/7/18 8:34 PM: --- Hi [~dennishuo],

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390170#comment-16390170 ] Ajay Kumar commented on HDFS-13056: --- Hi [~dennishuo], Below test case fails with latest patch. # hdfs

[jira] [Commented] (HDFS-13241) RBF: TestRouterSafemode failed if the port 8888 is in use

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390161#comment-16390161 ] genericqa commented on HDFS-13241: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390147#comment-16390147 ] Kihwal Lee commented on HDFS-13234: --- bq. Configuration occupies over 600MB How big is a single instance

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390128#comment-16390128 ] Hanisha Koneru commented on HDFS-11394: --- I have posted patch v05 to move this forward. I am adding

[jira] [Updated] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11394: -- Attachment: HDFS-11394.005.patch > Add method for getting erasure coding policy through WebHDFS

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in EZ commands

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390109#comment-16390109 ] Hanisha Koneru commented on HDFS-13109: --- Thanks [~xyao] for committing the patch and all for the

[jira] [Commented] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390100#comment-16390100 ] Bharat Viswanadham commented on HDFS-13222: --- Thank You [~szetszwo] for review and committing the

[jira] [Commented] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390098#comment-16390098 ] Hudson commented on HDFS-13222: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13788 (See

[jira] [Commented] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390089#comment-16390089 ] Tsz Wo Nicholas Sze commented on HDFS-13222: I have committed this.  Thanks, Bharat! > Update

  1   2   >