[jira] [Created] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Fei Hui (JIRA)
Fei Hui created HDFS-9530: - Summary: huge Non-DFS Used in hadoop 2.6.2 & 2.7.1 Key: HDFS-9530 URL: https://issues.apache.org/jira/browse/HDFS-9530 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048384#comment-15048384 ] Fei Hui commented on HDFS-9530: --- i want to add logs to monitor DataNode DFS Used, Non DFS Used,and so on. how

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-10 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050286#comment-15050286 ] Fei Hui commented on HDFS-9530: --- [hdfs@worker-1 ~]$ hadoop version Hadoop 2.6.2 and i am sure it also

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-10 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050453#comment-15050453 ] Fei Hui commented on HDFS-9530: --- dfs.namenode.resource.du.reserved 1073741824 > huge Non-DFS

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-10 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052235#comment-15052235 ] Fei Hui commented on HDFS-9530: --- useful information, jmx result conflicts with df "VolumeInfo" :

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-16 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059761#comment-15059761 ] Fei Hui commented on HDFS-9530: --- freeSpace conflicts with df putputs where is freeSpace code? maybe there is

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-16 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059760#comment-15059760 ] Fei Hui commented on HDFS-9530: --- freeSpace conflicts with df putputs where is freeSpace code? maybe there is

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-03-09 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186922#comment-15186922 ] Fei Hui commented on HDFS-9530: --- while job running, the df output is above.there is no non-dfs used, that is

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-03-09 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186836#comment-15186836 ] Fei Hui commented on HDFS-9530: --- execute df & dfs report in order after the job finished, non dfs usage is

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-03-09 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186764#comment-15186764 ] Fei Hui commented on HDFS-9530: --- maybe it's different from HDFS-9038. the example in description,

[jira] [Commented] (HDFS-13710) RBF: setQuota and getQuotaUsage should check the dfs.federation.router.quota.enable

2018-07-01 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529332#comment-16529332 ] Fei Hui commented on HDFS-13710: good catch ! [~elgoiri] [~linyiqun] Could you give any suggestions ? >

[jira] [Commented] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-08 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574175#comment-16574175 ] Fei Hui commented on HDFS-13802: [~elgoiri] Thanks. I will try to implement the router fsck > RBF:

[jira] [Updated] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13802: --- Attachment: HDFS-13802.001.patch > RBF: Remove FSCK from Router Web UI, because fsck is not supported

[jira] [Resolved] (HDFS-13803) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui resolved HDFS-13803. Resolution: Invalid > RBF: Remove FSCK from Router Web UI, because fsck is not supported currently >

[jira] [Created] (HDFS-13803) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
Fei Hui created HDFS-13803: -- Summary: RBF: Remove FSCK from Router Web UI, because fsck is not supported currently Key: HDFS-13803 URL: https://issues.apache.org/jira/browse/HDFS-13803 Project: Hadoop HDFS

[jira] [Created] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
Fei Hui created HDFS-13802: -- Summary: RBF: Remove FSCK from Router Web UI, because fsck is not supported currently Key: HDFS-13802 URL: https://issues.apache.org/jira/browse/HDFS-13802 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572660#comment-16572660 ] Fei Hui commented on HDFS-13802: [~linyiqun] Could you please take a look ? Thanks > RBF: Remove FSCK

[jira] [Updated] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-07 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13802: --- Status: Patch Available (was: Open) > RBF: Remove FSCK from Router Web UI, because fsck is not supported

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583469#comment-16583469 ] Fei Hui commented on HDFS-13821: [~elgoiri] Here's my testing result about localcache {code:java} hadoop

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.002.patch > RBF: Add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583567#comment-16583567 ] Fei Hui commented on HDFS-13821: [~elgoiri] [~linyiqun] Thanks for so meaningful discussions ! Upload

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.003.patch > RBF: Add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583793#comment-16583793 ] Fei Hui commented on HDFS-13821: [~elgoiri] Thanks. Fix the code according to your suggestions and fix

[jira] [Updated] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Status: Patch Available (was: Open) > RBF:add dfs.federation.router.mount-table.cache.enable so that users

[jira] [Commented] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577796#comment-16577796 ] Fei Hui commented on HDFS-13821: [~linyiqun] [~elgoiri] Could you please take a look? Thanks > RBF:add

[jira] [Commented] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577855#comment-16577855 ] Fei Hui commented on HDFS-13821: [~linyiqun] Test is a MR job which just does *ls* operations. This cache

[jira] [Updated] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Description: When i test rbf, if found performance problem. I found that ProxyAvgTime From Ganglia is so

[jira] [Created] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
Fei Hui created HDFS-13821: -- Summary: RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache Key: HDFS-13821 URL: https://issues.apache.org/jira/browse/HDFS-13821 Project:

[jira] [Updated] (HDFS-13821) RBF:add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.001.patch > RBF:add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-13 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578110#comment-16578110 ] Fei Hui commented on HDFS-13821: [~elgoiri] Profiling LocalCache is interesing, should we adress a new

[jira] [Commented] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-08 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573022#comment-16573022 ] Fei Hui commented on HDFS-13802: CC [~elgoiri] > RBF: Remove FSCK from Router Web UI, because fsck is

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-14 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579955#comment-16579955 ] Fei Hui commented on HDFS-13821: [~elgoiri] Thanks for your reply. {quote} The hit ratio of the cache

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-14 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: LocalCacheTest.java > RBF: Add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-20 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16586151#comment-16586151 ] Fei Hui commented on HDFS-13821: [~linyiqun] Thanks for detail comments Upload v008 patch > RBF: Add

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-20 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.008.patch > RBF: Add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Status: Patch Available (was: Open) > RBF: Add dfs.federation.router.mount-table.cache.enable so that users

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Status: Open (was: Patch Available) > RBF: Add dfs.federation.router.mount-table.cache.enable so that users

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Status: Patch Available (was: Open) > RBF: Add dfs.federation.router.mount-table.cache.enable so that users

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584143#comment-16584143 ] Fei Hui commented on HDFS-13821: Errors come from HDFS-13790 > RBF: Add

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-17 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Status: Open (was: Patch Available) > RBF: Add dfs.federation.router.mount-table.cache.enable so that users

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-22 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588530#comment-16588530 ] Fei Hui commented on HDFS-13821: [~linyiqun][~elgoiri] Thanks for review & commit > RBF: Add

[jira] [Updated] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-24 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13863: --- Status: Patch Available (was: Open) > FsDatasetImpl should log DiskOutOfSpaceException >

[jira] [Updated] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13863: --- Attachment: HDFS-13863.003.patch > FsDatasetImpl should log DiskOutOfSpaceException >

[jira] [Commented] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594792#comment-16594792 ] Fei Hui commented on HDFS-13863: [~linyiqun] Got it ! Upload v003 patch > FsDatasetImpl should log

[jira] [Commented] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594766#comment-16594766 ] Fei Hui commented on HDFS-13863: [~linyiqun] Thanks for you comments. Two cases with

[jira] [Comment Edited] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594766#comment-16594766 ] Fei Hui edited comment on HDFS-13863 at 8/28/18 9:48 AM: - [~linyiqun] Thanks for

[jira] [Commented] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595820#comment-16595820 ] Fei Hui commented on HDFS-13863: [~jojochuang] Thanks. {quote} It would be even better if the code that

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-20 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.006.patch Upload v006 patch fix checkstyle > RBF: Add

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-19 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585348#comment-16585348 ] Fei Hui commented on HDFS-13821: [~elgoiri] Thanks. Change the default value and add a unit test

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-19 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.004.patch > RBF: Add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-19 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585401#comment-16585401 ] Fei Hui commented on HDFS-13821: Upload v005 fix checkstyle > RBF: Add

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-19 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.005.patch > RBF: Add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Commented] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-20 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585749#comment-16585749 ] Fei Hui commented on HDFS-13821: [~linyiqun] Thanks. Upload v007 patch according to your suggestions >

[jira] [Updated] (HDFS-13821) RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache

2018-08-20 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13821: --- Attachment: HDFS-13821.007.patch > RBF: Add dfs.federation.router.mount-table.cache.enable so that users can

[jira] [Commented] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-27 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594409#comment-16594409 ] Fei Hui commented on HDFS-13863: [~arpitagarwal] Thanks for your review. Agree that stack trace impact

[jira] [Updated] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-27 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13863: --- Attachment: HDFS-13863.002.patch > FsDatasetImpl should log DiskOutOfSpaceException >

[jira] [Commented] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-08-22 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589673#comment-16589673 ] Fei Hui commented on HDFS-13802: [~elgoiri][~linyiqun] Are you sure we should support FSCK on WebUI? In

[jira] [Created] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-24 Thread Fei Hui (JIRA)
Fei Hui created HDFS-13863: -- Summary: FsDatasetImpl should log DiskOutOfSpaceException Key: HDFS-13863 URL: https://issues.apache.org/jira/browse/HDFS-13863 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-24 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13863: --- Attachment: HDFS-13863.001.patch > FsDatasetImpl should log DiskOutOfSpaceException >

[jira] [Commented] (HDFS-13863) FsDatasetImpl should log DiskOutOfSpaceException

2018-08-24 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591527#comment-16591527 ] Fei Hui commented on HDFS-13863: Upload the simple patch. [~jzhuge] Could you please take a look ? >

[jira] [Commented] (HDFS-13989) RBF: Add FSCK to the Router

2018-10-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648747#comment-16648747 ] Fei Hui commented on HDFS-13989: [~elgoiri] Thanks. Got it > RBF: Add FSCK to the Router >

[jira] [Commented] (HDFS-13802) RBF: Remove FSCK from Router Web UI, because fsck is not supported currently

2018-10-12 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647638#comment-16647638 ] Fei Hui commented on HDFS-13802: Hi [~elgoiri], i find that there is no fsck on namenode WebUI. And

[jira] [Commented] (HDFS-9411) HDFS NodeLabel support

2018-10-26 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664914#comment-16664914 ] Fei Hui commented on HDFS-9411: --- [~vinayrpet] Feature is pretty good. Is there any update on this ? > HDFS

[jira] [Comment Edited] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631669#comment-16631669 ] Fei Hui edited comment on HDFS-13248 at 9/28/18 10:26 AM: -- [~elgoiri] I modify

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631669#comment-16631669 ] Fei Hui commented on HDFS-13248: [~elgoiri] I modify the code , please take a look. {quote} I think we

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13248: --- Attachment: HDFS-13248.003.patch > RBF: Namenode need to choose block location for the client >

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13248: --- Attachment: HDFS-13248.005.patch > RBF: Namenode need to choose block location for the client >

[jira] [Reopened] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui reopened HDFS-13293: Assignee: Fei Hui > RBF: The RouterRPCServer should transfer CallerContext and client ip to >

[jira] [Updated] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13293: --- Status: Patch Available (was: Reopened) > RBF: The RouterRPCServer should transfer CallerContext and client

[jira] [Updated] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13293: --- Attachment: HDFS-13293.001.patch > RBF: The RouterRPCServer should transfer CallerContext and client ip to

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623382#comment-16623382 ] Fei Hui commented on HDFS-13293: Talk with [~elgoiri] online. It's necessary that namenode logs real ip

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623392#comment-16623392 ] Fei Hui commented on HDFS-13293: Tests are following: Add configuration to namenode {code:java}

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623385#comment-16623385 ] Fei Hui commented on HDFS-13293: Upload v001 patch. Refer to HDFS-13248 POC patch [~elgoiri] Could you

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624503#comment-16624503 ] Fei Hui commented on HDFS-13293: [~elgoiri] ClientProtocol code about addBlock is following {code:java}

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624498#comment-16624498 ] Fei Hui commented on HDFS-13293: [~elgoiri] My idea is that there are two issues, one is that namenode

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-25 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627253#comment-16627253 ] Fei Hui commented on HDFS-13248: Another approach for hdfs locality. Think about the parameter

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-25 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13248: --- Attachment: HDFS-13248.002.patch > RBF: Namenode need to choose block location for the client >

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2018-09-25 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626969#comment-16626969 ] Fei Hui commented on HDFS-13293: [~elgoiri] Making the separator configurable is better as [~ajayydv]

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-25 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13248: --- Status: Patch Available (was: Open) > RBF: Namenode need to choose block location for the client >

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-26 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628461#comment-16628461 ] Fei Hui commented on HDFS-13248: {quote} How does the rack locality and so on work in this case? Would it

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-19 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620495#comment-16620495 ] Fei Hui commented on HDFS-13248: [~elgoiri] Before resolving this issue, i think it's meaningful that

[jira] [Commented] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632109#comment-16632109 ] Fei Hui commented on HDFS-13248: Upload v004 Add a unit test for addBlock with Namenode and Router. >

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2018-09-28 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13248: --- Attachment: HDFS-13248.004.patch > RBF: Namenode need to choose block location for the client >

[jira] [Commented] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-01 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731723#comment-16731723 ] Fei Hui commented on HDFS-13856: [~Weiwei Yang] could you please ask somebody for reviewing this ? Thanks

[jira] [Comment Edited] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-01 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731723#comment-16731723 ] Fei Hui edited comment on HDFS-13856 at 1/2/19 1:57 AM: [~cheersyang] could you

[jira] [Updated] (HDFS-14161) RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection

2019-01-01 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14161: --- Attachment: HDFS-14161-HDFS-13891.006.patch > RBF: Throw StandbyException instead of IOException so that

[jira] [Commented] (HDFS-14161) RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection

2019-01-01 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731738#comment-16731738 ] Fei Hui commented on HDFS-14161: [~elgoiri] Upload v006 patch * add space for line 437 of RouterRpcClient

[jira] [Updated] (HDFS-14161) RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection

2019-01-02 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14161: --- Attachment: (was: HDFS-14161-HDFS-13891.006.patch) > RBF: Throw StandbyException instead of IOException

[jira] [Updated] (HDFS-14161) RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection

2019-01-02 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14161: --- Attachment: HDFS-14161-HDFS-13891.006.patch > RBF: Throw StandbyException instead of IOException so that

[jira] [Updated] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-04 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13856: --- Status: Patch Available (was: Open) > RBF: RouterAdmin should support dfsrouteradmin -refresh command >

[jira] [Updated] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-04 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13856: --- Status: Open (was: Patch Available) > RBF: RouterAdmin should support dfsrouteradmin -refresh command >

[jira] [Commented] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-05 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734831#comment-16734831 ] Fei Hui commented on HDFS-13856: Failed tests are unrelated. [~ayushtkn] could you please take a look at

[jira] [Updated] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-02 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13856: --- Attachment: HDFS-13856-HDFS-13891.003.patch > RBF: RouterAdmin should support dfsrouteradmin -refresh

[jira] [Commented] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-02 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732584#comment-16732584 ] Fei Hui commented on HDFS-13856: [~ayushtkn] Upload v003 patch. Add the command to HDFSCommands.md

[jira] [Updated] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-06 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13856: --- Status: Patch Available (was: Open) > RBF: RouterAdmin should support dfsrouteradmin -refresh command >

[jira] [Updated] (HDFS-13856) RBF: RouterAdmin should support dfsrouteradmin -refresh command

2019-01-06 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-13856: --- Status: Open (was: Patch Available) > RBF: RouterAdmin should support dfsrouteradmin -refresh command >

[jira] [Commented] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

2019-01-16 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743888#comment-16743888 ] Fei Hui commented on HDFS-13596: Any updates for this? > NN restart fails after RollingUpgrade from 2.x

[jira] [Updated] (HDFS-14207) ZKFC should catch exception when ha configuration missing

2019-01-15 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14207: --- Attachment: HDFS-14207.001.patch > ZKFC should catch exception when ha configuration missing >

[jira] [Created] (HDFS-14207) ZKFC should catch exception when ha configuration missing

2019-01-15 Thread Fei Hui (JIRA)
Fei Hui created HDFS-14207: -- Summary: ZKFC should catch exception when ha configuration missing Key: HDFS-14207 URL: https://issues.apache.org/jira/browse/HDFS-14207 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-14207) ZKFC should catch exception when ha configuration missing

2019-01-15 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14207: --- Attachment: (was: HDFS-14207.001.patch) > ZKFC should catch exception when ha configuration missing >

  1   2   3   4   5   6   7   >