[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-01 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565399#comment-16565399 ] Jinglun commented on HDFS-10240: [~jojochuang] [~sinago] got it, i will post one in 3 days. > Race

[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568158#comment-16568158 ] Jinglun commented on HDFS-10240: hi [~jojochuang], I thought patch HDFS-10240-001.patch still worked and

[jira] [Updated] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-10240: --- Attachment: HDFS-10240-002.patch > Race between close/recoverLease leads to missing block >

[jira] [Comment Edited] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-16 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582341#comment-16582341 ] Jinglun edited comment on HDFS-10240 at 8/16/18 10:48 AM: -- hi [~jojochuang],

[jira] [Updated] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-16 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-10240: --- Attachment: HDFS-10240.006.patch > Race between close/recoverLease leads to missing block >

[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-16 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582341#comment-16582341 ] Jinglun commented on HDFS-10240: hi [~jojochuang], thanks for your patient explanation. I notice there

[jira] [Comment Edited] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-16 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582341#comment-16582341 ] Jinglun edited comment on HDFS-10240 at 8/16/18 10:50 AM: -- hi [~jojochuang],

[jira] [Comment Edited] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-16 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582341#comment-16582341 ] Jinglun edited comment on HDFS-10240 at 8/16/18 10:51 AM: -- hi [~jojochuang],

[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570168#comment-16570168 ] Jinglun commented on HDFS-10240: [~jojochuang][~sinago] I'm not sure why these 9 test cases keep failing.

[jira] [Updated] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-10240: --- Attachment: HDFS-10240-003.patch > Race between close/recoverLease leads to missing block >

[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569943#comment-16569943 ] Jinglun commented on HDFS-10240: make TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure

[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-13 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578252#comment-16578252 ] Jinglun commented on HDFS-10240: Thanks [~jojochuang] a lot for your comments. As the test failures are

[jira] [Updated] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-08-13 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-10240: --- Attachment: HDFS-10240-004.patch > Race between close/recoverLease leads to missing block >

[jira] [Assigned] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-07-23 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-10240: -- Assignee: Jinglun (was: zhouyingchao) > Race between close/recoverLease leads to missing block >

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: HDFS-13901.000.patch > INode access time is ignored because of race between open and rename >

[jira] [Created] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-06 Thread Jinglun (JIRA)
Jinglun created HDFS-13901: -- Summary: INode access time is ignored because of race between open and rename Key: HDFS-13901 URL: https://issues.apache.org/jira/browse/HDFS-13901 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: HDFS-13901.000.patch Status: Patch Available (was: Open) > INode access time is ignored

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: (was: HDFS-13901.000.patch) > INode access time is ignored because of race between open and

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-10 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609116#comment-16609116 ] Jinglun commented on HDFS-13901: I ran the failed 7 unit tests on my computer,  they all went well except 

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-10 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Attachment: HDFS-13901.001.patch Status: Patch Available (was: Open) > INode access time is ignored

[jira] [Updated] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-10 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13901: --- Status: Open (was: Patch Available) > INode access time is ignored because of race between open and rename

[jira] [Commented] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2018-08-31 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598717#comment-16598717 ] Jinglun commented on HDFS-13888: hi [~elgoiri],I'll take a look on it :) > RequestHedgingProxyProvider

[jira] [Created] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
Jinglun created HDFS-13388: -- Summary: RequestHedgingProxyProvider calls multiple configured NNs all the time Key: HDFS-13388 URL: https://issues.apache.org/jira/browse/HDFS-13388 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Description: In HDFS-7858 RequestHedgingProxyProvider was designed to "first simultaneously call multiple

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Description: In HDFS-7858 RequestHedgingProxyProvider was designed to "first simultaneously call multiple

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0001.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Open) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0005.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Open) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Open (was: Patch Available) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429701#comment-16429701 ] Jinglun commented on HDFS-13388: Hi [~elgoiri], thanks for your comment. I changed assertTrue to

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-10 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432185#comment-16432185 ] Jinglun commented on HDFS-13388: Hi [~elgoiri], [~Sammi] , the problem is the variable represents the

[jira] [Comment Edited] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-10 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432185#comment-16432185 ] Jinglun edited comment on HDFS-13388 at 4/10/18 12:30 PM: -- Hi [~elgoiri],

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433855#comment-16433855 ] Jinglun commented on HDFS-13388: Hi [~elgoiri], I find a bug of 0006.patch: the InvocationTargetException

[jira] [Comment Edited] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433855#comment-16433855 ] Jinglun edited comment on HDFS-13388 at 4/11/18 12:41 PM: -- Hi [~elgoiri], I find

[jira] [Reopened] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-13388: There is a problem with the patch. When it uses reflection to call the method, the InvocationTargetException

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: (was: HADOOP-13388.0007.patch) > RequestHedgingProxyProvider calls multiple configured NNs

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0007.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Reopened) > RequestHedgingProxyProvider calls multiple configured NNs all the

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0007.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429977#comment-16429977 ] Jinglun commented on HDFS-13388: Thanks [~elgoiri] for all your comments and patience. :) >

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0006.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Open) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Open (was: Patch Available) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0004.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Open (was: Patch Available) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Open) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-07 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429593#comment-16429593 ] Jinglun commented on HDFS-13388: Hi  [~elgoiri] , thanks for your advice. I update the patch with static

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-07 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Open) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-07 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Open (was: Patch Available) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-07 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0003.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-12 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436761#comment-16436761 ] Jinglun commented on HDFS-13388: Thanks [~elgoiri] for comments. I updates the test case for static

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-12 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0012.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-12 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0011.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434817#comment-16434817 ] Jinglun commented on HDFS-13388: hi [~elgoiri], patch 007 is an addendum for what we committed. I prefer

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Open (was: Patch Available) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Open) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0008.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0009.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Comment Edited] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434817#comment-16434817 ] Jinglun edited comment on HDFS-13388 at 4/12/18 3:42 AM: - Hi [~elgoiri], patch 007

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-10 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433325#comment-16433325 ] Jinglun commented on HDFS-13388: Thanks [~elgoiri]. Keeping the patch in trunk would be enough for me. :)

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-15 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0013.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-15 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438934#comment-16438934 ] Jinglun commented on HDFS-13388: Thanks [~elgoiri] for your comments, I learned a lot from them. I upload

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-22 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447450#comment-16447450 ] Jinglun commented on HDFS-13388: Hi [~elgoiri], are you comfortable committing this?  >

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-16 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0014.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-16 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440234#comment-16440234 ] Jinglun commented on HDFS-13388: Hi [~elgoiri], I give an update at patch 0014. I'm comfortable committing

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Attachment: HADOOP-13388.0002.patch > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Open (was: Patch Available) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13388: --- Status: Patch Available (was: Open) > RequestHedgingProxyProvider calls multiple configured NNs all the time

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424875#comment-16424875 ] Jinglun commented on HDFS-13388: Thanks [~elgoiri] for review. I'm new to Hadoop Community and not

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424929#comment-16424929 ] Jinglun commented on HDFS-13388: Thanks [~elgoiri] [~linyiqun] for suggestions. I would do the fix and

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425043#comment-16425043 ] Jinglun commented on HDFS-13388: Hi [~elgoiri] [~linyiqun], seems good this time.  >

[jira] [Updated] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2019-01-02 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13888: --- Attachment: HDFS-13888.002.patch > RequestHedgingProxyProvider shows InterruptedException >

[jira] [Updated] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2019-01-03 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13888: --- Attachment: HDFS-13888.003.patch > RequestHedgingProxyProvider shows InterruptedException >

[jira] [Commented] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2019-01-02 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732724#comment-16732724 ] Jinglun commented on HDFS-13888: Hi [~elgoiri], I add a test case to replay the case 3.1. I change some

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-14 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721072#comment-16721072 ] Jinglun commented on HDFS-14088: hi [~John Smith] [~elgoiri], HDFS-14088.006.patch looks good to me.  

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708411#comment-16708411 ] Jinglun commented on HDFS-14088: Hi [~John Smith], it's a good job:). patch-003 resolves a race

[jira] [Updated] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2018-11-26 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13888: --- Attachment: HDFS-13888.001.patch > RequestHedgingProxyProvider shows InterruptedException >

[jira] [Commented] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2018-11-26 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698910#comment-16698910 ] Jinglun commented on HDFS-13888: hi [~elgoiri], I take a look on the cause of the log, and here is the

[jira] [Updated] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2019-01-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-13888: --- Attachment: HDFS-13888.004.patch > RequestHedgingProxyProvider shows InterruptedException >

[jira] [Commented] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2019-01-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734003#comment-16734003 ] Jinglun commented on HDFS-13888: I change the test case from override to mock. Still need to change 

[jira] [Commented] (HDFS-14481) BenchmarkThroughput.writeLocalFile hangs with misconfigured BUFFER_SIZE

2019-05-13 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838312#comment-16838312 ] Jinglun commented on HDFS-14481: Hi [~dustinday], the BUFFER_SIZE has got a default value, and anyone who

[jira] [Commented] (HDFS-13888) RequestHedgingProxyProvider shows InterruptedException

2019-05-13 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838314#comment-16838314 ] Jinglun commented on HDFS-13888: Hi [~elgoiri], +1 to close this jira :). > RequestHedgingProxyProvider

[jira] [Updated] (HDFS-14542) Remove redundant code when verify quota

2019-06-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14542: --- Attachment: HDFS-14542.patch > Remove redundant code when verify quota >

[jira] [Updated] (HDFS-14542) Remove redundant code when verify quota

2019-06-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14542: --- Description: DirectoryWithQuotaFeature.verifyQuotaByStorageType() does the job of verifying quota. It's

[jira] [Assigned] (HDFS-14542) Remove redundant code when verify quota

2019-06-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-14542: -- Assignee: Jinglun > Remove redundant code when verify quota > ---

[jira] [Commented] (HDFS-14542) Remove redundant code when verify quota

2019-06-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855641#comment-16855641 ] Jinglun commented on HDFS-14542: upload one patch to trigger jenkins. > Remove redundant code when

[jira] [Created] (HDFS-14542) Remove redundant code when verify quota

2019-06-04 Thread Jinglun (JIRA)
Jinglun created HDFS-14542: -- Summary: Remove redundant code when verify quota Key: HDFS-14542 URL: https://issues.apache.org/jira/browse/HDFS-14542 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-14542) Remove redundant code when verify quota

2019-06-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856312#comment-16856312 ] Jinglun commented on HDFS-14542: Hi [~ayushtkn], thanks for your comments, and you miss the fact that if

[jira] [Commented] (HDFS-14542) Remove redundant code when verify quota

2019-06-05 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856394#comment-16856394 ] Jinglun commented on HDFS-14542: Hi [~ayushtkn], seems you don't understand. *In the present code, when

[jira] [Created] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-04 Thread Jinglun (JIRA)
Jinglun created HDFS-14547: -- Summary: DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set. Key: HDFS-14547 URL: https://issues.apache.org/jira/browse/HDFS-14547

[jira] [Updated] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-04 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14547: --- Description: Our XiaoMi HDFS is considering upgrading from 2.6 to 3.1. We notice the storage type quota

[jira] [Commented] (HDFS-14542) Remove redundant code when verify quota

2019-06-05 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856519#comment-16856519 ] Jinglun commented on HDFS-14542: No matter the storage quota type is set or unset, *removing the

[jira] [Commented] (HDFS-14542) Remove redundant code when verify quota

2019-06-05 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856504#comment-16856504 ] Jinglun commented on HDFS-14542: Hi [~ayushtkn], thanks for comments. No, the method

[jira] [Assigned] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-05 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-14547: -- Assignee: Jinglun > DirectoryWithQuotaFeature.quota costs additional memory even the storage type >

[jira] [Created] (HDFS-14515) The proto type of quota should change to int64.

2019-05-27 Thread Jinglun (JIRA)
Jinglun created HDFS-14515: -- Summary: The proto type of quota should change to int64. Key: HDFS-14515 URL: https://issues.apache.org/jira/browse/HDFS-14515 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861743#comment-16861743 ] Jinglun commented on HDFS-14547: Does anybody have time to review the patch? Looking forward to all

[jira] [Comment Edited] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-12 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861740#comment-16861740 ] Jinglun edited comment on HDFS-14547 at 6/12/19 6:17 AM: - The EnumCounters is

[jira] [Commented] (HDFS-14562) The behaviour of getContentSummaryInt() in getQuotaUsage() should be configurable.

2019-06-12 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861911#comment-16861911 ] Jinglun commented on HDFS-14562: Hi [~jojochuang], do you mind to have a look at it? Thanks.:) > The

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861740#comment-16861740 ] Jinglun commented on HDFS-14547: The EnumCounters is widely used in DirectoryWithQuotaFeature and quota

  1   2   3   4   >