[jira] [Commented] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2019-07-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881469#comment-16881469 ] Yongjun Zhang commented on HDFS-9178: - HI [~kihwal], many thanks for the work here!

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2019-07-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9178: Description: When non-leaf datanode in a pipeline is slow on or stuck at disk I/O, the downstream n

[jira] [Commented] (HDFS-14083) libhdfs logs errors when opened FS doesn't support ByteBufferReadable

2019-02-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16778529#comment-16778529 ] Yongjun Zhang commented on HDFS-14083: -- HI guys, I took a look and I agree with [~t

[jira] [Updated] (HDFS-14118) Support using DNS to resolve nameservices to IP addresses

2019-02-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-14118: - Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-14118) Support using DNS to resolve nameservices to IP addresses

2019-02-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775976#comment-16775976 ] Yongjun Zhang commented on HDFS-14118: -- HI [~fengnanli], would you please add conten

[jira] [Updated] (HDFS-14118) Support using DNS to resolve nameservices to IP addresses

2019-02-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-14118: - Hadoop Flags: Reviewed > Support using DNS to resolve nameservices to IP addresses >

[jira] [Commented] (HDFS-14118) Support using DNS to resolve nameservices to IP addresses

2019-02-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775974#comment-16775974 ] Yongjun Zhang commented on HDFS-14118: -- Committed to trunk. Thanks [~fengnanli] for

[jira] [Updated] (HDFS-14118) Support using DNS to resolve nameservices to IP addresses

2019-02-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-14118: - Description: In router based federation (RBF), clients will need to know about routers to talk t

[jira] [Updated] (HDFS-14118) Support using DNS to resolve nameservices to IP addresses

2019-02-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-14118: - Summary: Support using DNS to resolve nameservices to IP addresses (was: Use DNS to resolve Name

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775817#comment-16775817 ] Yongjun Zhang commented on HDFS-14118: -- Hi [~fengnanli], Seems we have quite some f

[jira] [Updated] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-14118: - Attachment: HDFS-14118.024.patch > Use DNS to resolve Namenodes and Routers > ---

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775724#comment-16775724 ] Yongjun Zhang commented on HDFS-14118: -- Thanks [~fengnanli]! +1 on rev 23 pending je

[jira] [Comment Edited] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775474#comment-16775474 ] Yongjun Zhang edited comment on HDFS-14118 at 2/22/19 6:33 PM:

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775474#comment-16775474 ] Yongjun Zhang commented on HDFS-14118: -- Hi [~fengnanli], Thanks for following-up. W

[jira] [Comment Edited] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774848#comment-16774848 ] Yongjun Zhang edited comment on HDFS-14118 at 2/22/19 7:01 AM:

[jira] [Comment Edited] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774848#comment-16774848 ] Yongjun Zhang edited comment on HDFS-14118 at 2/22/19 7:03 AM:

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774848#comment-16774848 ] Yongjun Zhang commented on HDFS-14118: -- Thanks for the explanation and new rev [~fen

[jira] [Comment Edited] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774848#comment-16774848 ] Yongjun Zhang edited comment on HDFS-14118 at 2/22/19 6:58 AM:

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774569#comment-16774569 ] Yongjun Zhang commented on HDFS-14118: -- Thanks [~fengnanli], would you please addres

[jira] [Comment Edited] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773661#comment-16773661 ] Yongjun Zhang edited comment on HDFS-14118 at 2/21/19 3:37 PM:

[jira] [Comment Edited] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773661#comment-16773661 ] Yongjun Zhang edited comment on HDFS-14118 at 2/21/19 3:18 PM:

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773661#comment-16773661 ] Yongjun Zhang commented on HDFS-14118: -- Hi Guys, I did one round of review, and it

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773629#comment-16773629 ] Yongjun Zhang commented on HDFS-14118: -- Thanks [~goirix] for pointing out the doc li

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773337#comment-16773337 ] Yongjun Zhang commented on HDFS-14118: -- Hi [~fengnanli], For the benefit of the co

[jira] [Comment Edited] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773337#comment-16773337 ] Yongjun Zhang edited comment on HDFS-14118 at 2/20/19 7:58 PM:

[jira] [Commented] (HDFS-14118) Use DNS to resolve Namenodes and Routers

2019-02-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772070#comment-16772070 ] Yongjun Zhang commented on HDFS-14118: -- Hi [~fengnanli], Thanks for the work here. S

[jira] [Commented] (HDFS-13101) Yet another fsimage corruption related to snapshot

2019-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738485#comment-16738485 ] Yongjun Zhang commented on HDFS-13101: -- Hi All, Thanks for continuing to drive the i

[jira] [Assigned] (HDFS-13101) Yet another fsimage corruption related to snapshot

2019-01-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-13101: Assignee: Siyao Meng (was: Yongjun Zhang) > Yet another fsimage corruption related to sna

[jira] [Commented] (HDFS-14015) Improve error handling in hdfsThreadDestructor in native thread local storage

2018-11-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16673722#comment-16673722 ] Yongjun Zhang commented on HDFS-14015: -- Thanks [~templedf], good work! It seems go

[jira] [Commented] (HDFS-14015) Improve error handling in hdfsThreadDestructor in native thread local storage

2018-11-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672275#comment-16672275 ] Yongjun Zhang commented on HDFS-14015: -- FYI [~templedf], Thinking about that we cou

[jira] [Issue Comment Deleted] (HDFS-14015) Improve error handling in hdfsThreadDestructor in native thread local storage

2018-10-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-14015: - Comment: was deleted (was: I don't see  an API provided by jni to get the current thread id, but

[jira] [Commented] (HDFS-14015) Improve error handling in hdfsThreadDestructor in native thread local storage

2018-10-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667873#comment-16667873 ] Yongjun Zhang commented on HDFS-14015: -- I don't see  an API provided by jni to get t

[jira] [Commented] (HDFS-14012) Add diag info in RetryInvocationHandler

2018-10-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667870#comment-16667870 ] Yongjun Zhang commented on HDFS-14012: -- Thanks [~dineshchitlangia], good to see that

[jira] [Commented] (HDFS-14015) Improve error handling in hdfsThreadDestructor in native thread local storage

2018-10-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667791#comment-16667791 ] Yongjun Zhang commented on HDFS-14015: -- Hi [~templedf], Thanks for reporting and wo

[jira] [Updated] (HDFS-14012) Add diag info in RetryInvocationHandler

2018-10-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-14012: - Environment: (was: RetryInvocationHandler does the following logging: {code:java} } else { LOG

[jira] [Created] (HDFS-14012) Add diag info in RetryInvocationHandler

2018-10-20 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-14012: Summary: Add diag info in RetryInvocationHandler Key: HDFS-14012 URL: https://issues.apache.org/jira/browse/HDFS-14012 Project: Hadoop HDFS Issue Type: Impro

[jira] [Commented] (HDFS-13031) To detect fsimage corruption on the spot

2018-08-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575833#comment-16575833 ] Yongjun Zhang commented on HDFS-13031: -- Thanks [~adam.antal] and [~smeng]. Good sum

[jira] [Commented] (HDFS-13813) Exit NameNode when dangling child inode is detected when saving FsImage

2018-08-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575408#comment-16575408 ] Yongjun Zhang commented on HDFS-13813: -- Thanks [~smeng], good work here! I did not

[jira] [Commented] (HDFS-8131) Implement a space balanced block placement policy

2018-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558894#comment-16558894 ] Yongjun Zhang commented on HDFS-8131: - I just read HDFS-4946, I found it doesn't exact

[jira] [Commented] (HDFS-8131) Implement a space balanced block placement policy

2018-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558746#comment-16558746 ] Yongjun Zhang commented on HDFS-8131: - Hm, just noticed HDFS-4946 for my comment #3 ab

[jira] [Commented] (HDFS-8131) Implement a space balanced block placement policy

2018-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558739#comment-16558739 ] Yongjun Zhang commented on HDFS-8131: - HI [~liushaohui], Thanks much for the nice wor

[jira] [Created] (HDFS-13663) Should throw exception when incorrect block size is set

2018-06-07 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13663: Summary: Should throw exception when incorrect block size is set Key: HDFS-13663 URL: https://issues.apache.org/jira/browse/HDFS-13663 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-13632) Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA

2018-05-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13632: - Fix Version/s: (was: 3.0.3) 3.0.4 > Randomize baseDir for MiniJournalClust

[jira] [Updated] (HDFS-13591) TestDFSShell#testSetrepLow fails on Windows

2018-05-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13591: - Fix Version/s: (was: 3.0.4) 3.0.3 > TestDFSShell#testSetrepLow fails on Wi

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13068: - Fix Version/s: (was: 3.0.1) 3.0.3 > RBF: Add router admin option to manage

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Fix Version/s: (was: 3.0.1) 3.0.3 > In getNumUnderConstructionBlocks(), ign

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13164: - Fix Version/s: (was: 3.0.1) 3.0.3 > File not closed if streamer fail with D

[jira] [Updated] (HDFS-13244) Add stack, conf, metrics links to utilities dropdown in NN webUI

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13244: - Fix Version/s: (was: 3.0.1) 3.0.3 > Add stack, conf, metrics links to utili

[jira] [Updated] (HDFS-13551) TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13551: - Fix Version/s: (was: 3.0.4) 3.0.3 > TestMiniDFSCluster#testClusterSetStorag

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13611: - Fix Version/s: (was: 3.0.4) 3.0.3 > Unsafe use of Text as a ConcurrentHashM

[jira] [Commented] (HDFS-12813) RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1

2018-05-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481730#comment-16481730 ] Yongjun Zhang commented on HDFS-12813: -- Thanks you guys for the work here, I cherry-p

[jira] [Updated] (HDFS-12813) RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1

2018-05-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12813: - Fix Version/s: 3.0.3 > RequestHedgingProxyProvider can hide Exception thrown from the Namenode for

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-05-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16481728#comment-16481728 ] Yongjun Zhang commented on HDFS-13388: -- Hi [~elgoiri], Thanks for the reply. I just

[jira] [Updated] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-05-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13388: - Fix Version/s: 3.0.3 > RequestHedgingProxyProvider calls multiple configured NNs all the time > --

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2018-05-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16480265#comment-16480265 ] Yongjun Zhang commented on HDFS-6489: - HI Guys, Thanks for working on this issue. I ha

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16480073#comment-16480073 ] Yongjun Zhang commented on HDFS-13388: -- HI [~elgoiri], Would you please take a look

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-05-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470764#comment-16470764 ] Yongjun Zhang commented on HDFS-13388: -- HI [~elgoiri], Thanks for staying on top. I

[jira] [Comment Edited] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469299#comment-16469299 ] Yongjun Zhang edited comment on HDFS-13388 at 5/9/18 10:10 PM: -

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469583#comment-16469583 ] Yongjun Zhang commented on HDFS-13388: -- Welcome, and thanks for taking care of that,

[jira] [Commented] (HDFS-13430) Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469573#comment-16469573 ] Yongjun Zhang commented on HDFS-13430: -- Thanks [~shahrs87].   > Fix TestEncryptionZ

[jira] [Commented] (HDFS-13434) RBF: Fix dead links in RBF document

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469463#comment-16469463 ] Yongjun Zhang commented on HDFS-13434: -- Hi [~elgoiri], Thanks for working on this is

[jira] [Commented] (HDFS-13430) Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469457#comment-16469457 ] Yongjun Zhang commented on HDFS-13430: -- Hi [~xiaochen] and [~shahrs87], Thank you gu

[jira] [Commented] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469299#comment-16469299 ] Yongjun Zhang commented on HDFS-13388: -- Hi [~elgoiri], This Jira was released in 3.0

[jira] [Comment Edited] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469290#comment-16469290 ] Yongjun Zhang edited comment on HDFS-13136 at 5/9/18 6:50 PM: --

[jira] [Commented] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469290#comment-16469290 ] Yongjun Zhang commented on HDFS-13136: -- HI [~xyao], Thanks for your work here, could

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13062: - Fix Version/s: (was: 3.0.1) 3.0.3 > Provide support for JN to use separate

[jira] [Commented] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469281#comment-16469281 ] Yongjun Zhang commented on HDFS-13048: -- Hi [~ajisakaa], FYI, I just updated the fix

[jira] [Updated] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13048: - Fix Version/s: (was: 3.0.1) 3.0.3 > LowRedundancyReplicatedBlocks metric ca

[jira] [Updated] (HDFS-13315) Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997.

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13315: - Resolution: Fixed Status: Resolved (was: Patch Available) > Add a test for the issue repo

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10453: - Fix Version/s: (was: 3.0.1) 3.0.3 > ReplicationMonitor thread could stuck f

[jira] [Updated] (HDFS-10183) Prevent race condition during class initialization

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10183: - Fix Version/s: 3.0.3 > Prevent race condition during class initialization > --

[jira] [Updated] (HDFS-13428) RBF: Remove LinkedList From StateStoreFileImpl.java

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13428: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Remove LinkedList From StateStoreF

[jira] [Updated] (HDFS-13508) RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13508: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Normalize paths (automatically) wh

[jira] [Updated] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13326: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Improve the interfaces to modify a

[jira] [Updated] (HDFS-13499) RBF: Show disabled name services in the UI

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13499: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Show disabled name services in the

[jira] [Updated] (HDFS-13402) RBF: Fix java doc for StateStoreFileSystemImpl

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13402: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Fix java doc for StateStoreFileSy

[jira] [Updated] (HDFS-13045) RBF: Improve error message returned from subcluster

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13045: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Improve error message returned fro

[jira] [Updated] (HDFS-13384) RBF: Improve timeout RPC call mechanism

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13384: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Improve timeout RPC call mechanism

[jira] [Updated] (HDFS-13410) RBF: Support federation with no subclusters

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13410: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Support federation with no subclus

[jira] [Updated] (HDFS-13466) RBF: Add more router-related information to the UI

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13466: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Add more router-related informatio

[jira] [Updated] (HDFS-13386) RBF: Wrong date information in list file(-ls) result

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13386: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Wrong date information in list fil

[jira] [Updated] (HDFS-13478) RBF: Disabled Nameservice store API

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13478: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Disabled Nameservice store API > -

[jira] [Updated] (HDFS-13488) RBF: Reject requests when a Router is overloaded

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13488: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Reject requests when a Router is o

[jira] [Updated] (HDFS-13525) RBF: Add unit test TestStateStoreDisabledNameservice

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13525: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Add unit test TestStateStoreDisabl

[jira] [Updated] (HDFS-13503) Fix TestFsck test failures on Windows

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13503: - Fix Version/s: (was: 3.0.4) 3.0.3 > Fix TestFsck test failures on Windows >

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13283: - Fix Version/s: (was: 3.0.4) 3.0.3 > Percentage based Reserved Space Calcula

[jira] [Updated] (HDFS-13484) RBF: Disable Nameservices from the federation

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13484: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Disable Nameservices from the fede

[jira] [Updated] (HDFS-13509) Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13509: - Fix Version/s: (was: 3.0.4) 3.0.3 > Bug fix for breakHardlinks() of Replica

[jira] [Updated] (HDFS-13336) Test cases of TestWriteToReplica failed in windows

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13336: - Fix Version/s: (was: 3.0.4) 3.0.3 > Test cases of TestWriteToReplica failed

[jira] [Commented] (HDFS-13380) RBF: mv/rm fail after the directory exceeded the quota limit

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468310#comment-16468310 ] Yongjun Zhang commented on HDFS-13380: -- Hi [~elgoiri], Thanks you guys for working o

[jira] [Updated] (HDFS-13380) RBF: mv/rm fail after the directory exceeded the quota limit

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13380: - Fix Version/s: (was: 3.0.3) > RBF: mv/rm fail after the directory exceeded the quota limit > -

[jira] [Updated] (HDFS-13490) RBF: Fix setSafeMode in the Router

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13490: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Fix setSafeMode in the Router > --

[jira] [Updated] (HDFS-13380) RBF: mv/rm fail after the directory exceeded the quota limit

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13380: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: mv/rm fail after the directory exc

[jira] [Updated] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13462: - Fix Version/s: (was: 3.0.4) 3.0.3 > Add BIND_HOST configuration for Journal

[jira] [Commented] (HDFS-13478) RBF: Disabled Nameservice store API

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467849#comment-16467849 ] Yongjun Zhang commented on HDFS-13478: -- HI [~elgoiri], [~linyiqun], Thanks for your

[jira] [Updated] (HDFS-13453) RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13453: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: getMountPointDates should fetch la

[jira] [Updated] (HDFS-13435) RBF: Improve the error loggings for printing the stack trace

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13435: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: Improve the error loggings for pri

[jira] [Updated] (HDFS-13353) RBF: TestRouterWebHDFSContractCreate failed

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13353: - Fix Version/s: (was: 3.0.4) 3.0.3 > RBF: TestRouterWebHDFSContractCreate fa

[jira] [Updated] (HDFS-12981) renameSnapshot a Non-Existent snapshot to itself should throw error

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12981: - Fix Version/s: (was: 3.0.4) 3.0.3 > renameSnapshot a Non-Existent snapshot

[jira] [Comment Edited] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420978#comment-16420978 ] Yongjun Zhang edited comment on HDFS-13314 at 3/30/18 9:55 PM: -

  1   2   3   4   5   6   7   8   9   10   >