[jira] [Commented] (HDFS-15199) NPE in BlockSender

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047262#comment-17047262 ] Ayush Saxena commented on HDFS-15199: - {{String ioem = e.getMessage();}} is null for

[jira] [Created] (HDFS-15199) NPE in BlockSender

2020-02-27 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15199: --- Summary: NPE in BlockSender Key: HDFS-15199 URL: https://issues.apache.org/jira/browse/HDFS-15199 Project: Hadoop HDFS Issue Type: Bug Reporter:

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047260#comment-17047260 ] Hadoop QA commented on HDFS-15033: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047233#comment-17047233 ] Hadoop QA commented on HDFS-15033: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Attachment: HDFS-15188.patch Status: Patch Available (was: Open) > Add option to set Write/Read

[jira] [Commented] (HDFS-15198) In Secure Mode, Router can't refresh other router's mountTableEntries

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047228#comment-17047228 ] Ayush Saxena commented on HDFS-15198: - Can you extend a test for this? > In Secure Mode, Router

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Status: Open (was: Patch Available) > Add option to set Write/Read timeout extension for different

[jira] [Commented] (HDFS-15198) In Secure Mode, Router can't refresh other router's mountTableEntries

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047226#comment-17047226 ] Hadoop QA commented on HDFS-15198: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047219#comment-17047219 ] Hadoop QA commented on HDFS-15188: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15198) In Secure Mode, Router can't refresh other router's mountTableEntries

2020-02-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15198: - Status: Patch Available (was: Open) > In Secure Mode, Router can't refresh other router's

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047195#comment-17047195 ] Yang Yun commented on HDFS-15033: - Thanks [~ayushtkn] for the review. Got the time usage and removed 

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: HDFS-15033.patch Status: Patch Available (was: Open) > Support to save replica cached

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Status: Open (was: Patch Available) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15198) In Secure Mode, Router can't refresh other router's mountTableEntries

2020-02-27 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-15198: --- Attachment: HDFS-15198.001.patch > In Secure Mode, Router can't refresh other router's

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047191#comment-17047191 ] Ayush Saxena commented on HDFS-13377: - Thanx [~hadoop_yangyun]  for the patch. Overall LGTM.

[jira] [Commented] (HDFS-15198) In Secure Mode, Router can't refresh other router's mountTableEntries

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047190#comment-17047190 ] Ayush Saxena commented on HDFS-15198: - Thanx [~zhengchenyu]  for the report. Do you want to

[jira] [Updated] (HDFS-15198) In Secure Mode, Router can't refresh other router's mountTableEntries

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15198: Fix Version/s: (was: HDFS-13891) (was: 3.3.0) > In Secure Mode, Router

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047188#comment-17047188 ] Ayush Saxena commented on HDFS-15033: - Thanx [~hadoop_yangyun] for the patch . Had a quick look on

[jira] [Created] (HDFS-15198) In Secure Mode, Router can't refresh other router's mountTableEntries

2020-02-27 Thread zhengchenyu (Jira)
zhengchenyu created HDFS-15198: -- Summary: In Secure Mode, Router can't refresh other router's mountTableEntries Key: HDFS-15198 URL: https://issues.apache.org/jira/browse/HDFS-15198 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047182#comment-17047182 ] Haibin Huang commented on HDFS-15155: - Ok, i will update the patch soon > writeIoRate of

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047180#comment-17047180 ] Ayush Saxena commented on HDFS-15196: - Thanx [~fengnanli] for the patch. You can add a test to may

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047179#comment-17047179 ] Íñigo Goiri commented on HDFS-15155: I do think we need some assert, right now we are not really

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047178#comment-17047178 ] Íñigo Goiri commented on HDFS-15196: The tests don't look very happy. Minor comments: * Avoid changes

[jira] [Updated] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15196: --- Summary: RBF: RouterRpcServer getListing cannot list large dirs correctly (was: RouterRpcServer

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047173#comment-17047173 ] Yang Yun commented on HDFS-15033: - Thanks [~elgoiri] for the review. Added the time suffix  in  

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: (was: HDFS-15033.patch) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: (was: HDFS-15033.patch) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: (was: HDFS-15033.patch) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Status: Open (was: Patch Available) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: HDFS-15033.patch Status: Patch Available (was: Open) > Support to save replica cached

[jira] [Comment Edited] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047171#comment-17047171 ] Haibin Huang edited comment on HDFS-15155 at 2/28/20 3:05 AM: -- [~elgoiri] 

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047171#comment-17047171 ] Haibin Huang commented on HDFS-15155: - I think TestDataNodeVolumeMetrics#testVolumeMetrics has

[jira] [Commented] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047165#comment-17047165 ] Hadoop QA commented on HDFS-15196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047159#comment-17047159 ] Yang Yun commented on HDFS-15188: - Thanks [~elgoiri] for the review. Fixed the checkstyle warnings. Yes, 

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Attachment: HDFS-15188.patch Status: Patch Available (was: Open) > Add option to set Write/Read

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Status: Open (was: Patch Available) > Add option to set Write/Read timeout extension for different

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2020-02-27 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047136#comment-17047136 ] Uma Maheswara Rao G commented on HDFS-12090: Hi [~ehiggs] / [~Thomas Demoor]   Do you have

[jira] [Commented] (HDFS-15197) [SBN read] Change ObserverRetryOnActiveException log to debug

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047121#comment-17047121 ] Hadoop QA commented on HDFS-15197: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Target Version/s: 3.3.0 > Missing IBR when NameNode restart if open processCommand async

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15113: --- Priority: Blocker (was: Major) > Missing IBR when NameNode restart if open processCommand

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047116#comment-17047116 ] Wei-Chiu Chuang commented on HDFS-15113: This has to be a blocker for 3.3.0. Updated jira to

[jira] [Updated] (HDFS-13660) DistCp job fails when new data is appended in the file while the distCp copy job is running

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13660: --- Fix Version/s: 3.2.2 3.1.4 > DistCp job fails when new data is appended

[jira] [Updated] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12999: --- Fix Version/s: 3.2.2 3.1.4 > When reach the end of the block group, it

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15068: --- Fix Version/s: 3.2.2 3.1.4 > DataNode could meet deadlock if invoke

[jira] [Updated] (HDFS-15197) [SBN read] Change ObserverRetryOnActiveException log to debug

2020-02-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15197: Summary: [SBN read] Change ObserverRetryOnActiveException log to debug (was: Change

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047086#comment-17047086 ] Hadoop QA commented on HDFS-15154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

2020-02-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047081#comment-17047081 ] Chao Sun commented on HDFS-15197: - +1 > Change ObserverRetryOnActiveException log to debug >

[jira] [Updated] (HDFS-14731) [FGL] Remove redundant locking on NameNode.

2020-02-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14731: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Hadoop

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047075#comment-17047075 ] Íñigo Goiri commented on HDFS-15033: Can we use a time suffix in hdfs-default.xml? I'm guessing is

[jira] [Comment Edited] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047074#comment-17047074 ] Chao Sun edited comment on HDFS-15196 at 2/28/20 12:05 AM: --- +1. Patch LGTM but

[jira] [Commented] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047074#comment-17047074 ] Chao Sun commented on HDFS-15196: - Patch LGTM but will be great if [~elgoiri] or others who're familiar

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047070#comment-17047070 ] Íñigo Goiri commented on HDFS-15188: Thanks for the patch, [~hadoop_yangyun]. * Can you take care of

[jira] [Commented] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047069#comment-17047069 ] Chao Sun commented on HDFS-15196: - Thanks Fengnan for the patch. Raising this to Critical since it is a

[jira] [Updated] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15196: Priority: Critical (was: Major) > RouterRpcServer getListing cannot list large dirs correctly >

[jira] [Updated] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

2020-02-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15197: -- Status: Patch Available (was: Open) > Change ObserverRetryOnActiveException log to debug >

[jira] [Updated] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

2020-02-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15197: -- Attachment: HDFS-15197.001.patch > Change ObserverRetryOnActiveException log to debug >

[jira] [Created] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

2020-02-27 Thread Chen Liang (Jira)
Chen Liang created HDFS-15197: - Summary: Change ObserverRetryOnActiveException log to debug Key: HDFS-15197 URL: https://issues.apache.org/jira/browse/HDFS-15197 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15196: -- Status: Patch Available (was: Open) [~inigoiri] Can you help take a look? Thanks very much! Tagging 

[jira] [Updated] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15196: -- Attachment: HDFS-15196.001.patch > RouterRpcServer getListing cannot list large dirs correctly >

[jira] [Created] (HDFS-15196) RouterRpcServer getListing cannot list large dirs correctly

2020-02-27 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15196: - Summary: RouterRpcServer getListing cannot list large dirs correctly Key: HDFS-15196 URL: https://issues.apache.org/jira/browse/HDFS-15196 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15111: --- Resolution: Fixed Status: Resolved (was: Patch Available) Cherrypicked to

[jira] [Updated] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15111: --- Fix Version/s: 3.1.4 > stopStandbyServices() should log which service state it is

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-27 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047016#comment-17047016 ] Siddharth Wagle commented on HDFS-15154: 09 => rebased 08. > Allow only hdfs superusers the

[jira] [Updated] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-27 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-15154: --- Attachment: HDFS-15154.09.patch > Allow only hdfs superusers the ability to assign HDFS

[jira] [Updated] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-27 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-15154: --- Attachment: HDFS-15154.08.patch > Allow only hdfs superusers the ability to assign HDFS

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-27 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047005#comment-17047005 ] Siddharth Wagle commented on HDFS-15154: 08 => Explicity verified the deprecated config still

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047006#comment-17047006 ] Hadoop QA commented on HDFS-15154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046990#comment-17046990 ] Ahmed Hussein commented on HDFS-15149: -- Thanks [~leosun08] for making the changes. Thanks

[jira] [Commented] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046986#comment-17046986 ] Íñigo Goiri commented on HDFS-15149: [^HDFS-15149.005.patch] looks good to me. [~ahussein], further

[jira] [Commented] (HDFS-15147) LazyPersistTestCase wait logic is error-prone

2020-02-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046968#comment-17046968 ] Ahmed Hussein commented on HDFS-15147: -- Thanks [~kihwal] for committing the patches. >

[jira] [Commented] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046956#comment-17046956 ] Hadoop QA commented on HDFS-15190: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046949#comment-17046949 ] Hadoop QA commented on HDFS-15155: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14977) Quota Usage and Content summary are not same in Truncate with Snapshot

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046948#comment-17046948 ] Íñigo Goiri commented on HDFS-14977: Thanks [~hemanthboyina] for the patch. Let's add a few comments

[jira] [Commented] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046947#comment-17046947 ] Íñigo Goiri commented on HDFS-15190: It makes sense. The checkstyle is just for consistency so let's

[jira] [Commented] (HDFS-14977) Quota Usage and Content summary are not same in Truncate with Snapshot

2020-02-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046932#comment-17046932 ] Hadoop QA commented on HDFS-14977: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-27 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046923#comment-17046923 ] Hudson commented on HDFS-15186: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18006 (See

[jira] [Commented] (HDFS-14892) Close the output stream if createWrappedOutputStream() fails

2020-02-27 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046910#comment-17046910 ] Xiaoyu Yao commented on HDFS-14892: --- Thanks [~weichiu] for linking the issues. Looks like the same

[jira] [Updated] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15186: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046900#comment-17046900 ] Ayush Saxena commented on HDFS-15186: - Committed to trunk. Thanx [~yaoguangdong] for the contributon,

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046896#comment-17046896 ] Ayush Saxena commented on HDFS-15186: - v005 LGTM +1 > Erasure Coding: Decommission may generate the

[jira] [Updated] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

2020-02-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15190: - Attachment: HDFS-15190.002.patch > HttpFS : Add Support for Storage Policy Satisfier >

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046836#comment-17046836 ] Íñigo Goiri commented on HDFS-15155: The test is not checking anything, can we add there some

[jira] [Updated] (HDFS-15195) In place namenode federation

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15195: --- Summary: In place namenode federation (was: In place namenode fedaration) > In place namenode

[jira] [Commented] (HDFS-15195) In place namenode fedaration

2020-02-27 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046829#comment-17046829 ] Kihwal Lee commented on HDFS-15195: --- There were some discussions in the past including HDFS-7702. This

[jira] [Commented] (HDFS-15195) In place namenode fedaration

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046826#comment-17046826 ] Ayush Saxena commented on HDFS-15195: - Do you tend to change the BlockPool of the block to move the

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-02-27 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046823#comment-17046823 ] Hudson commented on HDFS-15124: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18004 (See

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046809#comment-17046809 ] Haibin Huang commented on HDFS-15155: - [~elgoiri]  [~ayushtkn] , i have updated the patch, can you

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046803#comment-17046803 ] Ayush Saxena commented on HDFS-15124: - Committed to trunk. Thanx [~ctest.team] for the contribution

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15124: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

2020-02-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046797#comment-17046797 ] hemanthboyina commented on HDFS-15190: -- thanks for the comment [~elgoiri] in our cluster , webhdfs

[jira] [Created] (HDFS-15195) In place namenode fedaration

2020-02-27 Thread Amithsha (Jira)
Amithsha created HDFS-15195: --- Summary: In place namenode fedaration Key: HDFS-15195 URL: https://issues.apache.org/jira/browse/HDFS-15195 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-02-27 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-15155: Attachment: HDFS-15155.002.patch > writeIoRate of DataNodeVolumeMetrics is never used >

[jira] [Updated] (HDFS-14977) Quota Usage and Content summary are not same in Truncate with Snapshot

2020-02-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14977: - Attachment: HDFS-14977.001.patch Status: Patch Available (was: Open) > Quota Usage and

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-02-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046791#comment-17046791 ] Ayush Saxena commented on HDFS-15124: - v006 LGTM +1 > Crashing bugs in NameNode when using a valid

[jira] [Commented] (HDFS-15147) LazyPersistTestCase wait logic is error-prone

2020-02-27 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046783#comment-17046783 ] Kihwal Lee commented on HDFS-15147: --- It has been committed to trunk to branch-2.10. Thanks for working

[jira] [Commented] (HDFS-14668) Support Fuse with Users from multiple Security Realms

2020-02-27 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046761#comment-17046761 ] Hudson commented on HDFS-14668: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18003 (See

[jira] [Resolved] (HDFS-14668) Support Fuse with Users from multiple Security Realms

2020-02-27 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14668. Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Resolved] (HDFS-15147) LazyPersistTestCase wait logic is error-prone

2020-02-27 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-15147. --- Hadoop Flags: Reviewed Resolution: Fixed > LazyPersistTestCase wait logic is error-prone >

[jira] [Updated] (HDFS-15147) LazyPersistTestCase wait logic is error-prone

2020-02-27 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15147: -- Fix Version/s: 2.10.1 > LazyPersistTestCase wait logic is error-prone >

[jira] [Updated] (HDFS-15147) LazyPersistTestCase wait logic is error-prone

2020-02-27 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15147: -- Fix Version/s: 3.1.4 > LazyPersistTestCase wait logic is error-prone >

  1   2   >