[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-02-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347472#comment-16347472 ] Rakesh R edited comment on HDFS-10285 at 2/1/18 1:58 PM: - Thank you very much 

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-02-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347472#comment-16347472 ] Rakesh R edited comment on HDFS-10285 at 2/1/18 1:52 PM: - Thank you very much 

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-02-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347472#comment-16347472 ] Rakesh R edited comment on HDFS-10285 at 2/1/18 1:49 PM: - Thank you very much 

[jira] [Assigned] (HDFS-13101) Yet another fsimage corruption related to snapshot

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-13101: Assignee: Yongjun Zhang > Yet another fsimage corruption related to snapshot >

[jira] [Created] (HDFS-13101) Yet another fsimage corruption related to snapshot

2018-02-01 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13101: Summary: Yet another fsimage corruption related to snapshot Key: HDFS-13101 URL: https://issues.apache.org/jira/browse/HDFS-13101 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349077#comment-16349077 ] Steve Loughran commented on HDFS-10453: --- Not my area of expertise at all; I'm not safe to have

[jira] [Updated] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13043: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 2.9.1

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-02-01 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349103#comment-16349103 ] Hanisha Koneru commented on HDFS-13062: --- Test failures are unrelated and pass locally. Will commit

[jira] [Updated] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13100: - Description: HDFS-12386 added getserverdefaults call to webhdfs, and expect clusters that don't

[jira] [Updated] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13100: - Description: HDFS-12386 added getserverdefaults call to webhdfs, and expect clusters that don't

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349188#comment-16349188 ] Yongjun Zhang commented on HDFS-13100: -- Thanks a lot for your comments [~kihwal]. I amended the

[jira] [Commented] (HDFS-13099) RBF: Document State Store Driver relevant settings in hdfs-default.xml

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349065#comment-16349065 ] Íñigo Goiri commented on HDFS-13099: I'm kind of torn about adding all the config keys into a single

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349132#comment-16349132 ] Xiaoyu Yao commented on HDFS-13081: --- Propose to improve secure datanode check with: # If SASL QoP does

[jira] [Commented] (HDFS-13095) Improve slice tree traversal implementation

2018-02-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349066#comment-16349066 ] Daryn Sharp commented on HDFS-13095: Good points, highlighting some major issues.  I have no intention

[jira] [Comment Edited] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-02-01 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347747#comment-16347747 ] Hanisha Koneru edited comment on HDFS-13062 at 2/1/18 6:44 PM: --- Thanks

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-02-01 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349174#comment-16349174 ] Misha Dmitriev commented on HDFS-12051: --- I've just attached the detailed document comparing the old

[jira] [Commented] (HDFS-13098) RBF: Datanodes interacting with Routers

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349110#comment-16349110 ] Íñigo Goiri commented on HDFS-13098: {quote}If I understand correctly, here the first hearbeat to

[jira] [Updated] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13100: - Description: HDFS-12386 added getserverdefaults call to webhdfs, and expect clusters that don't

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349088#comment-16349088 ] Íñigo Goiri commented on HDFS-13068: +1 on [^HDFS-13068.003.patch]. Thanks [~linyiqun]! > RBF: Add

[jira] [Commented] (HDFS-12615) Router-based HDFS federation phase 2

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349120#comment-16349120 ] Íñigo Goiri commented on HDFS-12615: [~linyiqun] was asking in HDFS-13043 what would be the plan was

[jira] [Commented] (HDFS-13095) Improve slice tree traversal implementation

2018-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349140#comment-16349140 ] Xiao Chen commented on HDFS-13095: -- Thanks for the thoughts Daryn. Filling in some more info on

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-02-01 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Attachment: HDFS-12051-NameCache-Rewrite.pdf > Reimplement NameCache in NameNode: Intern

[jira] [Updated] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-02-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12997: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolved

[jira] [Commented] (HDFS-12909) SSLConnectionConfigurator creation error should be printed only if security is enabled

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348954#comment-16348954 ] Kihwal Lee commented on HDFS-12909: --- The patch looks good in general. One concern is that it changes the

[jira] [Commented] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

2018-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348973#comment-16348973 ] Xiao Chen commented on HDFS-12933: -- Thanks [~candychencan], assigned the Jira to you. Will review later

[jira] [Created] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-13100: Summary: Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs. Key: HDFS-13100 URL: https://issues.apache.org/jira/browse/HDFS-13100

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12512: --- Attachment: HDFS-12512.005.patch > RBF: Add WebHDFS > > > Key: HDFS-12512 >

[jira] [Commented] (HDFS-13098) RBF: Datanodes interacting with Routers

2018-02-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348992#comment-16348992 ] Wei Yan commented on HDFS-13098: {quote}Currently, we do the assignment of DNs to subclusters using

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348942#comment-16348942 ] Ajay Kumar commented on HDFS-10453: --- [~hexiaoqiao], thanks for updating the patch. New patch doesn't

[jira] [Updated] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-13051: -- Target Version/s: 3.1.0, 2.10.0, 2.9.1, 3.0.1, 2.8.4, 2.7.6 (was: 2.8.1, 2.8.2, 2.7.5, 3.0.0) > dead

[jira] [Updated] (HDFS-13101) Yet another fsimage corruption related to snapshot

2018-02-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13101: - Issue Type: Bug (was: Improvement) > Yet another fsimage corruption related to snapshot >

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348777#comment-16348777 ] Kihwal Lee commented on HDFS-13100: --- The {{handle()}} method you are showing is from {{WebHdfsHandler}}

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348782#comment-16348782 ] Kihwal Lee commented on HDFS-11187: --- The patch looks good to me. > Optimize disk access for last

[jira] [Assigned] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

2018-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-12933: Assignee: chencan > Improve logging when DFSStripedOutputStream failed to read some blocks >

[jira] [Updated] (HDFS-12742) Add support for KSM --expunge command

2018-02-01 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12742: - Status: Open (was: Patch Available) > Add support for KSM --expunge command >

[jira] [Commented] (HDFS-12983) Block Storage: provide docker-compose file for cblock clusters

2018-02-01 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348735#comment-16348735 ] Mukul Kumar Singh commented on HDFS-12983: -- Hi [~elek], Thanks for working on this. There are ASF

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-02-01 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13062: -- Fix Version/s: 3.0.1 > Provide support for JN to use separate journal disk per namespace >

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-02-01 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13062: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Provide support for JN to

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-02-01 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13062: -- Fix Version/s: 3.1.0 > Provide support for JN to use separate journal disk per namespace >

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13081: -- Status: Patch Available (was: Open) > Datanode#checkSecureConfig should check HTTPS and SASL

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349223#comment-16349223 ] Hudson commented on HDFS-12997: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13600 (See

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13081: -- Attachment: HDFS-13081.000.patch > Datanode#checkSecureConfig should check HTTPS and SASL encryption >

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349357#comment-16349357 ] Wei-Chiu Chuang commented on HDFS-11187: Thanks [~kihwal]! I plan to commit the patch 005 to

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349426#comment-16349426 ] Íñigo Goiri commented on HDFS-12512: [^HDFS-12512.005.patch] looks good. We already agreed not to fix

[jira] [Comment Edited] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349424#comment-16349424 ] Kihwal Lee edited comment on HDFS-13100 at 2/1/18 10:42 PM: Got one at TRACE.

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-02-01 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349211#comment-16349211 ] Hanisha Koneru commented on HDFS-13062: --- Thanks [~bharatviswa] for the contribution and

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349328#comment-16349328 ] Wei Yan commented on HDFS-12512: The two tests passed in my local env, and the diff doesn't behavior

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349433#comment-16349433 ] Kihwal Lee commented on HDFS-13100: --- So, it's not the hadoop code explicitly doing {{valueOf()}}, but

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349231#comment-16349231 ] Ajay Kumar commented on HDFS-13081: --- [~xyao], Uploading initial patch for review. >

[jira] [Commented] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-02-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349453#comment-16349453 ] Anu Engineer commented on HDFS-12942: - [~virajith], [~arpitagarwal] if you folks have no other

[jira] [Comment Edited] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-02-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349455#comment-16349455 ] Arpit Agarwal edited comment on HDFS-12942 at 2/1/18 11:01 PM: --- Thanks for

[jira] [Commented] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-02-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349455#comment-16349455 ] Arpit Agarwal commented on HDFS-12942: -- Thanks for reviewing and the heads up, [~anu]. I won't be

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349225#comment-16349225 ] genericqa commented on HDFS-12512: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349266#comment-16349266 ] Hudson commented on HDFS-13062: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13601 (See

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-02-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349324#comment-16349324 ] Ajay Kumar commented on HDFS-12997: --- [~xyao] thanks for review and commit. [~ajisakaa][~bharatviswa]

[jira] [Comment Edited] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-02-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349324#comment-16349324 ] Ajay Kumar edited comment on HDFS-12997 at 2/1/18 9:42 PM: --- [~xyao] thanks for

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349424#comment-16349424 ] Kihwal Lee commented on HDFS-13100: --- Got one at TRACE. {noformat} 2018-02-01 22:38:55,161

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349392#comment-16349392 ] Kihwal Lee commented on HDFS-13100: --- Reproduced the issue. Enabled DEBUG-level logging on NN, but

[jira] [Commented] (HDFS-12284) Router support for Kerberos authentication and delegation tokens

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349429#comment-16349429 ] Íñigo Goiri commented on HDFS-12284: We could split this JIRA and support secure connections for the

[jira] [Updated] (HDFS-12284) Router support for Kerberos authentication and delegation tokens

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12284: --- Target Version/s: 3.1.0 (was: HDFS-10467) > Router support for Kerberos authentication and

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349558#comment-16349558 ] Yongjun Zhang commented on HDFS-13100: -- Thank you so much [~kihwal]! That's great help! I was about

[jira] [Commented] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-02-01 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349580#comment-16349580 ] Virajith Jalaparti commented on HDFS-12942: --- Yep, looks good to me +1. Thanks for working on

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349603#comment-16349603 ] Wei Yan commented on HDFS-12512: Upload a new diff [^HDFS-12512.006.patch] which disables safe mode in

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12512: --- Attachment: HDFS-12512.006.patch > RBF: Add WebHDFS > > > Key: HDFS-12512 >

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349670#comment-16349670 ] Íñigo Goiri commented on HDFS-12512: Disabling the safe mode makes sense. Let's see if we all the unit

[jira] [Commented] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349692#comment-16349692 ] Hudson commented on HDFS-12942: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13603 (See

[jira] [Updated] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-02-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12942: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 Target

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349505#comment-16349505 ] Wei Yan commented on HDFS-12512: The last round didn't cover the newly added testcases, and there were

[jira] [Resolved] (HDFS-12087) The error message is not friendly when set a path with the policy not enabled

2018-02-01 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei resolved HDFS-12087. -- Resolution: Not A Problem > The error message is not friendly when set a path with the policy not enabled >

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13068: - Attachment: (was: HDFS-13068-branch-2.001.patch) > RBF: Add router admin option to manage safe mode >

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13068: - Attachment: HDFS-13068-branch-2.001.patch > RBF: Add router admin option to manage safe mode >

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349737#comment-16349737 ] Hudson commented on HDFS-13068: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13604 (See

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349738#comment-16349738 ] genericqa commented on HDFS-12512: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13068: - Attachment: HDFS-13068-branch-2.001.patch > RBF: Add router admin option to manage safe mode >

[jira] [Commented] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349823#comment-16349823 ] Hudson commented on HDFS-13048: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13605 (See

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349828#comment-16349828 ] genericqa commented on HDFS-13068: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349836#comment-16349836 ] genericqa commented on HDFS-13100: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13099) RBF: Refactor RBF relevant settings

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13099: - Summary: RBF: Refactor RBF relevant settings (was: RBF: Document State Store Driver relevant settings in

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13068: - Attachment: HDFS-13068-branch-3.0.001.patch > RBF: Add router admin option to manage safe mode >

[jira] [Updated] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13100: - Status: Patch Available (was: Open) > Handle IllegalArgumentException in when GETSERVERDEFAULTS

[jira] [Updated] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13100: - Attachment: HDFS-13100.001.patch > Handle IllegalArgumentException in when GETSERVERDEFAULTS is

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-02-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349802#comment-16349802 ] Wei Yan commented on HDFS-12512: Yetus job still failed in the middle, and didn't execute newly added

[jira] [Updated] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-02-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-13048: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 3.1.0

[jira] [Commented] (HDFS-13099) RBF: Document State Store Driver relevant settings in hdfs-default.xml

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349860#comment-16349860 ] Yiqun Lin commented on HDFS-13099: -- Good idea, [~elgoiri]. I'd like to move all the RBF settings into one

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349730#comment-16349730 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] Thanks for your reviews. In the lastest patch, I check

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349761#comment-16349761 ] genericqa commented on HDFS-13068: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349779#comment-16349779 ] genericqa commented on HDFS-13068: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349804#comment-16349804 ] Yongjun Zhang edited comment on HDFS-13100 at 2/2/18 5:17 AM: -- Hi [~kihwal],

[jira] [Commented] (HDFS-13100) Handle IllegalArgumentException in when GETSERVERDEFAULTS is not implemented in webhdfs.

2018-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349804#comment-16349804 ] Yongjun Zhang commented on HDFS-13100: -- Hi [~kihwal], Thanks again for your help! I attached a

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13068: - Attachment: HDFS-13068-branch-3.0.001.patch > RBF: Add router admin option to manage safe mode >

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13068: - Attachment: (was: HDFS-13068-branch-3.0.001.patch) > RBF: Add router admin option to manage safe mode

[jira] [Commented] (HDFS-13098) RBF: Datanodes interacting with Routers

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349904#comment-16349904 ] Yiqun Lin commented on HDFS-13098: -- Looks very interesting, :)! Only one question from me: Do these

[jira] [Commented] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348278#comment-16348278 ] genericqa commented on HDFS-12933: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

2018-02-01 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348194#comment-16348194 ] chencan commented on HDFS-12933: Hi  [~xiaochen], i have submit the first patch, Please help to see if

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348172#comment-16348172 ] genericqa commented on HDFS-10453: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

2018-02-01 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12933: --- Status: Patch Available (was: Open) > Improve logging when DFSStripedOutputStream failed to read some blocks

[jira] [Updated] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

2018-02-01 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12933: --- Attachment: HDFS-12933.001.patch > Improve logging when DFSStripedOutputStream failed to read some blocks >

[jira] [Created] (HDFS-13099) Document State Store Driver relevant settings in hdfs-default.xml

2018-02-01 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-13099: Summary: Document State Store Driver relevant settings in hdfs-default.xml Key: HDFS-13099 URL: https://issues.apache.org/jira/browse/HDFS-13099 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13099) Document State Store Driver relevant settings in hdfs-default.xml

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13099: - Description: Currently the > Document State Store Driver relevant settings in hdfs-default.xml >

[jira] [Updated] (HDFS-13099) Document State Store Driver relevant settings in hdfs-default.xml

2018-02-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13099: - Description: Currently the State Store Driver relevant settings only written in its implement classes.

  1   2   >