[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-02-14 Thread Wei-Chiu Chuang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei-Chiu Chuang updated HDFS-11333:
---
Attachment: HDFS-11333.003.patch

Thanks for catching that [~linyiqun].
Copied the second 002 patch to 003. I would prefer to keep the patch history.

> Namenode unable to start if plugins can not be found
> 
>
> Key: HDFS-11333
> URL: https://issues.apache.org/jira/browse/HDFS-11333
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: namenode
>Affects Versions: 0.21.0
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>  Labels: supportability
> Attachments: HDFS-11333.001.patch, HDFS-11333.002.patch, 
> HDFS-11333.002.patch, HDFS-11333.003.patch
>
>
> If NameNode is unable to find plugins (specified in dfs.namenode.plugins), it 
> terminates abruptly with the following stack trace:
> {quote}
> Failed to start namenode.
> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class XXX not 
> found
>   at org.apache.hadoop.conf.Configuration.getClasses(Configuration.java:2178)
>   at 
> org.apache.hadoop.conf.Configuration.getInstances(Configuration.java:2250)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:713)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:691)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:843)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:822)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1543)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1611)
> {quote}
> We should catch this exception, log a warning message and let it proceed, as 
> missing the third party library does not affect the functionality of 
> NameNode. We caught this bug during a CDH upgrade where a third party plugin 
> was not in the lib directory of the newer version of CDH.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-02-13 Thread Wei-Chiu Chuang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei-Chiu Chuang updated HDFS-11333:
---
Attachment: HDFS-11333.002.patch
HDFS-11333.002.patch

Thanks [~linyiqun].
Posted my v002 patch.

Add an *error* message that explicitly says what the exception means. The 
exception is rethrown afterwards. Also, print the list of plugins to help 
troubleshooting.

> Namenode unable to start if plugins can not be found
> 
>
> Key: HDFS-11333
> URL: https://issues.apache.org/jira/browse/HDFS-11333
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: namenode
>Affects Versions: 0.21.0
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>  Labels: supportability
> Attachments: HDFS-11333.001.patch, HDFS-11333.002.patch, 
> HDFS-11333.002.patch
>
>
> If NameNode is unable to find plugins (specified in dfs.namenode.plugins), it 
> terminates abruptly with the following stack trace:
> {quote}
> Failed to start namenode.
> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class XXX not 
> found
>   at org.apache.hadoop.conf.Configuration.getClasses(Configuration.java:2178)
>   at 
> org.apache.hadoop.conf.Configuration.getInstances(Configuration.java:2250)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:713)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:691)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:843)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:822)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1543)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1611)
> {quote}
> We should catch this exception, log a warning message and let it proceed, as 
> missing the third party library does not affect the functionality of 
> NameNode. We caught this bug during a CDH upgrade where a third party plugin 
> was not in the lib directory of the newer version of CDH.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei-Chiu Chuang updated HDFS-11333:
---
Assignee: Wei-Chiu Chuang
  Status: Patch Available  (was: Open)

> Namenode unable to start if plugins can not be found
> 
>
> Key: HDFS-11333
> URL: https://issues.apache.org/jira/browse/HDFS-11333
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: namenode
>Affects Versions: 0.21.0
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>  Labels: supportability
> Attachments: HDFS-11333.001.patch
>
>
> If NameNode is unable to find plugins (specified in dfs.namenode.plugins), it 
> terminates abruptly with the following stack trace:
> {quote}
> Failed to start namenode.
> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class XXX not 
> found
>   at org.apache.hadoop.conf.Configuration.getClasses(Configuration.java:2178)
>   at 
> org.apache.hadoop.conf.Configuration.getInstances(Configuration.java:2250)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:713)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:691)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:843)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:822)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1543)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1611)
> {quote}
> We should catch this exception, log a warning message and let it proceed, as 
> missing the third party library does not affect the functionality of 
> NameNode. We caught this bug during a CDH upgrade where a third party plugin 
> was not in the lib directory of the newer version of CDH.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei-Chiu Chuang updated HDFS-11333:
---
Labels: supportability  (was: )

> Namenode unable to start if plugins can not be found
> 
>
> Key: HDFS-11333
> URL: https://issues.apache.org/jira/browse/HDFS-11333
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: namenode
>Affects Versions: 0.21.0
>Reporter: Wei-Chiu Chuang
>  Labels: supportability
> Attachments: HDFS-11333.001.patch
>
>
> If NameNode is unable to find plugins (specified in dfs.namenode.plugins), it 
> terminates abruptly with the following stack trace:
> {quote}
> Failed to start namenode.
> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class XXX not 
> found
>   at org.apache.hadoop.conf.Configuration.getClasses(Configuration.java:2178)
>   at 
> org.apache.hadoop.conf.Configuration.getInstances(Configuration.java:2250)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:713)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:691)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:843)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:822)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1543)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1611)
> {quote}
> We should catch this exception, log a warning message and let it proceed, as 
> missing the third party library does not affect the functionality of 
> NameNode. We caught this bug during a CDH upgrade where a third party plugin 
> was not in the lib directory of the newer version of CDH.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-11333) Namenode unable to start if plugins can not be found

2017-01-11 Thread Wei-Chiu Chuang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei-Chiu Chuang updated HDFS-11333:
---
Attachment: HDFS-11333.001.patch

Attach a patch with a simple unit test.

> Namenode unable to start if plugins can not be found
> 
>
> Key: HDFS-11333
> URL: https://issues.apache.org/jira/browse/HDFS-11333
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: namenode
>Affects Versions: 0.21.0
>Reporter: Wei-Chiu Chuang
>  Labels: supportability
> Attachments: HDFS-11333.001.patch
>
>
> If NameNode is unable to find plugins (specified in dfs.namenode.plugins), it 
> terminates abruptly with the following stack trace:
> {quote}
> Failed to start namenode.
> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class XXX not 
> found
>   at org.apache.hadoop.conf.Configuration.getClasses(Configuration.java:2178)
>   at 
> org.apache.hadoop.conf.Configuration.getInstances(Configuration.java:2250)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:713)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:691)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:843)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:822)
>   at 
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1543)
>   at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1611)
> {quote}
> We should catch this exception, log a warning message and let it proceed, as 
> missing the third party library does not affect the functionality of 
> NameNode. We caught this bug during a CDH upgrade where a third party plugin 
> was not in the lib directory of the newer version of CDH.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org