Re: HDP3.0: oozie cannot start
Thanks Lian for posting the resolution! On Thu, Aug 9, 2018 at 6:06 PM Lian Jiang wrote: > By reading 4.3.1 oozie source code, I solved the problem by adding > oozie.service.JPAService.validate.db.connection": "false". Thanks. > > On Wed, Aug 8, 2018 at 3:49 PM, Lian Jiang wrote: > > > Thanks Peter. I attached sanitized > /etc/oozie/3.0.0.0-1634/0/oozie-site.xml. > > Please let me know if you see any issue. > > > > On Mon, Jul 30, 2018 at 1:23 AM, Peter Cseh > > > wrote: > > > >> Hi! > >> > >> I'm not familiar with the details of HDP, but based on the error message > >> your xml is not well formatted. > >> > >> Based on the code: > >> https://github.com/apache/oozie/blob/master/core/src/main/ > >> java/org/apache/oozie/service/JPAService.java#L198 > >> the issue is in your driver classname or url for the jdbc. > >> Please check the generated xml files, or share them after removing > >> confidential information. > >> > >> All the best, > >> gp > >> > >> > >> On Sun, Jul 29, 2018 at 7:24 PM Lian Jiang > wrote: > >> > >> > Hi, > >> > > >> > I am installing HDP3.0 using ambari 2.7. OOZIE failed to start due to > >> below > >> > error: > >> > > >> > > >> > 2018-07-29 06:21:27,402 WARN ConfigurationService:523 - SERVER[ > >> > prod-namenode.subnet1.hadoop.oraclevcn.com] Invalid configuration > >> defined, > >> > [credentialStoreClassPath] > >> > 2018-07-29 06:21:27,406 WARN Services:523 - SERVER[ > >> > prod-namenode.subnet1.hadoop.oraclevcn.com] System ID [oozie-oozi] > >> exceeds > >> > maximum length [10], trimming > >> > 2018-07-29 06:21:27,631 WARN ConfigUtils:523 - SERVER[ > >> > prod-namenode.subnet1.hadoop.oraclevcn.com] Using a deprecated > >> > configuration property > >> > [oozie.service.AuthorizationService.security.enabled], should use > >> > [oozie.service.AuthorizationService.authorization.enabled]. Please > >> delete > >> > the deprecated property in order for the new property to take effect. > >> > 2018-07-29 06:21:28,551 FATAL Services:514 - SERVER[ > >> > prod-namenode.subnet1.hadoop.oraclevcn.com] Runtime Exception during > >> > Services Load. Check your list of 'oozie.services' or > >> 'oozie.services.ext' > >> > 2018-07-29 06:21:28,558 FATAL Services:514 - SERVER[ > >> > prod-namenode.subnet1.hadoop.oraclevcn.com] E0103: Could not load > >> service > >> > classes, Unmatched braces in the pattern. > >> > org.apache.oozie.service.ServiceException: E0103: Could not load > >> service > >> > classes, Unmatched braces in the pattern. > >> > at > >> > org.apache.oozie.service.Services.loadServices(Services.java:309) > >> > at org.apache.oozie.service.Services.init(Services.java:213) > >> > at > >> > > >> > org.apache.oozie.servlet.ServicesLoader.contextInitialized(S > >> ervicesLoader.java:46) > >> > at > >> > > >> > org.apache.catalina.core.StandardContext.listenerStart(Stand > >> ardContext.java:4276) > >> > at > >> > org.apache.catalina.core.StandardContext.start(StandardConte > >> xt.java:4779) > >> > at > >> > > >> > org.apache.catalina.core.ContainerBase.addChildInternal(Cont > >> ainerBase.java:803) > >> > at > >> > > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:780) > >> > at > >> > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583) > >> > at > >> > > >> > org.apache.catalina.startup.HostConfig.deployDescriptor(Host > >> Config.java:676) > >> > at > >> > > >> > org.apache.catalina.startup.HostConfig.deployDescriptors(Hos > >> tConfig.java:602) > >> > at > >> > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:503) > >> > at > >> > org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322) > >> > at > >> > org.apache.catalina.startup.HostConfig.lifecycleEvent(HostCo > >> nfig.java:325) > >> > at > >> > > >> > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent > >> (LifecycleSupport.java:142) > >> > at > >> > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1069) > >> > at > >> > org.apache.catalina.core.StandardHost.start(StandardHost.java:822) > >> > at > >> > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061) > >> > at > >> > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) > >> > at > >> > org.apache.catalina.core.StandardService.start(StandardServi > >> ce.java:525) > >> > at > >> > org.apache.catalina.core.StandardServer.start(StandardServer.java:761) > >> > at > org.apache.catalina.startup.Catalina.start(Catalina.java:595 > >> ) > >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> > at > >> > > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcce > >> ssorImpl.java:62) > >> > at > >> > > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe > >> thodAccessorImpl.java:43) > >> > at
Re: HDP3.0: oozie cannot start
By reading 4.3.1 oozie source code, I solved the problem by adding oozie.service.JPAService.validate.db.connection": "false". Thanks. On Wed, Aug 8, 2018 at 3:49 PM, Lian Jiang wrote: > Thanks Peter. I attached sanitized /etc/oozie/3.0.0.0-1634/0/oozie-site.xml. > Please let me know if you see any issue. > > On Mon, Jul 30, 2018 at 1:23 AM, Peter Cseh > wrote: > >> Hi! >> >> I'm not familiar with the details of HDP, but based on the error message >> your xml is not well formatted. >> >> Based on the code: >> https://github.com/apache/oozie/blob/master/core/src/main/ >> java/org/apache/oozie/service/JPAService.java#L198 >> the issue is in your driver classname or url for the jdbc. >> Please check the generated xml files, or share them after removing >> confidential information. >> >> All the best, >> gp >> >> >> On Sun, Jul 29, 2018 at 7:24 PM Lian Jiang wrote: >> >> > Hi, >> > >> > I am installing HDP3.0 using ambari 2.7. OOZIE failed to start due to >> below >> > error: >> > >> > >> > 2018-07-29 06:21:27,402 WARN ConfigurationService:523 - SERVER[ >> > prod-namenode.subnet1.hadoop.oraclevcn.com] Invalid configuration >> defined, >> > [credentialStoreClassPath] >> > 2018-07-29 06:21:27,406 WARN Services:523 - SERVER[ >> > prod-namenode.subnet1.hadoop.oraclevcn.com] System ID [oozie-oozi] >> exceeds >> > maximum length [10], trimming >> > 2018-07-29 06:21:27,631 WARN ConfigUtils:523 - SERVER[ >> > prod-namenode.subnet1.hadoop.oraclevcn.com] Using a deprecated >> > configuration property >> > [oozie.service.AuthorizationService.security.enabled], should use >> > [oozie.service.AuthorizationService.authorization.enabled]. Please >> delete >> > the deprecated property in order for the new property to take effect. >> > 2018-07-29 06:21:28,551 FATAL Services:514 - SERVER[ >> > prod-namenode.subnet1.hadoop.oraclevcn.com] Runtime Exception during >> > Services Load. Check your list of 'oozie.services' or >> 'oozie.services.ext' >> > 2018-07-29 06:21:28,558 FATAL Services:514 - SERVER[ >> > prod-namenode.subnet1.hadoop.oraclevcn.com] E0103: Could not load >> service >> > classes, Unmatched braces in the pattern. >> > org.apache.oozie.service.ServiceException: E0103: Could not load >> service >> > classes, Unmatched braces in the pattern. >> > at >> > org.apache.oozie.service.Services.loadServices(Services.java:309) >> > at org.apache.oozie.service.Services.init(Services.java:213) >> > at >> > >> > org.apache.oozie.servlet.ServicesLoader.contextInitialized(S >> ervicesLoader.java:46) >> > at >> > >> > org.apache.catalina.core.StandardContext.listenerStart(Stand >> ardContext.java:4276) >> > at >> > org.apache.catalina.core.StandardContext.start(StandardConte >> xt.java:4779) >> > at >> > >> > org.apache.catalina.core.ContainerBase.addChildInternal(Cont >> ainerBase.java:803) >> > at >> > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:780) >> > at >> > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583) >> > at >> > >> > org.apache.catalina.startup.HostConfig.deployDescriptor(Host >> Config.java:676) >> > at >> > >> > org.apache.catalina.startup.HostConfig.deployDescriptors(Hos >> tConfig.java:602) >> > at >> > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:503) >> > at >> > org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322) >> > at >> > org.apache.catalina.startup.HostConfig.lifecycleEvent(HostCo >> nfig.java:325) >> > at >> > >> > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent >> (LifecycleSupport.java:142) >> > at >> > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1069) >> > at >> > org.apache.catalina.core.StandardHost.start(StandardHost.java:822) >> > at >> > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061) >> > at >> > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) >> > at >> > org.apache.catalina.core.StandardService.start(StandardServi >> ce.java:525) >> > at >> > org.apache.catalina.core.StandardServer.start(StandardServer.java:761) >> > at org.apache.catalina.startup.Catalina.start(Catalina.java:595 >> ) >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> > at >> > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcce >> ssorImpl.java:62) >> > at >> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe >> thodAccessorImpl.java:43) >> > at java.lang.reflect.Method.invoke(Method.java:498) >> > at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java: >> 289) >> > at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:41 >> 4) >> > Caused by: java.lang.IllegalArgumentException: Unmatched braces in the >> > pattern. >> > at
Re: HDP3.0: oozie cannot start
Thanks Peter. I attached sanitized /etc/oozie/3.0.0.0-1634/0/oozie-site.xml. Please let me know if you see any issue. On Mon, Jul 30, 2018 at 1:23 AM, Peter Cseh wrote: > Hi! > > I'm not familiar with the details of HDP, but based on the error message > your xml is not well formatted. > > Based on the code: > https://github.com/apache/oozie/blob/master/core/src/ > main/java/org/apache/oozie/service/JPAService.java#L198 > the issue is in your driver classname or url for the jdbc. > Please check the generated xml files, or share them after removing > confidential information. > > All the best, > gp > > > On Sun, Jul 29, 2018 at 7:24 PM Lian Jiang wrote: > > > Hi, > > > > I am installing HDP3.0 using ambari 2.7. OOZIE failed to start due to > below > > error: > > > > > > 2018-07-29 06:21:27,402 WARN ConfigurationService:523 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] Invalid configuration > defined, > > [credentialStoreClassPath] > > 2018-07-29 06:21:27,406 WARN Services:523 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] System ID [oozie-oozi] > exceeds > > maximum length [10], trimming > > 2018-07-29 06:21:27,631 WARN ConfigUtils:523 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] Using a deprecated > > configuration property > > [oozie.service.AuthorizationService.security.enabled], should use > > [oozie.service.AuthorizationService.authorization.enabled]. Please > delete > > the deprecated property in order for the new property to take effect. > > 2018-07-29 06:21:28,551 FATAL Services:514 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] Runtime Exception during > > Services Load. Check your list of 'oozie.services' or > 'oozie.services.ext' > > 2018-07-29 06:21:28,558 FATAL Services:514 - SERVER[ > > prod-namenode.subnet1.hadoop.oraclevcn.com] E0103: Could not load > service > > classes, Unmatched braces in the pattern. > > org.apache.oozie.service.ServiceException: E0103: Could not load service > > classes, Unmatched braces in the pattern. > > at > > org.apache.oozie.service.Services.loadServices(Services.java:309) > > at org.apache.oozie.service.Services.init(Services.java:213) > > at > > > > org.apache.oozie.servlet.ServicesLoader.contextInitialized( > ServicesLoader.java:46) > > at > > > > org.apache.catalina.core.StandardContext.listenerStart( > StandardContext.java:4276) > > at > > org.apache.catalina.core.StandardContext.start( > StandardContext.java:4779) > > at > > > > org.apache.catalina.core.ContainerBase.addChildInternal( > ContainerBase.java:803) > > at > > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:780) > > at > > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583) > > at > > > > org.apache.catalina.startup.HostConfig.deployDescriptor( > HostConfig.java:676) > > at > > > > org.apache.catalina.startup.HostConfig.deployDescriptors( > HostConfig.java:602) > > at > > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:503) > > at > > org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322) > > at > > org.apache.catalina.startup.HostConfig.lifecycleEvent( > HostConfig.java:325) > > at > > > > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent( > LifecycleSupport.java:142) > > at > > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1069) > > at > > org.apache.catalina.core.StandardHost.start(StandardHost.java:822) > > at > > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061) > > at > > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) > > at > > org.apache.catalina.core.StandardService.start(StandardService.java:525) > > at > > org.apache.catalina.core.StandardServer.start(StandardServer.java:761) > > at org.apache.catalina.startup.Catalina.start(Catalina.java:595) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > > sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) > > at > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > > at org.apache.catalina.startup.Bootstrap.start(Bootstrap. > java:289) > > at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java: > 414) > > Caused by: java.lang.IllegalArgumentException: Unmatched braces in the > > pattern. > > at java.text.MessageFormat.applyPattern(MessageFormat.java:508) > > at java.text.MessageFormat.(MessageFormat.java:362) > > at java.text.MessageFormat.format(MessageFormat.java:840) > > at org.apache.oozie.service.JPAService.init(JPAService.java:197) > > at > > org.apache.oozie.service.Services.setServiceInternal(Services.java:386) > > at
Re: HDP3.0: oozie cannot start
Hi! I'm not familiar with the details of HDP, but based on the error message your xml is not well formatted. Based on the code: https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/JPAService.java#L198 the issue is in your driver classname or url for the jdbc. Please check the generated xml files, or share them after removing confidential information. All the best, gp On Sun, Jul 29, 2018 at 7:24 PM Lian Jiang wrote: > Hi, > > I am installing HDP3.0 using ambari 2.7. OOZIE failed to start due to below > error: > > > 2018-07-29 06:21:27,402 WARN ConfigurationService:523 - SERVER[ > prod-namenode.subnet1.hadoop.oraclevcn.com] Invalid configuration defined, > [credentialStoreClassPath] > 2018-07-29 06:21:27,406 WARN Services:523 - SERVER[ > prod-namenode.subnet1.hadoop.oraclevcn.com] System ID [oozie-oozi] exceeds > maximum length [10], trimming > 2018-07-29 06:21:27,631 WARN ConfigUtils:523 - SERVER[ > prod-namenode.subnet1.hadoop.oraclevcn.com] Using a deprecated > configuration property > [oozie.service.AuthorizationService.security.enabled], should use > [oozie.service.AuthorizationService.authorization.enabled]. Please delete > the deprecated property in order for the new property to take effect. > 2018-07-29 06:21:28,551 FATAL Services:514 - SERVER[ > prod-namenode.subnet1.hadoop.oraclevcn.com] Runtime Exception during > Services Load. Check your list of 'oozie.services' or 'oozie.services.ext' > 2018-07-29 06:21:28,558 FATAL Services:514 - SERVER[ > prod-namenode.subnet1.hadoop.oraclevcn.com] E0103: Could not load service > classes, Unmatched braces in the pattern. > org.apache.oozie.service.ServiceException: E0103: Could not load service > classes, Unmatched braces in the pattern. > at > org.apache.oozie.service.Services.loadServices(Services.java:309) > at org.apache.oozie.service.Services.init(Services.java:213) > at > > org.apache.oozie.servlet.ServicesLoader.contextInitialized(ServicesLoader.java:46) > at > > org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4276) > at > org.apache.catalina.core.StandardContext.start(StandardContext.java:4779) > at > > org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:803) > at > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:780) > at > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583) > at > > org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:676) > at > > org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:602) > at > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:503) > at > org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322) > at > org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:325) > at > > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142) > at > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1069) > at > org.apache.catalina.core.StandardHost.start(StandardHost.java:822) > at > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1061) > at > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) > at > org.apache.catalina.core.StandardService.start(StandardService.java:525) > at > org.apache.catalina.core.StandardServer.start(StandardServer.java:761) > at org.apache.catalina.startup.Catalina.start(Catalina.java:595) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) > at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) > Caused by: java.lang.IllegalArgumentException: Unmatched braces in the > pattern. > at java.text.MessageFormat.applyPattern(MessageFormat.java:508) > at java.text.MessageFormat.(MessageFormat.java:362) > at java.text.MessageFormat.format(MessageFormat.java:840) > at org.apache.oozie.service.JPAService.init(JPAService.java:197) > at > org.apache.oozie.service.Services.setServiceInternal(Services.java:386) > at org.apache.oozie.service.Services.setService(Services.java:372) > at > org.apache.oozie.service.Services.loadServices(Services.java:305) > ... 26 more > > > > My oozie settings which worked in HDP2.6 is: > > { > "oozie-site": { > "properties": { > "oozie.service.JPAService.jdbc.username": "admin", > "oozie.service.JPAService.jdbc.password": "%SERVICE_PASSWORD%", >