Hello,
We see in the attached log the following line:
2017-06-28 18:44:20,894 ERROR [main] o.a.z.server.quorum.QuorumPeerConfig
does not have the form host:port or host:port:port or host:port:port:type
The code in ZooKeeper that produces this line looks like this:
} else if (key.startsWith("server.")) {
int dot = key.indexOf('.');
long sid = Long.parseLong(key.substring(dot + 1));
String parts[] = value.split(":");
if ((parts.length != 2) && (parts.length != 3) && (parts.length
!=4)) {
LOG.error(value
+ " does not have the form host:port or host:port:port "
+
" or host:port:port:type");
}
So we can see here that it is in fact logging the invalid value. But since we
don't see it in the logs, which means that it is some
sort of white space. From what you pasted, all looks good, but can you
double-check your zookeeper.properties file again and
make sure that there's not something in it like:
server.3=
Or perhaps some sort of non-printable character in one of the two server.1=,
server.2= lines?
Thanks
-Mark
On Jun 28, 2017, at 9:45 AM, nifi-san
<nairsande...@gmail.com<mailto:nairsande...@gmail.com>> wrote:
I am trying to set up a fresh nifi cluster with 2 nodes.Details below:-
OS-104-Ubuntu
Nifi version 1.3.0
jdk - Oracle jdk-1.8.0_131
I tried to start the nifi nodes in a non clustered mode and both of them
started up fine.
After that,I have been trying to set up the 2 node nifi cluster and it fails
everytime with the below error:-
2017-06-28 18:44:12,769 WARN [main] o.a.n.d.html.HtmlDocumentationWriter
Could not link to
org.apache.nifi.couchbase.CouchbaseClusterControllerService becaus
e no bundles were found
2017-06-28 18:44:12,857 WARN [main] o.a.n.d.html.HtmlDocumentationWriter
Could not link to
org.apache.nifi.couchbase.CouchbaseClusterControllerService becaus
e no bundles were found
2017-06-28 18:44:12,894 WARN [main] o.a.n.d.html.HtmlDocumentationWriter
Could not link to
org.apache.nifi.distributed.cache.server.map.DistributedMapCacheCl
ient because no bundles were found
2017-06-28 18:44:12,912 INFO [main] org.eclipse.jetty.server.Server
jetty-9.4.3.v20170317
2017-06-28 18:44:13,068 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=81ms
2017-06-28 18:44:13,210 INFO [main] org.eclipse.jetty.server.session
DefaultSessionIdManager workerName=node0
2017-06-28 18:44:13,211 INFO [main] org.eclipse.jetty.server.session No
SessionScavenger set, using defaults
2017-06-28 18:44:13,212 INFO [main] org.eclipse.jetty.server.session
Scavenging every 600000ms
2017-06-28 18:44:13,246 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@34009349{/nifi-image-viewer-1.3.0,file:///opt/nifi/
nifi-1.3.0/work/jetty/nifi-image-viewer-1.3.0.war/webapp/,AVAILABLE}{./work/nar/extensions/nifi-media-nar-1.3.0.nar-unpacked/META-INF/bundled-dependencies/ni
fi-image-viewer-1.3.0.war}
2017-06-28 18:44:14,113 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=733ms
2017-06-28 18:44:14,261 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@44fd7ba4{/nifi-update-attribute-ui-1.3.0,file:///op
t/nifi/nifi-1.3.0/work/jetty/nifi-update-attribute-ui-1.3.0.war/webapp/,AVAILABLE}{./work/nar/extensions/nifi-update-attribute-nar-1.3.0.nar-unpacked/META-IN
F/bundled-dependencies/nifi-update-attribute-ui-1.3.0.war}
2017-06-28 18:44:14,814 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=464ms
2017-06-28 18:44:14,858 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@167a21b{/nifi-standard-content-viewer-1.3.0,file://
/opt/nifi/nifi-1.3.0/work/jetty/nifi-standard-content-viewer-1.3.0.war/webapp/,AVAILABLE}{./work/nar/extensions/nifi-standard-nar-1.3.0.nar-unpacked/META-INF
/bundled-dependencies/nifi-standard-content-viewer-1.3.0.war}
2017-06-28 18:44:16,299 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=1235ms
2017-06-28 18:44:16,363 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@3dc39459{/nifi-jolt-transform-json-ui-1.3.0,file://
/opt/nifi/nifi-1.3.0/work/jetty/nifi-jolt-transform-json-ui-1.3.0.war/webapp/,AVAILABLE}{./work/nar/extensions/nifi-standard-nar-1.3.0.nar-unpacked/META-INF/
bundled-dependencies/nifi-jolt-transform-json-ui-1.3.0.war}
2017-06-28 18:44:16,539 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=55ms
2017-06-28 18:44:16,549 INFO [main] org.eclipse.jetty.ContextHandler./nifi
No Spring WebApplicationInitializer types detected on classpath
2017-06-28 18:44:16,591 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@2bdab835{/nifi,file:///opt/nifi/nifi-1.3.0/work/jet
ty/nifi-web-ui-1.3.0.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.3.0.nar-unpacked/META-INF/bundled-dependencies/nifi-web-ui-1.3.0.war}
2017-06-28 18:44:16,713 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=77ms
2017-06-28 18:44:16,755 INFO [main] o.eclipse.jetty.ContextHandler./nifi-api
No Spring WebApplicationInitializer types detected on classpath
2017-06-28 18:44:16,792 INFO [main] o.eclipse.jetty.ContextHandler./nifi-api
Initializing Spring root WebApplicationContext
2017-06-28 18:44:19,047 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader
Determined default nifi.properties path to be
'/opt/nifi/nifi-1.3.0/./conf/nifi.
properties'
2017-06-28 18:44:19,048 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader
Determined default nifi.properties path to be
'/opt/nifi/nifi-1.3.0/./conf/nifi.
properties'
2017-06-28 18:44:19,049 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader
Loaded 125 properties from /opt/nifi/nifi-1.3.0/./conf/nifi.properties
2017-06-28 18:44:20,511 INFO [main] o.a.nifi.util.FileBasedVariableRegistry
Loaded 86 properties from system properties and environment variables
2017-06-28 18:44:20,511 INFO [main] o.a.nifi.util.FileBasedVariableRegistry
Loaded a total of 86 properties. Including precedence overrides effective
access
ible registry key size is 86
2017-06-28 18:44:20,558 INFO [main] o.a.n.c.r.WriteAheadFlowFileRepository
Initialized FlowFile Repository using 256 partitions
2017-06-28 18:44:20,741 INFO [main] o.a.n.p.lucene.SimpleIndexManager Index
Writer for ./provenance_repository/index-1498647000000 has been returned to
Index
Manager and is no longer in use. Closing Index Writer
2017-06-28 18:44:20,745 INFO [main] o.a.n.p.PersistentProvenanceRepository
Recovered 0 records
2017-06-28 18:44:20,753 INFO [main] o.a.n.p.PersistentProvenanceRepository
Created new Provenance Event Writers for events starting with ID 0
2017-06-28 18:44:20,757 INFO [main] o.a.n.c.repository.FileSystemRepository
Maximum Threshold for Container default set to 15975036846 bytes; if volume
excee
ds this size, archived data will be deleted until it no longer exceeds this
size
2017-06-28 18:44:20,757 INFO [main] o.a.n.c.repository.FileSystemRepository
Initializing FileSystemRepository with 'Always Sync' set to false
2017-06-28 18:44:20,839 INFO [main] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@468eff41 finished recovering records.
Performin
g Checkpoint to ensure proper state of Partitions before updates
2017-06-28 18:44:20,839 INFO [main] org.wali.MinimalLockingWriteAheadLog
Successfully recovered 0 records in 3 milliseconds
2017-06-28 18:44:20,850 INFO [main] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@468eff41 checkpointed with 0 Records
and 0 Swap
Files in 10 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit
Logs time = 2 millis), max Transaction ID -1
2017-06-28 18:44:20,894 ERROR [main] o.a.z.server.quorum.QuorumPeerConfig
does not have the form host:port or host:port:port or host:port:port:type
2017-06-28 18:44:20,897 WARN [main] org.eclipse.jetty.webapp.WebAppContext
Failed startup of context
o.e.j.w.WebAppContext@7e764e5c{/nifi-api,file:///opt/nif
i/nifi-1.3.0/work/jetty/nifi-web-api-1.3.0.war/webapp/,UNAVAILABLE}{./work/nar/framework/nifi-framework-nar-1.3.0.nar-unpacked/META-INF/bundled-dependencies/
nifi-web-api-1.3.0.war}
org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller.
at
org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:88)
at
org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:876)
at
org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:532)
at
org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:839)
at
org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:344)
at
org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1480)
at
org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1442)
at
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:799)
at
org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:261)
at
org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:540)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at
org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:290)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.server.Server.start(Server.java:452)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at org.eclipse.jetty.server.Server.doStart(Server.java:419)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.apache.nifi.web.server.JettyServer.start(JettyServer.java:705)
at org.apache.nifi.NiFi.<init>(NiFi.java:160)
at org.apache.nifi.NiFi.main(NiFi.java:267)
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'flowService': FactoryBean threw exception on object
creati
on; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name 'flowController': FactoryBean threw exception
on object creation; nested exception is
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:175)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1585)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:317)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
at
org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1060)
at
org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:55)
... 28 common frames omitted
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'flowController': FactoryBean threw exception on
object cre
ation; nested exception is java.lang.ArrayIndexOutOfBoundsException: 1
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:175)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1585)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:317)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
at
org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1060)
at
org.apache.nifi.spring.StandardFlowServiceFactoryBean.getObject(StandardFlowServiceFactoryBean.java:48)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168)
... 34 common frames omitted
Caused by: java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.zookeeper.server.quorum.QuorumPeerConfig.parseProperties(QuorumPeerConfig.java:188)
at
org.apache.nifi.controller.state.server.ZooKeeperStateServer.<init>(ZooKeeperStateServer.java:53)
at
org.apache.nifi.controller.state.server.ZooKeeperStateServer.create(ZooKeeperStateServer.java:176)
at
org.apache.nifi.controller.FlowController.<init>(FlowController.java:575)
at
org.apache.nifi.controller.FlowController.createClusteredInstance(FlowController.java:417)
at
org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:61)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168)
... 41 common frames omitted
2017-06-28 18:44:21,436 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=408ms
2017-06-28 18:44:21,465 INFO [main] o.e.j.C./nifi-content-viewer No Spring
WebApplicationInitializer types detected on classpath
2017-06-28 18:44:21,468 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@7ed5cc8c{/nifi-content-viewer,file:///opt/nifi/nifi
-1.3.0/work/jetty/nifi-web-content-viewer-1.3.0.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.3.0.nar-unpacked/META-INF/bundled-dependenci
es/nifi-web-content-viewer-1.3.0.war}
2017-06-28 18:44:21,470 INFO [main] o.e.jetty.server.handler.ContextHandler
Started o.e.j.s.h.ContextHandler@374bf34b{/nifi-docs,null,AVAILABLE}
2017-06-28 18:44:21,500 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=19ms
2017-06-28 18:44:21,502 INFO [main] o.e.jetty.ContextHandler./nifi-docs No
Spring WebApplicationInitializer types detected on classpath
2017-06-28 18:44:21,529 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@67aaf882{/nifi-docs,file:///opt/nifi/nifi-1.3.0/wor
k/jetty/nifi-web-docs-1.3.0.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.3.0.nar-unpacked/META-INF/bundled-dependencies/nifi-web-docs-1.3
.0.war}
2017-06-28 18:44:21,566 INFO [main] o.e.j.a.AnnotationConfiguration Scanning
elapsed time=21ms
2017-06-28 18:44:21,581 INFO [main] org.eclipse.jetty.ContextHandler./ No
Spring WebApplicationInitializer types detected on classpath
2017-06-28 18:44:21,584 INFO [main] o.e.jetty.server.handler.ContextHandler
Started
o.e.j.w.WebAppContext@65b1693c{/,file:///opt/nifi/nifi-1.3.0/work/jetty/n
ifi-web-error-1.3.0.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.3.0.nar-unpacked/META-INF/bundled-dependencies/nifi-web-error-1.3.0.war}
2017-06-28 18:44:21,600 INFO [main] o.eclipse.jetty.server.AbstractConnector
Started ServerConnector@1c09bb7a{HTTP/1.1,[http/1.1]}{hostname-1:8080}
2017-06-28 18:44:21,601 INFO [main] org.eclipse.jetty.server.Server Started
@16693ms
2017-06-28 18:44:21,601 WARN [main] org.apache.nifi.web.server.JettyServer
Failed to start web server... shutting down.
org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller.
at
org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:88)
at
org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:876)
at
org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:532)
at
org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:839)
at
org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:344)
at
org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1480)
at
org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1442)
at
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:799)
at
org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:261)
at
org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:540)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at
org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:290)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.server.Server.start(Server.java:452)
at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113)
at org.eclipse.jetty.server.Server.doStart(Server.java:419)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at
org.apache.nifi.web.server.JettyServer.start(JettyServer.java:705)
at org.apache.nifi.NiFi.<init>(NiFi.java:160)
at org.apache.nifi.NiFi.main(NiFi.java:267)
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'flowService': FactoryBean threw exception on object
creati
on; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name 'flowController': FactoryBean threw exception
on object creation; nested exception is
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:175)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1585)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:317)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
at
org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1060)
at
org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:55)
... 28 common frames omitted
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'flowController': FactoryBean threw exception on
object cre
ation; nested exception is java.lang.ArrayIndexOutOfBoundsException: 1
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:175)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1585)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:317)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
at
org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1060)
at
org.apache.nifi.spring.StandardFlowServiceFactoryBean.getObject(StandardFlowServiceFactoryBean.java:48)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168)
... 34 common frames omitted
Caused by: java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.zookeeper.server.quorum.QuorumPeerConfig.parseProperties(QuorumPeerConfig.java:188)
at
org.apache.nifi.controller.state.server.ZooKeeperStateServer.<init>(ZooKeeperStateServer.java:53)
at
org.apache.nifi.controller.state.server.ZooKeeperStateServer.create(ZooKeeperStateServer.java:176)
at
org.apache.nifi.controller.FlowController.<init>(FlowController.java:575)
at
org.apache.nifi.controller.FlowController.createClusteredInstance(FlowController.java:417)
at
org.apache.nifi.spring.FlowControllerFactoryBean.getObject(FlowControllerFactoryBean.java:61)
at
org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168)
... 41 common frames omitted
2017-06-28 18:44:21,602 INFO [Thread-1] org.apache.nifi.NiFi Initiating
shutdown of Jetty web server...
2017-06-28 18:44:21,613 INFO [Thread-1]
o.eclipse.jetty.server.AbstractConnector Stopped
ServerConnector@1c09bb7a{HTTP/1.1,[http/1.1]}{hostname-1:8080}
2017-06-28 18:44:21,613 INFO [Thread-1] org.eclipse.jetty.server.session
Stopped scavenging
I have validated all the configurations and below are my nifi.properties and
zookeeper.properties files:-
nifi.properties
more nifi.properties
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# Core Properties #
nifi.flow.configuration.file=./conf/flow.xml.gz
nifi.flow.configuration.archive.enabled=true
nifi.flow.configuration.archive.dir=./conf/archive/
nifi.flow.configuration.archive.max.time=30 days
nifi.flow.configuration.archive.max.storage=500 MB
nifi.flow.configuration.archive.max.count=
nifi.flowcontroller.autoResumeState=true
nifi.flowcontroller.graceful.shutdown.period=10 sec
nifi.flowservice.writedelay.interval=500 ms
nifi.administrative.yield.duration=30 sec
# If a component has no work to do (is "bored"), how long should we wait
before checking again for work?
nifi.bored.yield.duration=10 millis
nifi.authorizer.configuration.file=./conf/authorizers.xml
nifi.login.identity.provider.configuration.file=./conf/login-identity-providers.xml
nifi.templates.directory=./conf/templates
nifi.ui.banner.text=
nifi.ui.autorefresh.interval=30 sec
nifi.nar.library.directory=./lib
nifi.nar.working.directory=./work/nar/
nifi.documentation.working.directory=./work/docs/components
####################
# State Management #
####################
nifi.state.management.configuration.file=./conf/state-management.xml
# The ID of the local state provider
nifi.state.management.provider.local=local-provider
# The ID of the cluster-wide state provider. This will be ignored if NiFi is
not clustered but must be populated if running in a cluster.
nifi.state.management.provider.cluster=zk-provider
# Specifies whether or not this instance of NiFi should run an embedded
ZooKeeper server
#nifi.state.management.embedded.zookeeper.start=false
nifi.state.management.embedded.zookeeper.start=true
# Properties file that provides the ZooKeeper properties to use if
<nifi.state.management.embedded.zookeeper.start> is set to true
nifi.state.management.embedded.zookeeper.properties=./conf/zookeeper.properties
# H2 Settings
nifi.database.directory=./database_repository
nifi.h2.url.append=;LOCK_TIMEOUT=25000;WRITE_DELAY=0;AUTO_SERVER=FALSE
# FlowFile Repository
nifi.flowfile.repository.implementation=org.apache.nifi.controller.repository.WriteAheadFlowFileRepository
nifi.flowfile.repository.directory=./flowfile_repository
nifi.flowfile.repository.partitions=256
nifi.flowfile.repository.checkpoint.interval=2 mins
nifi.flowfile.repository.always.sync=false
nifi.swap.manager.implementation=org.apache.nifi.controller.FileSystemSwapManager
nifi.queue.swap.threshold=20000
nifi.swap.in.period=5 sec
nifi.swap.in.threads=1
nifi.swap.out.period=5 sec
nifi.swap.out.threads=4
# Content Repository
nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository
nifi.content.claim.max.appendable.size=10 MB
nifi.content.claim.max.flow.files=100
nifi.content.repository.directory.default=./content_repository
nifi.content.repository.archive.max.retention.period=12 hours
nifi.content.repository.archive.max.usage.percentage=50%
nifi.content.repository.archive.enabled=true
nifi.content.repository.always.sync=false
nifi.content.viewer.url=/nifi-content-viewer/
# Provenance Repository Properties
nifi.provenance.repository.implementation=org.apache.nifi.provenance.PersistentProvenanceRepository
nifi.provenance.repository.debug.frequency=1_000_000
nifi.provenance.repository.encryption.key.provider.implementation=
nifi.provenance.repository.encryption.key.provider.location=
nifi.provenance.repository.encryption.key.id=
nifi.provenance.repository.encryption.key=
# Persistent Provenance Repository Properties
nifi.provenance.repository.directory.default=./provenance_repository
nifi.provenance.repository.max.storage.time=24 hours
nifi.provenance.repository.max.storage.size=1 GB
nifi.provenance.repository.rollover.time=30 secs
nifi.provenance.repository.rollover.size=100 MB
nifi.provenance.repository.query.threads=2
nifi.provenance.repository.index.threads=2
nifi.provenance.repository.compress.on.rollover=true
nifi.provenance.repository.always.sync=false
nifi.provenance.repository.journal.count=16
# Comma-separated list of fields. Fields that are not indexed will not be
searchable. Valid fields are:
# EventType, FlowFileUUID, Filename, TransitURI, ProcessorID,
AlternateIdentifierURI, Relationship, Details
nifi.provenance.repository.indexed.fields=EventType, FlowFileUUID, Filename,
ProcessorID, Relationship
# FlowFile Attributes that should be indexed and made searchable. Some
examples to consider are filename, uuid, mime.type
nifi.provenance.repository.indexed.attributes=
# Large values for the shard size will result in more Java heap usage when
searching the Provenance Repository
# but should provide better performance
nifi.provenance.repository.index.shard.size=500 MB
# Indicates the maximum length that a FlowFile attribute can be when
retrieving a Provenance Event from
# the repository. If the length of any attribute exceeds this value, it will
be truncated when the event is retrieved.
nifi.provenance.repository.max.attribute.length=65536
# Volatile Provenance Respository Properties
nifi.provenance.repository.buffer.size=100000
# Component Status Repository
nifi.components.status.repository.implementation=org.apache.nifi.controller.status.history.VolatileComponentStatusRepository
nifi.components.status.repository.buffer.size=1440
nifi.components.status.snapshot.frequency=1 min
# Site to Site properties
nifi.remote.input.host=hostname-1
nifi.remote.input.secure=false
nifi.remote.input.socket.port=9998
nifi.remote.input.http.enabled=true
nifi.remote.input.http.transaction.ttl=30 sec
# web properties #
nifi.web.war.directory=./lib
nifi.web.http.host=hostname-1
nifi.web.http.port=8080
nifi.web.http.network.interface.default=
nifi.web.https.host=
nifi.web.https.port=
nifi.web.https.network.interface.default=
nifi.web.jetty.working.directory=./work/jetty
nifi.web.jetty.threads=200
# security properties #
nifi.sensitive.props.key=
nifi.sensitive.props.key.protected=
nifi.sensitive.props.algorithm=PBEWITHMD5AND256BITAES-CBC-OPENSSL
nifi.sensitive.props.provider=BC
nifi.sensitive.props.additional.keys=
nifi.security.keystore=
nifi.security.keystoreType=
nifi.security.keystorePasswd=
nifi.security.keyPasswd=
nifi.security.truststore=
nifi.security.truststoreType=
nifi.security.truststorePasswd=
nifi.security.needClientAuth=
nifi.security.user.authorizer=file-provider
nifi.security.user.login.identity.provider=
nifi.security.ocsp.responder.url=
nifi.security.ocsp.responder.certificate=
# Identity Mapping Properties #
# These properties allow normalizing user identities such that identities
coming from different identity providers
# (certificates, LDAP, Kerberos) can be treated the same internally in NiFi.
The following example demonstrates normalizing
# DNs from certificates and principals from Kerberos into a common identity
string:
#
# nifi.security.identity.mapping.pattern.dn=^CN=(.*?), OU=(.*?), O=(.*?),
L=(.*?), ST=(.*?), C=(.*?)$
# nifi.security.identity.mapping.value.dn=$1@$2
# nifi.security.identity.mapping.pattern.kerb=^(.*?)/instance@(.*?)$
# nifi.security.identity.mapping.value.kerb=$1@$2
# cluster common properties (all nodes must have same values) #
nifi.cluster.protocol.heartbeat.interval=5 sec
nifi.cluster.protocol.is.secure=false
# cluster node properties (only configure for cluster nodes) #
nifi.cluster.is.node=true
nifi.cluster.node.address=hostname-1
nifi.cluster.node.protocol.port=9999
nifi.cluster.node.protocol.threads=10
nifi.cluster.node.protocol.max.threads=50
nifi.cluster.node.event.history.size=25
nifi.cluster.node.connection.timeout=5 sec
nifi.cluster.node.read.timeout=5 sec
nifi.cluster.firewall.file=
nifi.cluster.flow.election.max.wait.time=5 mins
nifi.cluster.flow.election.max.candidates=
# zookeeper properties, used for cluster management #
nifi.zookeeper.connect.string=hostname-1:2181,hostname-2:2181
nifi.zookeeper.connect.timeout=3 secs
nifi.zookeeper.session.timeout=3 secs
nifi.zookeeper.root.node=/nifi
# kerberos #
nifi.kerberos.krb5.file=
# kerberos service principal #
nifi.kerberos.service.principal=
nifi.kerberos.service.keytab.location=
# kerberos spnego principal #
nifi.kerberos.spnego.principal=
nifi.kerberos.spnego.keytab.location=
nifi.kerberos.spnego.authentication.expiration=12 hours
# external properties files for variable registry
# supports a comma delimited list of file locations
nifi.variable.registry.properties=
zookeeper.properties:-
#
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#
#
#
clientPort=2181
initLimit=10
autopurge.purgeInterval=24
syncLimit=5
tickTime=2000
dataDir=./state/zookeeper
autopurge.snapRetainCount=30
#
# Specifies the servers that are part of this zookeeper ensemble. For
# every NiFi instance running an embedded zookeeper, there needs to be
# a server entry below. For instance:
#
server.1=hostname-1:2888:3888
server.2=hostname-2:2888:3888
# server.2=nifi-node2-hostname:2888:3888
# server.3=nifi-node3-hostname:2888:3888
#
# The index of the server corresponds to the myid file that gets created
# in the dataDir of each node running an embedded zookeeper. See the
# administration guide for more details.
NOTE:-I am yet to secure the cluster which I plan for after this.
Any help is appreciated.
--
View this message in context:
http://apache-nifi-developer-list.39713.n7.nabble.com/Not-able-to-start-nifi-nodes-when-clustered-tp16289.html
Sent from the Apache NiFi Developer List mailing list archive at
Nabble.com<http://Nabble.com>.
