After upgrading my functioning 2.03 environment (1 Graylog server with 2
ElasticSearch nodes all CentOS 7), Graylog won't start up properly. It
loops through startup/shutdown as shown below (full log is attached). It
seems like a problem binding linux ports below 1024, but I could be wrong.
Any thoughts?
2016-09-07T10:47:08.205-04:00 INFO [JerseyService] Started REST API at
<http://10.66.1.23:12900/>
2016-09-07T10:47:10.814-04:00 ERROR [ServiceManager] Service JerseyService
[FAILED] has failed in the STARTING state.
javax.ws.rs.ProcessingException: Failed to start Grizzly HTTP server:
Permission denied
at
org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:299)
~[graylog.jar:?]
at
org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:163)
~[graylog.jar:?]
at
org.graylog2.shared.initializers.JerseyService.setUp(JerseyService.java:337)
~[graylog.jar:?]
at
org.graylog2.shared.initializers.JerseyService.startUpWeb(JerseyService.java:159)
~[graylog.jar:?]
at
org.graylog2.shared.initializers.JerseyService.startUp(JerseyService.java:135)
~[graylog.jar:?]
at
com.google.common.util.concurrent.AbstractIdleService$DelegateService$1.run(AbstractIdleService.java:60)
[graylog.jar:?]
at com.google.common.util.concurrent.Callables$3.run(Callables.java:100)
[graylog.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101]
Caused by: java.net.SocketException: Permission denied
at sun.nio.ch.Net.bind0(Native Method) ~[?:1.8.0_101]
at sun.nio.ch.Net.bind(Net.java:433) ~[?:1.8.0_101]
at sun.nio.ch.Net.bind(Net.java:425) ~[?:1.8.0_101]
at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
~[?:1.8.0_101]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
~[?:1.8.0_101]
at
org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bindToChannelAndAddress(TCPNIOBindingHandler.java:131)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bind(TCPNIOBindingHandler.java:88)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:248)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:228)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:219)
~[graylog.jar:?]
at
org.glassfish.grizzly.http.server.NetworkListener.start(NetworkListener.java:714)
~[graylog.jar:?]
at org.glassfish.grizzly.http.server.HttpServer.start(HttpServer.java:278)
~[graylog.jar:?]
at
org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:296)
~[graylog.jar:?]
... 7 more
--
You received this message because you are subscribed to the Google Groups
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/graylog2/c2cfd04c-a151-4267-92f3-c9142a630c63%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
2016-09-07T10:46:50.417-04:00 INFO [CmdLineTool] Loaded plugin: Elastic Beats
Input 1.1.0 [org.graylog.plugins.beats.BeatsInputPlugin]
2016-09-07T10:46:50.419-04:00 INFO [CmdLineTool] Loaded plugin: Collector
1.1.0 [org.graylog.plugins.collector.CollectorPlugin]
2016-09-07T10:46:50.419-04:00 INFO [CmdLineTool] Loaded plugin: Enterprise
Integration Plugin 1.1.0
[org.graylog.plugins.enterprise_integration.EnterpriseIntegrationPlugin]
2016-09-07T10:46:50.419-04:00 INFO [CmdLineTool] Loaded plugin:
MapWidgetPlugin 1.1.0 [org.graylog.plugins.map.MapWidgetPlugin]
2016-09-07T10:46:50.420-04:00 INFO [CmdLineTool] Loaded plugin: Pipeline
Processor Plugin 1.1.0 [org.graylog.plugins.pipelineprocessor.ProcessorPlugin]
2016-09-07T10:46:50.420-04:00 INFO [CmdLineTool] Loaded plugin: Anonymous
Usage Statistics 2.1.0 [org.graylog.plugins.usagestatistics.UsageStatsPlugin]
2016-09-07T10:46:50.541-04:00 INFO [CmdLineTool] Running with JVM arguments:
-Xms1g -Xmx1g -XX:NewRatio=1 -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC
-XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC
-XX:-OmitStackTraceInFastThrow
-Dlog4j.configurationFile=file:///etc/graylog/server/log4j2.xml
-Djava.library.path=/usr/share/graylog-server/lib/sigar
-Dgraylog2.installation_source=rpm
2016-09-07T10:46:53.227-04:00 INFO [InputBufferImpl] Message journal is
enabled.
2016-09-07T10:46:53.256-04:00 INFO [NodeId] Node ID:
c88199e9-38fd-424d-b4a5-15826d19a1e9
2016-09-07T10:46:53.520-04:00 INFO [LogManager] Loading logs.
2016-09-07T10:46:53.596-04:00 INFO [LogManager] Logs loading complete.
2016-09-07T10:46:53.597-04:00 INFO [KafkaJournal] Initialized Kafka based
journal at /var/lib/graylog-server/journal
2016-09-07T10:46:53.616-04:00 INFO [InputBufferImpl] Initialized
InputBufferImpl with ring size <65536> and wait strategy
<BlockingWaitStrategy>, running 2 parallel message handlers.
2016-09-07T10:46:53.641-04:00 INFO [cluster] Cluster created with settings
{hosts=[localhost:27017], mode=SINGLE, requiredClusterType=UNKNOWN,
serverSelectionTimeout='30000 ms', maxWaitQueueSize=5000}
2016-09-07T10:46:53.696-04:00 INFO [cluster] No server chosen by
ReadPreferenceServerSelector{readPreference=primary} from cluster description
ClusterDescription{type=UNKNOWN, connectionMode=SINGLE,
serverDescriptions=[ServerDescription{address=localhost:27017, type=UNKNOWN,
state=CONNECTING}]}. Waiting for 30000 ms before timing out
2016-09-07T10:46:53.726-04:00 INFO [connection] Opened connection
[connectionId{localValue:1, serverValue:174}] to localhost:27017
2016-09-07T10:46:53.728-04:00 INFO [cluster] Monitor thread successfully
connected to server with description ServerDescription{address=localhost:27017,
type=STANDALONE, state=CONNECTED, ok=true,
version=ServerVersion{versionList=[3, 2, 9]}, minWireVersion=0,
maxWireVersion=4, maxDocumentSize=16777216, roundTripTimeNanos=736921}
2016-09-07T10:46:53.736-04:00 INFO [connection] Opened connection
[connectionId{localValue:2, serverValue:175}] to localhost:27017
2016-09-07T10:46:54.046-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] version[2.3.5], pid[13968],
build[90f439f/2016-07-27T10:36:52Z]
2016-09-07T10:46:54.046-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] initializing ...
2016-09-07T10:46:54.054-04:00 INFO [plugins]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] modules [], plugins
[graylog-monitor], sites []
2016-09-07T10:46:55.868-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] initialized
2016-09-07T10:46:55.987-04:00 INFO [Version] HV000001: Hibernate Validator
5.2.4.Final
2016-09-07T10:46:56.192-04:00 INFO [ProcessBuffer] Initialized ProcessBuffer
with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-09-07T10:46:58.317-04:00 INFO [RulesEngineProvider] No static rules file
loaded.
2016-09-07T10:46:58.671-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-09-07T10:46:58.677-04:00 INFO [OutputBuffer] Initialized OutputBuffer
with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-09-07T10:46:58.770-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-09-07T10:46:58.870-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-09-07T10:46:58.948-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-09-07T10:46:59.014-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-09-07T10:46:59.528-04:00 INFO [ServerBootstrap] Graylog server
2.1.0+62db7e0 starting up
2016-09-07T10:46:59.529-04:00 INFO [ServerBootstrap] JRE: Oracle Corporation
1.8.0_101 on Linux 3.10.0-327.28.3.el7.x86_64
2016-09-07T10:46:59.529-04:00 INFO [ServerBootstrap] Deployment: rpm
2016-09-07T10:46:59.530-04:00 INFO [ServerBootstrap] OS: CentOS Linux 7 (Core)
(centos)
2016-09-07T10:46:59.530-04:00 INFO [ServerBootstrap] Arch: amd64
2016-09-07T10:46:59.534-04:00 WARN [DeadEventLoggingListener] Received
unhandled event of type <org.graylog2.plugin.lifecycles.Lifecycle> from event
bus <AsyncEventBus{graylog-eventbus}>
2016-09-07T10:46:59.563-04:00 INFO [PeriodicalsService] Starting 25
periodicals ...
2016-09-07T10:46:59.564-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ThroughputCalculator] periodical in [0s], polling
every [1s].
2016-09-07T10:46:59.568-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.AlertScannerThread] periodical in [10s], polling every
[60s].
2016-09-07T10:46:59.568-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] periodical in
[0s], polling every [1s].
2016-09-07T10:46:59.569-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] starting ...
2016-09-07T10:46:59.569-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ClusterHealthCheckThread] periodical in [120s],
polling every [20s].
2016-09-07T10:46:59.575-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ContentPackLoaderPeriodical] periodical, running
forever.
2016-09-07T10:46:59.578-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.GarbageCollectionWarningThread] periodical, running
forever.
2016-09-07T10:46:59.579-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexerClusterCheckerThread] periodical in [0s],
polling every [30s].
2016-09-07T10:46:59.579-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRetentionThread] periodical in [0s], polling
every [300s].
2016-09-07T10:46:59.580-04:00 INFO [IndexRetentionThread] Elasticsearch
cluster not available, skipping index retention checks.
2016-09-07T10:46:59.581-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRotationThread] periodical in [0s], polling every
[10s].
2016-09-07T10:46:59.582-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.NodePingThread] periodical in [0s], polling every [1s].
2016-09-07T10:46:59.586-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.VersionCheckThread] periodical in [300s], polling
every [1800s].
2016-09-07T10:46:59.586-04:00 INFO [IndexerClusterCheckerThread] Indexer not
fully initialized yet. Skipping periodic cluster check.
2016-09-07T10:46:59.587-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ThrottleStateUpdaterThread] periodical in [1s],
polling every [1s].
2016-09-07T10:46:59.588-04:00 INFO [Periodicals] Starting
[org.graylog2.events.ClusterEventPeriodical] periodical in [0s], polling every
[1s].
2016-09-07T10:46:59.592-04:00 INFO [Periodicals] Starting
[org.graylog2.events.ClusterEventCleanupPeriodical] periodical in [0s], polling
every [86400s].
2016-09-07T10:46:59.593-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ClusterIdGeneratorPeriodical] periodical, running
forever.
2016-09-07T10:46:59.593-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRangesMigrationPeriodical] periodical, running
forever.
2016-09-07T10:46:59.603-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRangesCleanupPeriodical] periodical in [15s],
polling every [3600s].
2016-09-07T10:46:59.606-04:00 INFO [connection] Opened connection
[connectionId{localValue:3, serverValue:176}] to localhost:27017
2016-09-07T10:46:59.611-04:00 INFO [connection] Opened connection
[connectionId{localValue:6, serverValue:178}] to localhost:27017
2016-09-07T10:46:59.611-04:00 INFO [connection] Opened connection
[connectionId{localValue:7, serverValue:179}] to localhost:27017
2016-09-07T10:46:59.612-04:00 INFO [connection] Opened connection
[connectionId{localValue:5, serverValue:180}] to localhost:27017
2016-09-07T10:46:59.614-04:00 INFO [connection] Opened connection
[connectionId{localValue:4, serverValue:177}] to localhost:27017
2016-09-07T10:46:59.639-04:00 INFO [PeriodicalsService] Not starting
[org.graylog2.periodical.UserPermissionMigrationPeriodical] periodical. Not
configured to run on this node.
2016-09-07T10:46:59.640-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.AlarmCallbacksMigrationPeriodical] periodical, running
forever.
2016-09-07T10:46:59.650-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ConfigurationManagementPeriodical] periodical, running
forever.
2016-09-07T10:46:59.656-04:00 INFO [PeriodicalsService] Not starting
[org.graylog2.periodical.LdapGroupMappingMigration] periodical. Not configured
to run on this node.
2016-09-07T10:46:59.657-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexFailuresPeriodical] periodical, running forever.
2016-09-07T10:46:59.669-04:00 INFO [Periodicals] Starting
[org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] periodical in
[300s], polling every [21600s].
2016-09-07T10:46:59.673-04:00 INFO [Periodicals] Starting
[org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] periodical in
[300s], polling every [21600s].
2016-09-07T10:46:59.679-04:00 INFO [Periodicals] Starting
[org.graylog.plugins.collector.periodical.PurgeExpiredCollectorsThread]
periodical in [0s], polling every [3600s].
2016-09-07T10:46:59.807-04:00 INFO [transport]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] publish_address
{10.66.1.23:9350}, bound_addresses {10.66.1.23:9350}
2016-09-07T10:46:59.816-04:00 INFO [discovery]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9]
graylog2-prod/UBResEn0QPaxQaXEGlNfgQ
2016-09-07T10:47:00.024-04:00 INFO [JerseyService] Enabling CORS for HTTP
endpoint
2016-09-07T10:47:02.820-04:00 WARN [discovery]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] waited for 3s and no initial
state was set by the discovery
2016-09-07T10:47:02.821-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] started
2016-09-07T10:47:02.939-04:00 INFO [service]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] detected_master
{gpesn01}{vLqc4CyMS96VYjMyDF_2lA}{10.6.1.74}{10.6.1.74:9300}, added
{{gpesn01}{vLqc4CyMS96VYjMyDF_2lA}{10.6.1.74}{10.6.1.74:9300},{gpesn02}{MVuRUOkDSyeNiiN1_nEFjQ}{10.6.1.75}{10.6.1.75:9300},},
reason: zen-disco-receive(from master
[{gpesn01}{vLqc4CyMS96VYjMyDF_2lA}{10.6.1.74}{10.6.1.74:9300}])
2016-09-07T10:47:08.202-04:00 INFO [NetworkListener] Started listener bound to
[10.66.1.23:12900]
2016-09-07T10:47:08.204-04:00 INFO [HttpServer] [HttpServer] Started.
2016-09-07T10:47:08.205-04:00 INFO [JerseyService] Started REST API at
<http://10.66.1.23:12900/>
2016-09-07T10:47:10.814-04:00 ERROR [ServiceManager] Service JerseyService
[FAILED] has failed in the STARTING state.
javax.ws.rs.ProcessingException: Failed to start Grizzly HTTP server:
Permission denied
at
org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:299)
~[graylog.jar:?]
at
org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:163)
~[graylog.jar:?]
at
org.graylog2.shared.initializers.JerseyService.setUp(JerseyService.java:337)
~[graylog.jar:?]
at
org.graylog2.shared.initializers.JerseyService.startUpWeb(JerseyService.java:159)
~[graylog.jar:?]
at
org.graylog2.shared.initializers.JerseyService.startUp(JerseyService.java:135)
~[graylog.jar:?]
at
com.google.common.util.concurrent.AbstractIdleService$DelegateService$1.run(AbstractIdleService.java:60)
[graylog.jar:?]
at
com.google.common.util.concurrent.Callables$3.run(Callables.java:100)
[graylog.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101]
Caused by: java.net.SocketException: Permission denied
at sun.nio.ch.Net.bind0(Native Method) ~[?:1.8.0_101]
at sun.nio.ch.Net.bind(Net.java:433) ~[?:1.8.0_101]
at sun.nio.ch.Net.bind(Net.java:425) ~[?:1.8.0_101]
at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
~[?:1.8.0_101]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
~[?:1.8.0_101]
at
org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bindToChannelAndAddress(TCPNIOBindingHandler.java:131)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bind(TCPNIOBindingHandler.java:88)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:248)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:228)
~[graylog.jar:?]
at
org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:219)
~[graylog.jar:?]
at
org.glassfish.grizzly.http.server.NetworkListener.start(NetworkListener.java:714)
~[graylog.jar:?]
at
org.glassfish.grizzly.http.server.HttpServer.start(HttpServer.java:278)
~[graylog.jar:?]
at
org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:296)
~[graylog.jar:?]
... 7 more
2016-09-07T10:47:10.821-04:00 ERROR [InputSetupService] Not starting any inputs
because lifecycle is: Uninitialized [LB:DEAD]
2016-09-07T10:47:10.827-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.AlertScannerThread].
2016-09-07T10:47:10.827-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.AlertScannerThread] complete, took <0ms>.
2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.BatchedElasticSearchOutputFlushThread].
2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] complete, took
<0ms>.
2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.ClusterHealthCheckThread].
2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.ClusterHealthCheckThread] complete, took <0ms>.
2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.IndexerClusterCheckerThread].
2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.IndexerClusterCheckerThread] complete, took <0ms>.
2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.IndexRetentionThread].
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.IndexRetentionThread] complete, took <0ms>.
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.IndexRotationThread].
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.IndexRotationThread] complete, took <0ms>.
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.VersionCheckThread].
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.VersionCheckThread] complete, took <0ms>.
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.ThrottleStateUpdaterThread].
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.ThrottleStateUpdaterThread] complete, took <0ms>.
2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.events.ClusterEventPeriodical].
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.events.ClusterEventPeriodical] complete, took <0ms>.
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.events.ClusterEventCleanupPeriodical].
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.events.ClusterEventCleanupPeriodical] complete, took <0ms>.
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog2.periodical.IndexRangesCleanupPeriodical].
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog2.periodical.IndexRangesCleanupPeriodical] complete, took <0ms>.
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical].
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] complete, took
<0ms>.
2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down
periodical [org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical].
2016-09-07T10:47:10.831-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] complete,
took <0ms>.
2016-09-07T10:47:10.831-04:00 INFO [PeriodicalsService] Shutting down
periodical
[org.graylog.plugins.collector.periodical.PurgeExpiredCollectorsThread].
2016-09-07T10:47:10.831-04:00 INFO [PeriodicalsService] Shutdown of periodical
[org.graylog.plugins.collector.periodical.PurgeExpiredCollectorsThread]
complete, took <0ms>.
2016-09-07T10:47:10.833-04:00 INFO [JournalReader] Stopping.
2016-09-07T10:47:10.833-04:00 INFO [LogManager] Shutting down.
2016-09-07T10:47:10.851-04:00 INFO [Buffers] Waiting until all buffers are
empty.
2016-09-07T10:47:10.853-04:00 INFO [Buffers] All buffers are empty. Continuing.
2016-09-07T10:47:10.859-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] stopping ...
2016-09-07T10:47:10.859-04:00 INFO [OutputSetupService] Stopping output
org.graylog2.outputs.BlockingBatchedESOutput
2016-09-07T10:47:10.876-04:00 INFO [LogManager] Shutdown complete.
2016-09-07T10:47:10.880-04:00 INFO [ServiceManagerListener] Services are now
stopped.
2016-09-07T10:47:10.881-04:00 ERROR [ServerBootstrap] Graylog startup failed.
Exiting. Exception was:
java.lang.IllegalStateException: Expected to be healthy after starting. The
following services are not running: {FAILED=[JerseyService [FAILED]]}
at
com.google.common.util.concurrent.ServiceManager$ServiceManagerState.checkHealthy(ServiceManager.java:713)
~[graylog.jar:?]
at
com.google.common.util.concurrent.ServiceManager$ServiceManagerState.awaitHealthy(ServiceManager.java:542)
~[graylog.jar:?]
at
com.google.common.util.concurrent.ServiceManager.awaitHealthy(ServiceManager.java:299)
~[graylog.jar:?]
at
org.graylog2.bootstrap.ServerBootstrap.startCommand(ServerBootstrap.java:147)
[graylog.jar:?]
at org.graylog2.bootstrap.CmdLineTool.run(CmdLineTool.java:209)
[graylog.jar:?]
at org.graylog2.bootstrap.Main.main(Main.java:44) [graylog.jar:?]
2016-09-07T10:47:10.883-04:00 INFO [Server] SIGNAL received. Shutting down.
2016-09-07T10:47:10.892-04:00 INFO [GracefulShutdown] Graceful shutdown
initiated.
2016-09-07T10:47:10.893-04:00 WARN [DeadEventLoggingListener] Received
unhandled event of type <org.graylog2.plugin.lifecycles.Lifecycle> from event
bus <AsyncEventBus{graylog-eventbus}>
2016-09-07T10:47:10.893-04:00 INFO [GracefulShutdown] Node status: [Halting
[LB:DEAD]]. Waiting <3sec> for possible load balancers to recognize state
change.
2016-09-07T10:47:10.902-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] stopped
2016-09-07T10:47:10.903-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] closing ...
2016-09-07T10:47:10.912-04:00 INFO [node]
[graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] closed
2016-09-07T10:47:14.981-04:00 INFO [GracefulShutdown] Goodbye.