After upgrading my functioning 2.03 environment (1 Graylog server with 2 ElasticSearch nodes all CentOS 7), Graylog won't start up properly. It loops through startup/shutdown as shown below (full log is attached). It seems like a problem binding linux ports below 1024, but I could be wrong. Any thoughts?
2016-09-07T10:47:08.205-04:00 INFO [JerseyService] Started REST API at <http://10.66.1.23:12900/> 2016-09-07T10:47:10.814-04:00 ERROR [ServiceManager] Service JerseyService [FAILED] has failed in the STARTING state. javax.ws.rs.ProcessingException: Failed to start Grizzly HTTP server: Permission denied at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:299) ~[graylog.jar:?] at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:163) ~[graylog.jar:?] at org.graylog2.shared.initializers.JerseyService.setUp(JerseyService.java:337) ~[graylog.jar:?] at org.graylog2.shared.initializers.JerseyService.startUpWeb(JerseyService.java:159) ~[graylog.jar:?] at org.graylog2.shared.initializers.JerseyService.startUp(JerseyService.java:135) ~[graylog.jar:?] at com.google.common.util.concurrent.AbstractIdleService$DelegateService$1.run(AbstractIdleService.java:60) [graylog.jar:?] at com.google.common.util.concurrent.Callables$3.run(Callables.java:100) [graylog.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101] Caused by: java.net.SocketException: Permission denied at sun.nio.ch.Net.bind0(Native Method) ~[?:1.8.0_101] at sun.nio.ch.Net.bind(Net.java:433) ~[?:1.8.0_101] at sun.nio.ch.Net.bind(Net.java:425) ~[?:1.8.0_101] at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) ~[?:1.8.0_101] at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[?:1.8.0_101] at org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bindToChannelAndAddress(TCPNIOBindingHandler.java:131) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bind(TCPNIOBindingHandler.java:88) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:248) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:228) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:219) ~[graylog.jar:?] at org.glassfish.grizzly.http.server.NetworkListener.start(NetworkListener.java:714) ~[graylog.jar:?] at org.glassfish.grizzly.http.server.HttpServer.start(HttpServer.java:278) ~[graylog.jar:?] at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:296) ~[graylog.jar:?] ... 7 more -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to graylog2+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/c2cfd04c-a151-4267-92f3-c9142a630c63%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
2016-09-07T10:46:50.417-04:00 INFO [CmdLineTool] Loaded plugin: Elastic Beats Input 1.1.0 [org.graylog.plugins.beats.BeatsInputPlugin] 2016-09-07T10:46:50.419-04:00 INFO [CmdLineTool] Loaded plugin: Collector 1.1.0 [org.graylog.plugins.collector.CollectorPlugin] 2016-09-07T10:46:50.419-04:00 INFO [CmdLineTool] Loaded plugin: Enterprise Integration Plugin 1.1.0 [org.graylog.plugins.enterprise_integration.EnterpriseIntegrationPlugin] 2016-09-07T10:46:50.419-04:00 INFO [CmdLineTool] Loaded plugin: MapWidgetPlugin 1.1.0 [org.graylog.plugins.map.MapWidgetPlugin] 2016-09-07T10:46:50.420-04:00 INFO [CmdLineTool] Loaded plugin: Pipeline Processor Plugin 1.1.0 [org.graylog.plugins.pipelineprocessor.ProcessorPlugin] 2016-09-07T10:46:50.420-04:00 INFO [CmdLineTool] Loaded plugin: Anonymous Usage Statistics 2.1.0 [org.graylog.plugins.usagestatistics.UsageStatsPlugin] 2016-09-07T10:46:50.541-04:00 INFO [CmdLineTool] Running with JVM arguments: -Xms1g -Xmx1g -XX:NewRatio=1 -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC -XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC -XX:-OmitStackTraceInFastThrow -Dlog4j.configurationFile=file:///etc/graylog/server/log4j2.xml -Djava.library.path=/usr/share/graylog-server/lib/sigar -Dgraylog2.installation_source=rpm 2016-09-07T10:46:53.227-04:00 INFO [InputBufferImpl] Message journal is enabled. 2016-09-07T10:46:53.256-04:00 INFO [NodeId] Node ID: c88199e9-38fd-424d-b4a5-15826d19a1e9 2016-09-07T10:46:53.520-04:00 INFO [LogManager] Loading logs. 2016-09-07T10:46:53.596-04:00 INFO [LogManager] Logs loading complete. 2016-09-07T10:46:53.597-04:00 INFO [KafkaJournal] Initialized Kafka based journal at /var/lib/graylog-server/journal 2016-09-07T10:46:53.616-04:00 INFO [InputBufferImpl] Initialized InputBufferImpl with ring size <65536> and wait strategy <BlockingWaitStrategy>, running 2 parallel message handlers. 2016-09-07T10:46:53.641-04:00 INFO [cluster] Cluster created with settings {hosts=[localhost:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=5000} 2016-09-07T10:46:53.696-04:00 INFO [cluster] No server chosen by ReadPreferenceServerSelector{readPreference=primary} from cluster description ClusterDescription{type=UNKNOWN, connectionMode=SINGLE, serverDescriptions=[ServerDescription{address=localhost:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out 2016-09-07T10:46:53.726-04:00 INFO [connection] Opened connection [connectionId{localValue:1, serverValue:174}] to localhost:27017 2016-09-07T10:46:53.728-04:00 INFO [cluster] Monitor thread successfully connected to server with description ServerDescription{address=localhost:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 2, 9]}, minWireVersion=0, maxWireVersion=4, maxDocumentSize=16777216, roundTripTimeNanos=736921} 2016-09-07T10:46:53.736-04:00 INFO [connection] Opened connection [connectionId{localValue:2, serverValue:175}] to localhost:27017 2016-09-07T10:46:54.046-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] version[2.3.5], pid[13968], build[90f439f/2016-07-27T10:36:52Z] 2016-09-07T10:46:54.046-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] initializing ... 2016-09-07T10:46:54.054-04:00 INFO [plugins] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] modules [], plugins [graylog-monitor], sites [] 2016-09-07T10:46:55.868-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] initialized 2016-09-07T10:46:55.987-04:00 INFO [Version] HV000001: Hibernate Validator 5.2.4.Final 2016-09-07T10:46:56.192-04:00 INFO [ProcessBuffer] Initialized ProcessBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>. 2016-09-07T10:46:58.317-04:00 INFO [RulesEngineProvider] No static rules file loaded. 2016-09-07T10:46:58.671-04:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /tmp/GeoLite2-City.mmdb 2016-09-07T10:46:58.677-04:00 INFO [OutputBuffer] Initialized OutputBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>. 2016-09-07T10:46:58.770-04:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /tmp/GeoLite2-City.mmdb 2016-09-07T10:46:58.870-04:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /tmp/GeoLite2-City.mmdb 2016-09-07T10:46:58.948-04:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /tmp/GeoLite2-City.mmdb 2016-09-07T10:46:59.014-04:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /tmp/GeoLite2-City.mmdb 2016-09-07T10:46:59.528-04:00 INFO [ServerBootstrap] Graylog server 2.1.0+62db7e0 starting up 2016-09-07T10:46:59.529-04:00 INFO [ServerBootstrap] JRE: Oracle Corporation 1.8.0_101 on Linux 3.10.0-327.28.3.el7.x86_64 2016-09-07T10:46:59.529-04:00 INFO [ServerBootstrap] Deployment: rpm 2016-09-07T10:46:59.530-04:00 INFO [ServerBootstrap] OS: CentOS Linux 7 (Core) (centos) 2016-09-07T10:46:59.530-04:00 INFO [ServerBootstrap] Arch: amd64 2016-09-07T10:46:59.534-04:00 WARN [DeadEventLoggingListener] Received unhandled event of type <org.graylog2.plugin.lifecycles.Lifecycle> from event bus <AsyncEventBus{graylog-eventbus}> 2016-09-07T10:46:59.563-04:00 INFO [PeriodicalsService] Starting 25 periodicals ... 2016-09-07T10:46:59.564-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.ThroughputCalculator] periodical in [0s], polling every [1s]. 2016-09-07T10:46:59.568-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.AlertScannerThread] periodical in [10s], polling every [60s]. 2016-09-07T10:46:59.568-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] periodical in [0s], polling every [1s]. 2016-09-07T10:46:59.569-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] starting ... 2016-09-07T10:46:59.569-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.ClusterHealthCheckThread] periodical in [120s], polling every [20s]. 2016-09-07T10:46:59.575-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.ContentPackLoaderPeriodical] periodical, running forever. 2016-09-07T10:46:59.578-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.GarbageCollectionWarningThread] periodical, running forever. 2016-09-07T10:46:59.579-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.IndexerClusterCheckerThread] periodical in [0s], polling every [30s]. 2016-09-07T10:46:59.579-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.IndexRetentionThread] periodical in [0s], polling every [300s]. 2016-09-07T10:46:59.580-04:00 INFO [IndexRetentionThread] Elasticsearch cluster not available, skipping index retention checks. 2016-09-07T10:46:59.581-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.IndexRotationThread] periodical in [0s], polling every [10s]. 2016-09-07T10:46:59.582-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.NodePingThread] periodical in [0s], polling every [1s]. 2016-09-07T10:46:59.586-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.VersionCheckThread] periodical in [300s], polling every [1800s]. 2016-09-07T10:46:59.586-04:00 INFO [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check. 2016-09-07T10:46:59.587-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.ThrottleStateUpdaterThread] periodical in [1s], polling every [1s]. 2016-09-07T10:46:59.588-04:00 INFO [Periodicals] Starting [org.graylog2.events.ClusterEventPeriodical] periodical in [0s], polling every [1s]. 2016-09-07T10:46:59.592-04:00 INFO [Periodicals] Starting [org.graylog2.events.ClusterEventCleanupPeriodical] periodical in [0s], polling every [86400s]. 2016-09-07T10:46:59.593-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.ClusterIdGeneratorPeriodical] periodical, running forever. 2016-09-07T10:46:59.593-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.IndexRangesMigrationPeriodical] periodical, running forever. 2016-09-07T10:46:59.603-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.IndexRangesCleanupPeriodical] periodical in [15s], polling every [3600s]. 2016-09-07T10:46:59.606-04:00 INFO [connection] Opened connection [connectionId{localValue:3, serverValue:176}] to localhost:27017 2016-09-07T10:46:59.611-04:00 INFO [connection] Opened connection [connectionId{localValue:6, serverValue:178}] to localhost:27017 2016-09-07T10:46:59.611-04:00 INFO [connection] Opened connection [connectionId{localValue:7, serverValue:179}] to localhost:27017 2016-09-07T10:46:59.612-04:00 INFO [connection] Opened connection [connectionId{localValue:5, serverValue:180}] to localhost:27017 2016-09-07T10:46:59.614-04:00 INFO [connection] Opened connection [connectionId{localValue:4, serverValue:177}] to localhost:27017 2016-09-07T10:46:59.639-04:00 INFO [PeriodicalsService] Not starting [org.graylog2.periodical.UserPermissionMigrationPeriodical] periodical. Not configured to run on this node. 2016-09-07T10:46:59.640-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.AlarmCallbacksMigrationPeriodical] periodical, running forever. 2016-09-07T10:46:59.650-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.ConfigurationManagementPeriodical] periodical, running forever. 2016-09-07T10:46:59.656-04:00 INFO [PeriodicalsService] Not starting [org.graylog2.periodical.LdapGroupMappingMigration] periodical. Not configured to run on this node. 2016-09-07T10:46:59.657-04:00 INFO [Periodicals] Starting [org.graylog2.periodical.IndexFailuresPeriodical] periodical, running forever. 2016-09-07T10:46:59.669-04:00 INFO [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] periodical in [300s], polling every [21600s]. 2016-09-07T10:46:59.673-04:00 INFO [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] periodical in [300s], polling every [21600s]. 2016-09-07T10:46:59.679-04:00 INFO [Periodicals] Starting [org.graylog.plugins.collector.periodical.PurgeExpiredCollectorsThread] periodical in [0s], polling every [3600s]. 2016-09-07T10:46:59.807-04:00 INFO [transport] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] publish_address {10.66.1.23:9350}, bound_addresses {10.66.1.23:9350} 2016-09-07T10:46:59.816-04:00 INFO [discovery] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] graylog2-prod/UBResEn0QPaxQaXEGlNfgQ 2016-09-07T10:47:00.024-04:00 INFO [JerseyService] Enabling CORS for HTTP endpoint 2016-09-07T10:47:02.820-04:00 WARN [discovery] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] waited for 3s and no initial state was set by the discovery 2016-09-07T10:47:02.821-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] started 2016-09-07T10:47:02.939-04:00 INFO [service] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] detected_master {gpesn01}{vLqc4CyMS96VYjMyDF_2lA}{10.6.1.74}{10.6.1.74:9300}, added {{gpesn01}{vLqc4CyMS96VYjMyDF_2lA}{10.6.1.74}{10.6.1.74:9300},{gpesn02}{MVuRUOkDSyeNiiN1_nEFjQ}{10.6.1.75}{10.6.1.75:9300},}, reason: zen-disco-receive(from master [{gpesn01}{vLqc4CyMS96VYjMyDF_2lA}{10.6.1.74}{10.6.1.74:9300}]) 2016-09-07T10:47:08.202-04:00 INFO [NetworkListener] Started listener bound to [10.66.1.23:12900] 2016-09-07T10:47:08.204-04:00 INFO [HttpServer] [HttpServer] Started. 2016-09-07T10:47:08.205-04:00 INFO [JerseyService] Started REST API at <http://10.66.1.23:12900/> 2016-09-07T10:47:10.814-04:00 ERROR [ServiceManager] Service JerseyService [FAILED] has failed in the STARTING state. javax.ws.rs.ProcessingException: Failed to start Grizzly HTTP server: Permission denied at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:299) ~[graylog.jar:?] at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:163) ~[graylog.jar:?] at org.graylog2.shared.initializers.JerseyService.setUp(JerseyService.java:337) ~[graylog.jar:?] at org.graylog2.shared.initializers.JerseyService.startUpWeb(JerseyService.java:159) ~[graylog.jar:?] at org.graylog2.shared.initializers.JerseyService.startUp(JerseyService.java:135) ~[graylog.jar:?] at com.google.common.util.concurrent.AbstractIdleService$DelegateService$1.run(AbstractIdleService.java:60) [graylog.jar:?] at com.google.common.util.concurrent.Callables$3.run(Callables.java:100) [graylog.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101] Caused by: java.net.SocketException: Permission denied at sun.nio.ch.Net.bind0(Native Method) ~[?:1.8.0_101] at sun.nio.ch.Net.bind(Net.java:433) ~[?:1.8.0_101] at sun.nio.ch.Net.bind(Net.java:425) ~[?:1.8.0_101] at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) ~[?:1.8.0_101] at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[?:1.8.0_101] at org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bindToChannelAndAddress(TCPNIOBindingHandler.java:131) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOBindingHandler.bind(TCPNIOBindingHandler.java:88) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:248) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:228) ~[graylog.jar:?] at org.glassfish.grizzly.nio.transport.TCPNIOTransport.bind(TCPNIOTransport.java:219) ~[graylog.jar:?] at org.glassfish.grizzly.http.server.NetworkListener.start(NetworkListener.java:714) ~[graylog.jar:?] at org.glassfish.grizzly.http.server.HttpServer.start(HttpServer.java:278) ~[graylog.jar:?] at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpServerFactory.createHttpServer(GrizzlyHttpServerFactory.java:296) ~[graylog.jar:?] ... 7 more 2016-09-07T10:47:10.821-04:00 ERROR [InputSetupService] Not starting any inputs because lifecycle is: Uninitialized [LB:DEAD] 2016-09-07T10:47:10.827-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.AlertScannerThread]. 2016-09-07T10:47:10.827-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.AlertScannerThread] complete, took <0ms>. 2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.BatchedElasticSearchOutputFlushThread]. 2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] complete, took <0ms>. 2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.ClusterHealthCheckThread]. 2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.ClusterHealthCheckThread] complete, took <0ms>. 2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.IndexerClusterCheckerThread]. 2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.IndexerClusterCheckerThread] complete, took <0ms>. 2016-09-07T10:47:10.828-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.IndexRetentionThread]. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.IndexRetentionThread] complete, took <0ms>. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.IndexRotationThread]. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.IndexRotationThread] complete, took <0ms>. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.VersionCheckThread]. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.VersionCheckThread] complete, took <0ms>. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.ThrottleStateUpdaterThread]. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.ThrottleStateUpdaterThread] complete, took <0ms>. 2016-09-07T10:47:10.829-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.events.ClusterEventPeriodical]. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.events.ClusterEventPeriodical] complete, took <0ms>. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.events.ClusterEventCleanupPeriodical]. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.events.ClusterEventCleanupPeriodical] complete, took <0ms>. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog2.periodical.IndexRangesCleanupPeriodical]. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog2.periodical.IndexRangesCleanupPeriodical] complete, took <0ms>. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical]. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] complete, took <0ms>. 2016-09-07T10:47:10.830-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical]. 2016-09-07T10:47:10.831-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] complete, took <0ms>. 2016-09-07T10:47:10.831-04:00 INFO [PeriodicalsService] Shutting down periodical [org.graylog.plugins.collector.periodical.PurgeExpiredCollectorsThread]. 2016-09-07T10:47:10.831-04:00 INFO [PeriodicalsService] Shutdown of periodical [org.graylog.plugins.collector.periodical.PurgeExpiredCollectorsThread] complete, took <0ms>. 2016-09-07T10:47:10.833-04:00 INFO [JournalReader] Stopping. 2016-09-07T10:47:10.833-04:00 INFO [LogManager] Shutting down. 2016-09-07T10:47:10.851-04:00 INFO [Buffers] Waiting until all buffers are empty. 2016-09-07T10:47:10.853-04:00 INFO [Buffers] All buffers are empty. Continuing. 2016-09-07T10:47:10.859-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] stopping ... 2016-09-07T10:47:10.859-04:00 INFO [OutputSetupService] Stopping output org.graylog2.outputs.BlockingBatchedESOutput 2016-09-07T10:47:10.876-04:00 INFO [LogManager] Shutdown complete. 2016-09-07T10:47:10.880-04:00 INFO [ServiceManagerListener] Services are now stopped. 2016-09-07T10:47:10.881-04:00 ERROR [ServerBootstrap] Graylog startup failed. Exiting. Exception was: java.lang.IllegalStateException: Expected to be healthy after starting. The following services are not running: {FAILED=[JerseyService [FAILED]]} at com.google.common.util.concurrent.ServiceManager$ServiceManagerState.checkHealthy(ServiceManager.java:713) ~[graylog.jar:?] at com.google.common.util.concurrent.ServiceManager$ServiceManagerState.awaitHealthy(ServiceManager.java:542) ~[graylog.jar:?] at com.google.common.util.concurrent.ServiceManager.awaitHealthy(ServiceManager.java:299) ~[graylog.jar:?] at org.graylog2.bootstrap.ServerBootstrap.startCommand(ServerBootstrap.java:147) [graylog.jar:?] at org.graylog2.bootstrap.CmdLineTool.run(CmdLineTool.java:209) [graylog.jar:?] at org.graylog2.bootstrap.Main.main(Main.java:44) [graylog.jar:?] 2016-09-07T10:47:10.883-04:00 INFO [Server] SIGNAL received. Shutting down. 2016-09-07T10:47:10.892-04:00 INFO [GracefulShutdown] Graceful shutdown initiated. 2016-09-07T10:47:10.893-04:00 WARN [DeadEventLoggingListener] Received unhandled event of type <org.graylog2.plugin.lifecycles.Lifecycle> from event bus <AsyncEventBus{graylog-eventbus}> 2016-09-07T10:47:10.893-04:00 INFO [GracefulShutdown] Node status: [Halting [LB:DEAD]]. Waiting <3sec> for possible load balancers to recognize state change. 2016-09-07T10:47:10.902-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] stopped 2016-09-07T10:47:10.903-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] closing ... 2016-09-07T10:47:10.912-04:00 INFO [node] [graylog-c88199e9-38fd-424d-b4a5-15826d19a1e9] closed 2016-09-07T10:47:14.981-04:00 INFO [GracefulShutdown] Goodbye.