I did play around with the virtual appliance, and liked it. I'm trying to
get this setup as a production ready system to see about using it to
replace our Splunk install.
I looked at the graylog log file, but all I see is the obvious unable to
connect errors. I can't see anything that's causing it. I've attached the
log file.
Thanks!
Nathan
On Saturday, August 6, 2016 at 4:42:40 AM UTC-4, Jochen Schalanda wrote:
>
> Hi Nathan,
>
> those errors hint to Graylog not being able to connect to the
> Elasticsearch cluster. Check the logs of your Graylog server for more
> details.
>
> Just as a side node, if you simply want to try out Graylog and play around
> with it, you can also use the official virtual machine images and spare
> yourself the setup:
> http://docs.graylog.org/en/2.0/pages/installation/virtual_machine_appliances.html
>
> Cheers,
> Jochen
>
> On Friday, 5 August 2016 17:19:19 UTC+2, Nathan Mace wrote:
>>
>> Changed those two settings and now the web interface is working and I am
>> able to login and configure Inputs. Woot!
>>
>> However none of the data that should be received by the input is being
>> received. If you go to the search screen and wait for a ~30 seconds or so
>> there are two red warnings that pop up on the bottom of the screen and then
>> go away. They are:
>>
>> Could not load sources data
>> Loading of the sources data failed with status: Error cannot GET
>> http://x.x.x.146:12900/sources?range=3600 try reloading the page
>>
>> and
>>
>> Could not load field information
>> loading field information failed with status: cannot GET
>> http://x.x.x.146:12900/system/fields (500)
>>
>> Reloading the browser page doesn't seem to make any difference. Also of
>> note, going to System -> Overview the section for Elasticsearch Cluster
>> just spins with a "Loading" spinner and never shows the status of the ES
>> cluster.
>>
>> Nathan
>>
>> On Thursday, August 4, 2016 at 5:23:00 PM UTC-4, Jochen Schalanda wrote:
>>>
>>> Hi Nathan,
>>>
>>> try removing the elasticsearch_transport_tcp_port setting from your
>>> Graylog configuration and add the port (9300) to the IP address in
>>> elasticsearch_discovery_zen_ping_unicast_hosts (so that it's bein set
>>> to x.x.x.149:9300).
>>>
>>> Additionally, your web_endpoint_uri is wrong and should be removed
>>> completely (or at least point to the public address of the Graylog REST
>>> API).
>>>
>>> Cheers,
>>> Jochen
>>>
>>> On Thursday, 4 August 2016 21:14:37 UTC+2, Nathan Mace wrote:
>>>>
>>>> Per my other thread, I decided to delete the VMs and start over from
>>>> scratch. Instead of running ES on two nodes and Graylog on one of those
>>>> nodes, I've got two VM. Running ES only and the other running Graylog and
>>>> MongoDB only.
>>>>
>>>> ansted -> x.x.x.146 Running Graylog and MongoDB
>>>> ansted-search-01 -> x.x.x.149 Running ElasticSearch
>>>>
>>>> I've attached the two config files (one for Graylog and one for ES). I
>>>> removed all of the commented out lines from the text files. I've also
>>>> attached the log file that Graylog is generating. The repeated error is:
>>>>
>>>> 2016-08-04T14:14:09.089-04:00 WARN [unicast]
>>>> [graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send ping to
>>>> [{#zen_unicast_1#}{x.x.x.149}{x.x.x.149:9200}]
>>>> org.elasticsearch.transport.ReceiveTimeoutTransportException:
>>>> [][x.x.x.149:9200][internal:discovery/zen/unicast] request_id [18] timed
>>>> out after [3750ms]
>>>> at
>>>> org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:679)
>>>>
>>>> [graylog.jar:?]
>>>> at
>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>
>>>> [?:1.8.0_101]
>>>> at
>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>
>>>> [?:1.8.0_101]
>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101]
>>>>
>>>> It is trying to connect to the ES server's IP, but I am out of ideas as
>>>> for what is wrong. I know I have ES set to use port 9300 for transport
>>>> and
>>>> Graylog is (currently) set to port 9200, but changing Graylog's config
>>>> file
>>>> doesn't seem to change the error in the Graylog log file.
>>>>
>>>
--
You received this message because you are subscribed to the Google Groups
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/graylog2/9b15e9f8-fb52-4503-b615-19598fa7bd44%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
2016-08-08T10:31:46.987-04:00 INFO [CmdLineTool] Loaded plugin: Collector
1.0.3 [org.graylog.plugins.collector.CollectorPlugin]
2016-08-08T10:31:46.987-04:00 INFO [CmdLineTool] Loaded plugin: Enterprise
Integration Plugin 1.0.3
[org.graylog.plugins.enterprise_integration.EnterpriseIntegrationPlugin]
2016-08-08T10:31:46.988-04:00 INFO [CmdLineTool] Loaded plugin:
MapWidgetPlugin 1.0.3 [org.graylog.plugins.map.MapWidgetPlugin]
2016-08-08T10:31:46.988-04:00 INFO [CmdLineTool] Loaded plugin: Pipeline
Processor Plugin 1.0.0-beta.5
[org.graylog.plugins.pipelineprocessor.ProcessorPlugin]
2016-08-08T10:31:46.988-04:00 INFO [CmdLineTool] Loaded plugin: Anonymous
Usage Statistics 2.0.3 [org.graylog.plugins.usagestatistics.UsageStatsPlugin]
2016-08-08T10:31:47.063-04:00 INFO [CmdLineTool] Running with JVM arguments:
-Xms1g -Xmx1g -XX:NewRatio=1 -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC
-XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC
-XX:-OmitStackTraceInFastThrow
-Dlog4j.configurationFile=file:///etc/graylog/server/log4j2.xml
-Djava.library.path=/usr/share/graylog-server/lib/sigar
-Dgraylog2.installation_source=rpm
2016-08-08T10:31:49.079-04:00 INFO [InputBufferImpl] Message journal is
enabled.
2016-08-08T10:31:49.250-04:00 INFO [LogManager] Loading logs.
2016-08-08T10:31:49.340-04:00 INFO [LogManager] Logs loading complete.
2016-08-08T10:31:49.340-04:00 INFO [KafkaJournal] Initialized Kafka based
journal at /var/lib/graylog-server/journal
2016-08-08T10:31:49.353-04:00 INFO [InputBufferImpl] Initialized
InputBufferImpl with ring size <65536> and wait strategy
<BlockingWaitStrategy>, running 2 parallel message handlers.
2016-08-08T10:31:49.383-04:00 INFO [cluster] Cluster created with settings
{hosts=[localhost:27017], mode=SINGLE, requiredClusterType=UNKNOWN,
serverSelectionTimeout='30000 ms', maxWaitQueueSize=5000}
2016-08-08T10:31:49.436-04:00 INFO [cluster] No server chosen by
ReadPreferenceServerSelector{readPreference=primary} from cluster description
ClusterDescription{type=UNKNOWN, connectionMode=SINGLE,
all=[ServerDescription{address=localhost:27017, type=UNKNOWN,
state=CONNECTING}]}. Waiting for 30000 ms before timing out
2016-08-08T10:31:49.467-04:00 INFO [connection] Opened connection
[connectionId{localValue:1, serverValue:169}] to localhost:27017
2016-08-08T10:31:49.469-04:00 INFO [cluster] Monitor thread successfully
connected to server with description ServerDescription{address=localhost:27017,
type=STANDALONE, state=CONNECTED, ok=true,
version=ServerVersion{versionList=[3, 2, 8]}, minWireVersion=0,
maxWireVersion=4, maxDocumentSize=16777216, roundTripTimeNanos=1572163}
2016-08-08T10:31:49.479-04:00 INFO [connection] Opened connection
[connectionId{localValue:2, serverValue:170}] to localhost:27017
2016-08-08T10:31:49.677-04:00 INFO [NodeId] Node ID:
f51e5052-55d0-4c4a-92ca-89a28282b3f4
2016-08-08T10:31:49.773-04:00 INFO [node]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] version[2.3.2], pid[30518],
build[b9e4a6a/2016-04-21T16:03:47Z]
2016-08-08T10:31:49.773-04:00 INFO [node]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] initializing ...
2016-08-08T10:31:49.779-04:00 INFO [plugins]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] modules [], plugins
[graylog-monitor], sites []
2016-08-08T10:31:51.269-04:00 INFO [node]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] initialized
2016-08-08T10:31:51.333-04:00 INFO [Version] HV000001: Hibernate Validator
5.2.4.Final
2016-08-08T10:31:51.447-04:00 INFO [ProcessBuffer] Initialized ProcessBuffer
with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-08-08T10:31:53.268-04:00 INFO [RulesEngineProvider] No static rules file
loaded.
2016-08-08T10:31:53.357-04:00 INFO [connection] Opened connection
[connectionId{localValue:3, serverValue:171}] to localhost:27017
2016-08-08T10:31:53.450-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-08-08T10:31:53.458-04:00 INFO [OutputBuffer] Initialized OutputBuffer
with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-08-08T10:31:53.514-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-08-08T10:31:53.562-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-08-08T10:31:53.684-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-08-08T10:31:53.730-04:00 WARN [GeoIpResolverEngine] GeoIP database file
does not exist: /tmp/GeoLite2-City.mmdb
2016-08-08T10:31:54.243-04:00 INFO [ServerBootstrap] Graylog server 2.0.3
(f07c170) starting up
2016-08-08T10:31:54.244-04:00 INFO [ServerBootstrap] JRE: Oracle Corporation
1.8.0_101 on Linux 3.10.0-327.28.2.el7.x86_64
2016-08-08T10:31:54.244-04:00 INFO [ServerBootstrap] Deployment: rpm
2016-08-08T10:31:54.244-04:00 INFO [ServerBootstrap] OS: CentOS Linux 7 (Core)
(centos)
2016-08-08T10:31:54.244-04:00 INFO [ServerBootstrap] Arch: amd64
2016-08-08T10:31:54.252-04:00 WARN [DeadEventLoggingListener] Received
unhandled event of type <org.graylog2.plugin.lifecycles.Lifecycle> from event
bus <AsyncEventBus{graylog-eventbus}>
2016-08-08T10:31:54.276-04:00 INFO [PeriodicalsService] Starting 24
periodicals ...
2016-08-08T10:31:54.277-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ThroughputCalculator] periodical in [0s], polling
every [1s].
2016-08-08T10:31:54.280-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.AlertScannerThread] periodical in [10s], polling every
[60s].
2016-08-08T10:31:54.280-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] periodical in
[0s], polling every [1s].
2016-08-08T10:31:54.281-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ClusterHealthCheckThread] periodical in [0s], polling
every [20s].
2016-08-08T10:31:54.282-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ContentPackLoaderPeriodical] periodical, running
forever.
2016-08-08T10:31:54.283-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.GarbageCollectionWarningThread] periodical, running
forever.
2016-08-08T10:31:54.285-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexerClusterCheckerThread] periodical in [0s],
polling every [30s].
2016-08-08T10:31:54.286-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRetentionThread] periodical in [0s], polling
every [300s].
2016-08-08T10:31:54.296-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRotationThread] periodical in [0s], polling every
[10s].
2016-08-08T10:31:54.296-04:00 INFO [IndexRetentionThread] Elasticsearch
cluster not available, skipping index retention checks.
2016-08-08T10:31:54.299-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.NodePingThread] periodical in [0s], polling every [1s].
2016-08-08T10:31:54.300-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.VersionCheckThread] periodical in [300s], polling
every [1800s].
2016-08-08T10:31:54.301-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ThrottleStateUpdaterThread] periodical in [1s],
polling every [1s].
2016-08-08T10:31:54.302-04:00 INFO [Periodicals] Starting
[org.graylog2.events.ClusterEventPeriodical] periodical in [0s], polling every
[1s].
2016-08-08T10:31:54.303-04:00 INFO [Periodicals] Starting
[org.graylog2.events.ClusterEventCleanupPeriodical] periodical in [0s], polling
every [300s].
2016-08-08T10:31:54.304-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ClusterIdGeneratorPeriodical] periodical, running
forever.
2016-08-08T10:31:54.305-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRangesMigrationPeriodical] periodical, running
forever.
2016-08-08T10:31:54.306-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.IndexRangesCleanupPeriodical] periodical in [15s],
polling every [3600s].
2016-08-08T10:31:54.315-04:00 INFO [connection] Opened connection
[connectionId{localValue:4, serverValue:172}] to localhost:27017
2016-08-08T10:31:54.326-04:00 INFO [IndexerClusterCheckerThread] Indexer not
fully initialized yet. Skipping periodic cluster check.
2016-08-08T10:31:54.344-04:00 INFO [connection] Opened connection
[connectionId{localValue:5, serverValue:173}] to localhost:27017
2016-08-08T10:31:54.345-04:00 INFO [connection] Opened connection
[connectionId{localValue:6, serverValue:174}] to localhost:27017
2016-08-08T10:31:54.355-04:00 INFO [node]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] starting ...
2016-08-08T10:31:54.358-04:00 INFO [connection] Opened connection
[connectionId{localValue:7, serverValue:175}] to localhost:27017
2016-08-08T10:31:54.403-04:00 INFO [PeriodicalsService] Not starting
[org.graylog2.periodical.UserPermissionMigrationPeriodical] periodical. Not
configured to run on this node.
2016-08-08T10:31:54.403-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.AlarmCallbacksMigrationPeriodical] periodical, running
forever.
2016-08-08T10:31:54.405-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.ConfigurationManagementPeriodical] periodical, running
forever.
2016-08-08T10:31:54.408-04:00 INFO [Periodicals] Starting
[org.graylog2.periodical.LdapGroupMappingMigration] periodical, running forever.
2016-08-08T10:31:54.414-04:00 INFO [Periodicals] Starting
[org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] periodical in
[300s], polling every [21600s].
2016-08-08T10:31:54.414-04:00 INFO [Periodicals] Starting
[org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] periodical in
[300s], polling every [21600s].
2016-08-08T10:31:54.414-04:00 INFO [Periodicals] Starting
[org.graylog.plugins.collector.periodical.PurgeExpiredCollectorsThread]
periodical in [0s], polling every [3600s].
2016-08-08T10:31:54.637-04:00 INFO [transport]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] publish_address
{127.0.0.1:9350}, bound_addresses {[::1]:9350}, {127.0.0.1:9350}
2016-08-08T10:31:54.642-04:00 INFO [discovery]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] graylog/E7KzrxsUT2SYKJy8vMSZqw
2016-08-08T10:31:54.799-04:00 INFO [AbstractJerseyService] Enabling CORS for
HTTP endpoint
2016-08-08T10:31:57.420-04:00 INFO [NetworkListener] Started listener bound to
[x.x.x.146:9000]
2016-08-08T10:31:57.422-04:00 INFO [HttpServer] [HttpServer] Started.
2016-08-08T10:31:57.422-04:00 INFO [WebInterfaceService] Started Web Interface
at <http://x.x.x.146:9000/>
2016-08-08T10:31:57.646-04:00 WARN [discovery]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] waited for 3s and no initial
state was set by the discovery
2016-08-08T10:31:57.646-04:00 INFO [node]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] started
2016-08-08T10:31:57.680-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:00.720-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:00.845-04:00 INFO [NetworkListener] Started listener bound to
[x.x.x.146:12900]
2016-08-08T10:32:00.845-04:00 INFO [HttpServer] [HttpServer-1] Started.
2016-08-08T10:32:00.845-04:00 INFO [RestApiService] Started REST API at
<http://x.x.x.146:12900/>
2016-08-08T10:32:02.652-04:00 WARN [IndexerSetupService] Could not connect to
Elasticsearch
2016-08-08T10:32:02.652-04:00 INFO [IndexerSetupService] If you're using
multicast, check that it is working in your network and that Elasticsearch is
accessible. Also check that the cluster name setting is correct.
2016-08-08T10:32:02.653-04:00 INFO [IndexerSetupService] See
http://docs.graylog.org/en/2.0/pages/configuration/elasticsearch.html for
details.
2016-08-08T10:32:02.654-04:00 INFO [ServiceManagerListener] Services are
healthy
2016-08-08T10:32:02.655-04:00 INFO [ServerBootstrap] Services started, startup
times in ms: {InputSetupService [RUNNING]=35, BufferSynchronizerService
[RUNNING]=94, OutputSetupService [RUNNING]=94, MetricsReporterService
[RUNNING]=97, KafkaJournal [RUNNING]=117, JournalReader [RUNNING]=132,
PeriodicalsService [RUNNING]=170, WebInterfaceService [RUNNING]=3130,
RestApiService [RUNNING]=6571, IndexerSetupService [RUNNING]=8346}
2016-08-08T10:32:02.656-04:00 INFO [InputSetupService] Triggering launching
persisted inputs, node transitioned from Uninitialized [LB:DEAD] to Running
[LB:ALIVE]
2016-08-08T10:32:02.659-04:00 INFO [ServerBootstrap] Graylog server up and
running.
2016-08-08T10:32:02.680-04:00 INFO [InputStateListener] Input [GELF
UDP/57a4abd897cd3a6cdeb59501] is now STARTING
2016-08-08T10:32:02.694-04:00 WARN [NettyTransport] receiveBufferSize
(SO_RCVBUF) for input GELFUDPInput{title=Windows Sidecar Input,
type=org.graylog2.inputs.gelf.udp.GELFUDPInput, nodeId=null} should be 1048576
but is 212992.
2016-08-08T10:32:02.696-04:00 INFO [InputStateListener] Input [GELF
UDP/57a4abd897cd3a6cdeb59501] is now RUNNING
2016-08-08T10:32:02.697-04:00 ERROR [KafkaJournal] Read offset 0 before start
of log at 17799, starting to read from the beginning of the journal.
2016-08-08T10:32:03.805-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:06.826-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:09.312-04:00 INFO [IndexRangesCleanupPeriodical] Skipping
index range cleanup because the Elasticsearch cluster is unreachable or
unhealthy
2016-08-08T10:32:09.869-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:12.880-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:15.891-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:18.901-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:21.912-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:24.920-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:27.928-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:30.935-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]
2016-08-08T10:32:33.945-04:00 INFO [zen]
[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4] failed to send join request to
master [{ansted-search-01}{O8fkyxorTzqFqrX1GiVdLA}{x.x.x.149}{x.x.x.149:9300}],
reason
[RemoteTransportException[[ansted-search-01][x.x.x.149:9300][internal:discovery/zen/join]];
nested:
ConnectTransportException[[graylog-f51e5052-55d0-4c4a-92ca-89a28282b3f4][127.0.0.1:9350]
connect_timeout[30s]]; nested:
NotSerializableExceptionWrapper[connect_exception: Connection refused:
/127.0.0.1:9350]; ]