Hi Christian, Here are some problems I saw:
- You are using Elasticsearch 1.3.1, but we only support 0.90.10 at the moment. - Please ensure you are setting the same cluster name on both Elasticsearch and Graylog2, at least I couldn't find that in the configuration files you attached. - If you disable multicast on the Graylog2 configuration, you need to set the unicast host you want to use. You may also find some useful information regarding the Elasticsearch configuration for Graylog2 here: http://support.torch.sh/help/kb/graylog2-server/configuring-and-tuning-elasticsearch-for-graylog2-v0200 I hope that helps! Regards, Edmundo Alvarez Developer Tel.: +49 (0)40 609 452 077 Fax.: +49 (0)40 609 452 078 TORCH GmbH Steckelhörn 11 20457 Hamburg Germany https://www.torch.sh/ Commercial Reg. (Registergericht): Amtsgericht Hamburg, HRB 125175 Geschäftsführer: Lennart Koopmann (CEO) On 06 Aug 2014, at 12:09, Christian Reiss <em...@christian-reiss.de> wrote: > Hey folks! o/ > > I am trying to get GL2 to talk to EL both residing in one vm (small setup). I > can't make them find each other. > > elasticsearch.yaml > ============ 8< ============== =========== 8< ============== =========== > 8< ============== =========== 8< ============= > ############################## Network And HTTP > ############################### > > # Elasticsearch, by default, binds itself to the 0.0.0.0 address, and listens > # on port [9200-9300] for HTTP traffic and on port [9300-9400] for > node-to-node > # communication. (the range means that if the port is busy, it will > automatically > # try the next port). > > # Set the bind address specifically (IPv4 or IPv6): > # > network.bind_host: 127.0.0.1 > > # Set the address other nodes will use to communicate with this node. If not > # set, it is automatically derived. It must point to an actual IP address. > # > network.publish_host: 127.0.0.1 > > # Set both 'bind_host' and 'publish_host': > # > network.host: 127.0.0.1 > ============ 8< ============== =========== 8< ============== =========== > 8< ============== =========== 8< ============= > > > netstat -tulpen | grep java > ============ 8< ============== =========== 8< ============== =========== > 8< ============== =========== 8< ============= > tcp6 0 0 127.0.0.1:9200 :::* LISTEN > 110 48135 16809/java > tcp6 0 0 127.0.0.1:9300 :::* LISTEN > 110 27616 16809/java > ============ 8< ============== =========== 8< ============== =========== > 8< ============== =========== 8< ============= > > > graylog2.conf > ============ 8< ============== =========== 8< ============== =========== > 8< ============== =========== 8< ============= > elasticsearch_discovery_zen_ping_multicast_enabled = false > #elasticsearch_discovery_zen_ping_unicast_hosts = 127.0.0.1:9300 > > # the following settings allow to change the bind addresses for the > elasticsearch client in graylog2 > # these settings are empty by default, letting elasticsearch choose > automatically, > # override them here or in the 'elasticsearch_config_file' if you need to > bind to a special address > # refer to > http://www.elasticsearch.org/guide/en/elasticsearch/reference/0.90/modules-network.html > for special values here > elasticsearch_network_host = 127.0.0.1 > elasticsearch_network_bind_host = 127.0.0.1 > elasticsearch_network_publish_host = 127.0.0.1 > ============ 8< ============== =========== 8< ============== =========== > 8< ============== =========== 8< ============= > > > dpkg -l | egrep -i '(elastic|jre|mongo)' > ============ 8< ============== =========== 8< ============== > =========== 8< ============== =========== 8< ============= > ii elasticsearch 1.3.1 > all Open Source, Distributed, RESTful Search Engine > ii icedtea-7-jre-jamvm:amd64 7u65-2.5.1-2~deb7u1 > amd64 Alternative JVM for OpenJDK, using JamVM > ii mongodb-org 2.6.3 > amd64 MongoDB open source document-oriented database system > (metapackage) > ii mongodb-org-mongos 2.6.3 > amd64 MongoDB sharded cluster query router > ii mongodb-org-server 2.6.3 > amd64 MongoDB database server > ii mongodb-org-shell 2.6.3 > amd64 MongoDB shell client > ii mongodb-org-tools 2.6.3 > amd64 MongoDB tools > ii openjdk-7-jre-headless:amd64 7u65-2.5.1-2~deb7u1 > amd64 OpenJDK Java runtime, using Hotspot JIT (headless) > ============ 8< ============== =========== 8< ============== > =========== 8< ============== =========== 8< ============= > > > > > > Error on Start: > > java -jar graylog2-server.jar --debug > > 2014-08-06 11:53:51,426 INFO : org.graylog2.Main - Graylog2 0.20.6 starting > up. (JRE: Oracle Corporation 1.7.0_65 on Linux 3.2.0-4-amd64) > 2014-08-06 11:53:51,507 INFO : org.graylog2.plugin.system.NodeId - Node ID: > 9b8327ad-6a63-4272-92d5-84b377ac0fa5 > 2014-08-06 11:53:51,508 INFO : org.graylog2.Core - No rest_transport_uri set. > Falling back to [http://127.0.0.1:12900/]. > 2014-08-06 11:53:51,717 INFO : org.graylog2.buffers.ProcessBuffer - > Initialized ProcessBuffer with ring size <1024> and wait strategy > <BlockingWaitStrategy>. > 2014-08-06 11:53:51,737 INFO : org.graylog2.buffers.OutputBuffer - > Initialized OutputBuffer with ring size <1024> and wait strategy > <BlockingWaitStrategy>. > 2014-08-06 11:53:52,032 DEBUG: > com.ning.http.client.providers.netty.NettyAsyncHttpProvider - Number of > application's worker threads is 32 > 2014-08-06 11:53:52,331 INFO : org.elasticsearch.node - [graylog2-server] > version[0.90.10], pid[3873], build[0a5781f/2014-01-10T10:18:37Z] > 2014-08-06 11:53:52,332 INFO : org.elasticsearch.node - [graylog2-server] > initializing ... > 2014-08-06 11:53:52,332 DEBUG: org.elasticsearch.node - [graylog2-server] > using home [/usr/local/graylog2-server-0.20.6], config > [/usr/local/graylog2-server-0.20.6/config], data > [[/usr/local/graylog2-server-0.20.6/data]], logs > [/usr/local/graylog2-server-0.20.6/logs], work > [/usr/local/graylog2-server-0.20.6/work], plugins > [/usr/local/graylog2-server-0.20.6/plugins] > 2014-08-06 11:53:52,339 INFO : org.elasticsearch.plugins - [graylog2-server] > loaded [], sites [] > 2014-08-06 11:53:52,369 DEBUG: org.elasticsearch.common.compress.lzf - using > [UnsafeChunkDecoder] decoder > 2014-08-06 11:53:53,813 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [generic], type [cached], keep_alive > [30s] > 2014-08-06 11:53:53,822 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [index], type [fixed], size [16], > queue_size [200] > 2014-08-06 11:53:53,827 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [bulk], type [fixed], size [16], > queue_size [50] > 2014-08-06 11:53:53,828 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [get], type [fixed], size [16], > queue_size [1k] > 2014-08-06 11:53:53,828 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [search], type [fixed], size [48], > queue_size [1k] > 2014-08-06 11:53:53,828 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [suggest], type [fixed], size [16], > queue_size [1k] > 2014-08-06 11:53:53,829 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [percolate], type [fixed], size [16], > queue_size [1k] > 2014-08-06 11:53:53,829 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [management], type [scaling], min [1], > size [5], keep_alive [5m] > 2014-08-06 11:53:53,830 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [flush], type [scaling], min [1], size > [5], keep_alive [5m] > 2014-08-06 11:53:53,831 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [merge], type [scaling], min [1], size > [5], keep_alive [5m] > 2014-08-06 11:53:53,831 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [refresh], type [scaling], min [1], > size [8], keep_alive [5m] > 2014-08-06 11:53:53,831 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [warmer], type [scaling], min [1], > size [5], keep_alive [5m] > 2014-08-06 11:53:53,832 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [snapshot], type [scaling], min [1], > size [5], keep_alive [5m] > 2014-08-06 11:53:53,832 DEBUG: org.elasticsearch.threadpool - > [graylog2-server] creating thread_pool [optimize], type [fixed], size [1], > queue_size [null] > 2014-08-06 11:53:53,853 DEBUG: org.elasticsearch.transport.netty - > [graylog2-server] using worker_count[32], port[9350], bind_host[null], > publish_host[null], compress[false], connect_timeout[30s], > connections_per_node[2/3/6/1/1], receive_predictor[512kb->512kb] > 2014-08-06 11:53:53,867 DEBUG: org.elasticsearch.discovery.zen.ping.unicast - > [graylog2-server] using initial hosts [], with concurrent_connects [10] > 2014-08-06 11:53:53,869 DEBUG: org.elasticsearch.discovery.zen - > [graylog2-server] using ping.timeout [3s], master_election.filter_client > [true], master_election.filter_data [false] > 2014-08-06 11:53:53,870 DEBUG: org.elasticsearch.discovery.zen.elect - > [graylog2-server] using minimum_master_nodes [-1] > 2014-08-06 11:53:53,871 DEBUG: org.elasticsearch.discovery.zen.fd - > [graylog2-server] [master] uses ping_interval [1s], ping_timeout [30s], > ping_retries [3] > 2014-08-06 11:53:53,886 DEBUG: org.elasticsearch.discovery.zen.fd - > [graylog2-server] [node ] uses ping_interval [1s], ping_timeout [30s], > ping_retries [3] > 2014-08-06 11:53:53,924 DEBUG: org.elasticsearch.monitor.jvm - > [graylog2-server] enabled [true], last_gc_enabled [false], interval [1s], > gc_threshold [{old=GcThreshold{name='old', warnThreshold=10000, > infoThreshold=5000, debugThreshold=2000}, default=GcThreshold{name='default', > warnThreshold=10000, infoThreshold=5000, debugThreshold=2000}, > young=GcThreshold{name='young', warnThreshold=1000, infoThreshold=700, > debugThreshold=400}}] > 2014-08-06 11:53:53,926 DEBUG: org.elasticsearch.monitor.os - > [graylog2-server] Using probe > [org.elasticsearch.monitor.os.JmxOsProbe@4255f6fc] with refresh_interval [1s] > 2014-08-06 11:53:53,928 DEBUG: org.elasticsearch.monitor.process - > [graylog2-server] Using probe > [org.elasticsearch.monitor.process.JmxProcessProbe@68f2c791] with > refresh_interval [1s] > 2014-08-06 11:53:53,933 DEBUG: org.elasticsearch.monitor.jvm - > [graylog2-server] Using refresh_interval [1s] > 2014-08-06 11:53:53,934 DEBUG: org.elasticsearch.monitor.network - > [graylog2-server] Using probe > [org.elasticsearch.monitor.network.JmxNetworkProbe@606141c1] with > refresh_interval [5s] > 2014-08-06 11:53:53,936 DEBUG: org.elasticsearch.monitor.network - > [graylog2-server] net_info > host [wife] > eth1 display_name [eth1] > address [/fe80:0:0:0:dc72:4aff:fe91:4092%3] [/10.1.0.6] > mtu [1500] multicast [true] ptp [false] loopback [false] up > [true] virtual [false] > eth0 display_name [eth0] > address [/fe80:0:0:0:d45f:ffff:fe58:7aa8%2] [/46.229.47.140] > mtu [1500] multicast [true] ptp [false] loopback [false] up > [true] virtual [false] > lo display_name [lo] > address [/0:0:0:0:0:0:0:1%1] [/127.0.0.1] > mtu [16436] multicast [false] ptp [false] loopback [true] up > [true] virtual [false] > > 2014-08-06 11:53:53,938 DEBUG: org.elasticsearch.monitor.fs - > [graylog2-server] Using probe > [org.elasticsearch.monitor.fs.JmxFsProbe@676ef6f3] with refresh_interval [1s] > 2014-08-06 11:53:54,322 DEBUG: org.elasticsearch.indices.store - > [graylog2-server] using indices.store.throttle.type [MERGE], with > index.store.throttle.max_bytes_per_sec [20mb] > 2014-08-06 11:53:54,330 DEBUG: org.elasticsearch.cache.memory - > [graylog2-server] using bytebuffer cache with small_buffer_size [1kb], > large_buffer_size [1mb], small_cache_size [10mb], large_cache_size [500mb], > direct [true] > 2014-08-06 11:53:54,339 DEBUG: org.elasticsearch.script - [graylog2-server] > using script cache with max_size [500], expire [null] > 2014-08-06 11:53:54,345 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using node_concurrent_recoveries [2], node_initial_primaries_recoveries [4] > 2014-08-06 11:53:54,346 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using [cluster.routing.allocation.allow_rebalance] with [indices_all_active] > 2014-08-06 11:53:54,346 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using [cluster_concurrent_rebalance] with [2] > 2014-08-06 11:53:54,351 DEBUG: org.elasticsearch.gateway.local - > [graylog2-server] using initial_shards [quorum], list_timeout [30s] > 2014-08-06 11:53:54,475 DEBUG: org.elasticsearch.indices.recovery - > [graylog2-server] using max_bytes_per_sec[20mb], concurrent_streams [3], > file_chunk_size [512kb], translog_size [512kb], translog_ops [1000], and > compress [true] > 2014-08-06 11:53:54,534 DEBUG: org.elasticsearch.indices.memory - > [graylog2-server] using index_buffer_size [356mb], with > min_shard_index_buffer_size [4mb], max_shard_index_buffer_size [512mb], > shard_inactive_time [30m] > 2014-08-06 11:53:54,535 DEBUG: org.elasticsearch.indices.cache.filter - > [graylog2-server] using [node] weighted filter cache with size [20%], > actual_size [712.1mb], expire [null], clean_interval [1m] > 2014-08-06 11:53:54,537 DEBUG: org.elasticsearch.indices.fielddata.cache - > [graylog2-server] using size [-1] [-1b], expire [null] > 2014-08-06 11:53:54,556 DEBUG: org.elasticsearch.gateway.local.state.meta - > [graylog2-server] using gateway.local.auto_import_dangled [YES], with > gateway.local.dangling_timeout [2h] > 2014-08-06 11:53:54,560 DEBUG: org.elasticsearch.bulk.udp - [graylog2-server] > using enabled [false], host [null], port [9700-9800], bulk_actions [1000], > bulk_size [5mb], flush_interval [5s], concurrent_requests [4] > 2014-08-06 11:53:54,563 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using node_concurrent_recoveries [2], node_initial_primaries_recoveries [4] > 2014-08-06 11:53:54,564 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using [cluster.routing.allocation.allow_rebalance] with [indices_all_active] > 2014-08-06 11:53:54,564 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using [cluster_concurrent_rebalance] with [2] > 2014-08-06 11:53:54,565 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using node_concurrent_recoveries [2], node_initial_primaries_recoveries [4] > 2014-08-06 11:53:54,565 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using [cluster.routing.allocation.allow_rebalance] with [indices_all_active] > 2014-08-06 11:53:54,565 DEBUG: > org.elasticsearch.cluster.routing.allocation.decider - [graylog2-server] > using [cluster_concurrent_rebalance] with [2] > 2014-08-06 11:53:54,578 INFO : org.elasticsearch.node - [graylog2-server] > initialized > 2014-08-06 11:53:54,578 INFO : org.elasticsearch.node - [graylog2-server] > starting ... > 2014-08-06 11:53:54,598 DEBUG: > org.elasticsearch.netty.channel.socket.nio.SelectorUtil - Using select > timeout of 500 > 2014-08-06 11:53:54,598 DEBUG: > org.elasticsearch.netty.channel.socket.nio.SelectorUtil - Epoll-bug > workaround enabled = false > 2014-08-06 11:53:54,695 DEBUG: org.elasticsearch.transport.netty - > [graylog2-server] Bound to address [/127.0.0.1:9350] > 2014-08-06 11:53:54,695 INFO : org.elasticsearch.transport - > [graylog2-server] bound_address {inet[/127.0.0.1:9350]}, publish_address > {inet[/127.0.0.1:9350]} > 2014-08-06 11:53:57,703 WARN : org.elasticsearch.discovery - > [graylog2-server] waited for 3s and no initial state was set by the discovery > 2014-08-06 11:53:57,703 INFO : org.elasticsearch.discovery - > [graylog2-server] graylog2/7C6579VnTeqpjYDaSCkgJA > 2014-08-06 11:53:57,703 DEBUG: org.elasticsearch.gateway - [graylog2-server] > can't wait on start for (possibly) reading state from gateway, will do it > asynchronously > 2014-08-06 11:53:57,704 INFO : org.elasticsearch.node - [graylog2-server] > started > 2014-08-06 11:53:57,708 DEBUG: org.elasticsearch.discovery.zen - > [graylog2-server] filtered ping responses: (filter_client[true], > filter_data[false]) {none} > 2014-08-06 11:54:00,710 DEBUG: org.elasticsearch.discovery.zen - > [graylog2-server] filtered ping responses: (filter_client[true], > filter_data[false]) {none} > 2014-08-06 11:54:02,712 ERROR: org.graylog2.Main - > > ################################################################################ > > ERROR: Could not successfully connect to ElasticSearch. Check that your > cluster state is not RED and that ElasticSearch is running properly. > > Need help? > > * Official documentation: http://support.torch.sh/help/kb > * Mailing list: http://support.torch.sh/help/kb/general/forums-mailing-list > * Issue tracker: http://support.torch.sh/help/kb/general/issue-trackers > * Commercial support: http://www.torch.sh/ > > But we also got some specific help pages that might help you in this case: > > * > http://support.torch.sh/help/kb/graylog2-server/configuring-and-tuning-elasticsearch-for-graylog2-v0200 > > Terminating. :( > > ################################################################################ > > > Thanks for any pointers! > -Christian. > > -- > You received this message because you are subscribed to the Google Groups > "graylog2" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to graylog2+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "graylog2" group. To unsubscribe from this group and stop receiving emails from it, send an email to graylog2+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
