I have no more errors now, ES cluster is OK, ZooKeeper is OK, I can consume logs in Kafka.... but graylog2-server still does not consume Kafka...
Do you see something special in this log ? : 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA> 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.2.0-4-amd64 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Client environment:user.name=root 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/root 2014-03-21 15:18:04,198 INFO : org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=10.111.25.11:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@36a58ec3 2014-03-21 15:18:04,211 INFO : org.apache.zookeeper.ClientCnxn - Opening socket connection to server /10.111.25.11:2181 2014-03-21 15:18:04,231 INFO : org.apache.zookeeper.ClientCnxn - Socket connection established to 10.111.25.11/10.111.25.11:2181, initiating session 2014-03-21 15:18:04,352 INFO : org.apache.zookeeper.ClientCnxn - Session establishment complete on server 10.111.25.11/10.111.25.11:2181, sessionid = 0x144e0d310c5004b, negotiated timeout = 6000 2014-03-21 15:18:04,353 INFO : org.I0Itec.zkclient.ZkClient - zookeeper state changed (SyncConnected) 2014-03-21 15:18:04,362 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], starting auto committer every 60000 ms 2014-03-21 15:18:04,392 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], begin registering consumer graylog2_log01-server1-1395411484158-ff052f44 in ZK 2014-03-21 15:18:04,729 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], end registering consumer graylog2_log01-server1-1395411484158-ff052f44 in ZK 2014-03-21 15:18:04,739 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], starting watcher executor thread for consumer graylog2_log01-server1-1395411484158-ff052f44 2014-03-21 15:18:04,758 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], begin rebalancing consumer graylog2_log01-server1-1395411484158-ff052f44 try #0 2014-03-21 15:18:04,914 INFO : kafka.utils.VerifiableProperties - Verifying properties 2014-03-21 15:18:04,914 INFO : kafka.utils.VerifiableProperties - Property metadata.broker.list is overridden to log01-kafka1.priv.coppint.net:9092 2014-03-21 15:18:04,914 INFO : kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000 2014-03-21 15:18:04,914 INFO : kafka.utils.VerifiableProperties - Property client.id is overridden to gl2-f4e6604d-df22-4849-987a-93479a9fc4b4-532c2a24e4b0072f4ebab9a1 2014-03-21 15:18:04,926 INFO : kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:log01-kafka1.priv.coppint.net,port:9092 with correlation id 0 for 1 topic(s) Set(graylog2-radio-messages) 2014-03-21 15:18:04,986 INFO : kafka.producer.SyncProducer - Connected to log01-kafka1.priv.coppint.net:9092 for producing 2014-03-21 15:18:05,015 INFO : kafka.producer.SyncProducer - Disconnecting from log01-kafka1.priv.coppint.net:9092 2014-03-21 15:18:05,024 INFO : kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1395411484358] Stopping leader finder thread 2014-03-21 15:18:05,024 INFO : kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1395411484358] Stopping all fetchers 2014-03-21 15:18:05,025 INFO : kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1395411484358] All connections stopped 2014-03-21 15:18:05,025 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Cleared all relevant queues for this fetcher 2014-03-21 15:18:05,026 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Cleared the data chunks in all the consumer message iterators 2014-03-21 15:18:05,026 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Committing all offsets after clearing the fetcher queues 2014-03-21 15:18:05,027 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Releasing partition ownership 2014-03-21 15:18:05,028 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Consumer graylog2_log01-server1-1395411484158-ff052f44 rebalancing the following partitions: ArrayBuffer(0) for topic graylog2-radio-messages with consumers: List(graylog2_log01-server1-1395342076705-38c278a0-0, graylog2_log01-server1-1395342076705-38c278a0-1, graylog2_log01-server1-1395342076705-38c278a0-2, graylog2_log01-server1-1395342076705-38c278a0-3, graylog2_log01-server1-1395342076705-38c278a0-4, graylog2_log01-server1-1395342076705-38c278a0-5, graylog2_log01-server1-1395342076705-38c278a0-6, graylog2_log01-server1-1395342076705-38c278a0-7, graylog2_log01-server1-1395342076705-38c278a0-8, graylog2_log01-server1-1395342076705-38c278a0-9, graylog2_log01-server1-1395411484158-ff052f44-0, graylog2_log01-server1-1395411484158-ff052f44-1) 2014-03-21 15:18:05,029 WARN : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], No broker partitions consumed by consumer thread graylog2_log01-server1-1395411484158-ff052f44-1 for topic graylog2-radio-messages 2014-03-21 15:18:05,029 WARN : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], No broker partitions consumed by consumer thread graylog2_log01-server1-1395411484158-ff052f44-0 for topic graylog2-radio-messages 2014-03-21 15:18:05,030 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Updating the cache 2014-03-21 15:18:05,031 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Consumer graylog2_log01-server1-1395411484158-ff052f44 selected partitions : 2014-03-21 15:18:05,033 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], end rebalancing consumer graylog2_log01-server1-1395411484158-ff052f44 try #0 2014-03-21 15:18:05,034 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Creating topic event watcher for whitelist ^graylog2-radio-messages$ 2014-03-21 15:18:05,035 INFO : org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=10.111.25.11:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@3249fed9 2014-03-21 15:18:05,040 INFO : org.I0Itec.zkclient.ZkEventThread - Starting ZkClient event thread. 2014-03-21 15:18:05,040 INFO : org.apache.zookeeper.ClientCnxn - Opening socket connection to server /10.111.25.11:2181 2014-03-21 15:18:05,045 INFO : kafka.consumer.ConsumerFetcherManager$LeaderFinderThread - [graylog2_log01-server1-1395411484158-ff052f44-leader-finder-thread], Starting 2014-03-21 15:18:05,064 INFO : org.apache.zookeeper.ClientCnxn - Socket connection established to 10.111.25.11/10.111.25.11:2181, initiating session 2014-03-21 15:18:05,182 INFO : org.apache.zookeeper.ClientCnxn - Session establishment complete on server 10.111.25.11/10.111.25.11:2181, sessionid = 0x144e0d310c5004c, negotiated timeout = 6000 2014-03-21 15:18:05,183 INFO : org.I0Itec.zkclient.ZkClient - zookeeper state changed (SyncConnected) 2014-03-21 15:18:05,187 INFO : kafka.consumer.ZookeeperConsumerConnector - [graylog2_log01-server1-1395411484158-ff052f44], Topics to consume = List(graylog2-radio-messages) 2014-03-21 15:18:05,210 INFO : org.graylog2.inputs.InputRegistry - Completed starting [org.graylog2.inputs.kafka.KafkaInput] input with ID <532c2a24e4b0072f4ebab9a1> 2014-03-21 15:18:05,645 INFO : org.glassfish.jersey.server.ApplicationHandler - Initiating Jersey application, version Jersey: 2.5 2013-12-18 14:27:29... 2014-03-21 15:18:06,821 INFO : org.graylog2.Core - Started REST API at <http://10.111.12.171:12900/> 2014-03-21 15:18:06,822 INFO : org.graylog2.Main - Graylog2 up and running. 2014-03-21 15:18:14,160 INFO : org.apache.shiro.session.mgt.AbstractValidatingSessionManager - Enabling session validation scheduler... -- You received this message because you are subscribed to the Google Groups "graylog2" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
