Hi,
I'm desperately trying to run Kafka 0.9.0.0 on Solaris 5.10 (Kafka 0.8.2
is working fine). I use 1 Broker with default configuration just as in
the quickstart guide.
The Broker is not working and I see SocketTimeoutExceptions in the
controller.log.
Kafka is running on Java 1.8, Filesystem is ufs
Exception from controller.log:
[2016-02-19 11:59:23,274] WARN [Controller-0-to-broker-0-send-thread],
Controller 0's connection to broker Node(0, srvs010.ac.aixigo.de, 9093)
was unsuccessful (kafka.controller.RequestSendThread)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
at
kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:228)
at
kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:172)
at
kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:171)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
The entire logs are attatched.
Thanks in advance
<https://dict.leo.org/ende/index_en.html#/search=desperately&searchLoc=0&resultOrder=basic&multiwordShowSingle=on>
--
aixigo AG - einfach. besser. beraten
Karl-Friedrich-Straße 68, 52072 Aachen, Germany
fon: +49 (0)241 559709-364, fax: +49 (0)241 559709-99
eMail: lukas.band...@aixigo.de, web: http://www.aixigo.de
Amtsgericht Aachen - HRB 8057
Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
Vors. des Aufsichtsrates: Prof. Dr. Rüdiger von Nitzsch
[2016-02-19 11:58:06,282] DEBUG preRegister called.
Server=com.sun.jmx.mbeanserver.JmxMBeanServer@66d3c617,
name=log4j:logger=kafka.controller (kafka.controller)
[2016-02-19 11:58:52,939] INFO [Controller 0]: Controller starting up
(kafka.controller.KafkaController)
[2016-02-19 11:58:52,988] INFO [Controller 0]: Broker 0 starting become
controller state transition (kafka.controller.KafkaController)
[2016-02-19 11:58:52,995] INFO [Controller 0]: Controller 0 incremented epoch
to 1 (kafka.controller.KafkaController)
[2016-02-19 11:58:52,996] DEBUG [Controller 0]: Registering
IsrChangeNotificationListener (kafka.controller.KafkaController)
[2016-02-19 11:58:53,016] INFO [Controller 0]: Partitions undergoing preferred
replica election: (kafka.controller.KafkaController)
[2016-02-19 11:58:53,017] INFO [Controller 0]: Partitions that completed
preferred replica election: (kafka.controller.KafkaController)
[2016-02-19 11:58:53,017] INFO [Controller 0]: Resuming preferred replica
election for partitions: (kafka.controller.KafkaController)
[2016-02-19 11:58:53,020] INFO [Controller 0]: Partitions being reassigned:
Map() (kafka.controller.KafkaController)
[2016-02-19 11:58:53,021] INFO [Controller 0]: Partitions already reassigned:
List() (kafka.controller.KafkaController)
[2016-02-19 11:58:53,022] INFO [Controller 0]: Resuming reassignment of
partitions: Map() (kafka.controller.KafkaController)
[2016-02-19 11:58:53,026] INFO [Controller 0]: List of topics to be deleted:
(kafka.controller.KafkaController)
[2016-02-19 11:58:53,027] INFO [Controller 0]: List of topics ineligible for
deletion: (kafka.controller.KafkaController)
[2016-02-19 11:58:53,029] INFO [Controller 0]: Currently active brokers in the
cluster: Set() (kafka.controller.KafkaController)
[2016-02-19 11:58:53,030] INFO [Controller 0]: Currently shutting brokers in
the cluster: Set() (kafka.controller.KafkaController)
[2016-02-19 11:58:53,030] INFO [Controller 0]: Current list of topics in the
cluster: Set() (kafka.controller.KafkaController)
[2016-02-19 11:58:53,033] INFO [Replica state machine on controller 0]: Started
replica state machine with initial state -> Map()
(kafka.controller.ReplicaStateMachine)
[2016-02-19 11:58:53,042] INFO [Partition state machine on Controller 0]:
Started partition state machine with initial state -> Map()
(kafka.controller.PartitionStateMachine)
[2016-02-19 11:58:53,043] INFO [Controller 0]: Broker 0 is ready to serve as
the new controller with epoch 1 (kafka.controller.KafkaController)
[2016-02-19 11:58:53,045] INFO [Controller 0]: Starting preferred replica
leader election for partitions (kafka.controller.KafkaController)
[2016-02-19 11:58:53,046] INFO [Partition state machine on Controller 0]:
Invoking state change to OnlinePartition for partitions
(kafka.controller.PartitionStateMachine)
[2016-02-19 11:58:53,053] INFO [Controller 0]: starting the partition rebalance
scheduler (kafka.controller.KafkaController)
[2016-02-19 11:58:53,054] INFO [Controller 0]: Controller startup complete
(kafka.controller.KafkaController)
[2016-02-19 11:58:53,165] INFO [BrokerChangeListener on Controller 0]: Broker
change listener fired for path /brokers/ids with children 0
(kafka.controller.ReplicaStateMachine$BrokerChangeListener)
[2016-02-19 11:58:53,225] INFO [BrokerChangeListener on Controller 0]: Newly
added brokers: 0, deleted brokers: , all live brokers: 0
(kafka.controller.ReplicaStateMachine$BrokerChangeListener)
[2016-02-19 11:58:53,227] DEBUG [Channel manager on controller 0]: Controller 0
trying to connect to broker 0 (kafka.controller.ControllerChannelManager)
[2016-02-19 11:58:53,241] INFO [Controller-0-to-broker-0-send-thread], Starting
(kafka.controller.RequestSendThread)
[2016-02-19 11:58:53,242] INFO [Controller 0]: New broker startup callback for
0 (kafka.controller.KafkaController)
[2016-02-19 11:58:58,055] TRACE [Controller 0]: checking need to trigger
partition rebalance (kafka.controller.KafkaController)
[2016-02-19 11:58:58,058] DEBUG [Controller 0]: preferred replicas by broker
Map() (kafka.controller.KafkaController)
[2016-02-19 11:59:23,274] WARN [Controller-0-to-broker-0-send-thread],
Controller 0's connection to broker Node(0, srvs010.ac.aixigo.de, 9093) was
unsuccessful (kafka.controller.RequestSendThread)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
at
kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:228)
at
kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:172)
at
kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:171)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
[2016-02-19 11:59:53,595] WARN [Controller-0-to-broker-0-send-thread],
Controller 0's connection to broker Node(0, srvs010.ac.aixigo.de, 9093) was
unsuccessful (kafka.controller.RequestSendThread)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
at
kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:228)
at
kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:172)
at
kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:171)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
[2016-02-19 11:58:51,969] INFO KafkaConfig values:
advertised.host.name = null
metric.reporters = []
quota.producer.default = 9223372036854775807
offsets.topic.num.partitions = 50
log.flush.interval.messages = 9223372036854775807
auto.create.topics.enable = true
controller.socket.timeout.ms = 30000
log.flush.interval.ms = null
principal.builder.class = class
org.apache.kafka.common.security.auth.DefaultPrincipalBuilder
replica.socket.receive.buffer.bytes = 65536
min.insync.replicas = 1
replica.fetch.wait.max.ms = 500
num.recovery.threads.per.data.dir = 1
ssl.keystore.type = JKS
default.replication.factor = 1
ssl.truststore.password = null
log.preallocate = false
sasl.kerberos.principal.to.local.rules = [DEFAULT]
fetch.purgatory.purge.interval.requests = 1000
ssl.endpoint.identification.algorithm = null
replica.socket.timeout.ms = 30000
message.max.bytes = 1000012
num.io.threads = 8
offsets.commit.required.acks = -1
log.flush.offset.checkpoint.interval.ms = 60000
delete.topic.enable = false
quota.window.size.seconds = 1
ssl.truststore.type = JKS
offsets.commit.timeout.ms = 5000
quota.window.num = 11
zookeeper.connect = localhost:2182
authorizer.class.name =
num.replica.fetchers = 1
log.retention.ms = null
log.roll.jitter.hours = 0
log.cleaner.enable = false
offsets.load.buffer.size = 5242880
log.cleaner.delete.retention.ms = 86400000
ssl.client.auth = none
controlled.shutdown.max.retries = 3
queued.max.requests = 500
offsets.topic.replication.factor = 3
log.cleaner.threads = 1
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
socket.request.max.bytes = 104857600
ssl.trustmanager.algorithm = PKIX
zookeeper.session.timeout.ms = 6000
log.retention.bytes = -1
sasl.kerberos.min.time.before.relogin = 60000
zookeeper.set.acl = false
connections.max.idle.ms = 600000
offsets.retention.minutes = 1440
replica.fetch.backoff.ms = 1000
inter.broker.protocol.version = 0.9.0.X
log.retention.hours = 168
num.partitions = 1
listeners = PLAINTEXT://:9093
ssl.provider = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
log.roll.ms = null
log.flush.scheduler.interval.ms = 9223372036854775807
ssl.cipher.suites = null
log.index.size.max.bytes = 10485760
ssl.keymanager.algorithm = SunX509
security.inter.broker.protocol = PLAINTEXT
replica.fetch.max.bytes = 1048576
advertised.port = null
log.cleaner.dedupe.buffer.size = 524288000
replica.high.watermark.checkpoint.interval.ms = 5000
log.cleaner.io.buffer.size = 524288
sasl.kerberos.ticket.renew.window.factor = 0.8
zookeeper.connection.timeout.ms = 6000
controlled.shutdown.retry.backoff.ms = 5000
log.roll.hours = 168
log.cleanup.policy = delete
host.name =
log.roll.jitter.ms = null
max.connections.per.ip = 2147483647
offsets.topic.segment.bytes = 104857600
background.threads = 10
quota.consumer.default = 9223372036854775807
request.timeout.ms = 30000
log.index.interval.bytes = 4096
log.dir = /tmp/kafka-logs
log.segment.bytes = 1073741824
log.cleaner.backoff.ms = 15000
offset.metadata.max.bytes = 4096
ssl.truststore.location = null
group.max.session.timeout.ms = 30000
ssl.keystore.password = null
zookeeper.sync.time.ms = 2000
port = 9092
log.retention.minutes = null
log.segment.delete.delay.ms = 60000
log.dirs = /tmp/kafka-logs
controlled.shutdown.enable = true
compression.type = producer
max.connections.per.ip.overrides =
sasl.kerberos.kinit.cmd = /usr/bin/kinit
log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
auto.leader.rebalance.enable = true
leader.imbalance.check.interval.seconds = 300
log.cleaner.min.cleanable.ratio = 0.5
replica.lag.time.max.ms = 10000
num.network.threads = 3
ssl.key.password = null
reserved.broker.max.id = 1000
metrics.num.samples = 2
socket.send.buffer.bytes = 102400
ssl.protocol = TLS
socket.receive.buffer.bytes = 102400
ssl.keystore.location = null
replica.fetch.min.bytes = 1
unclean.leader.election.enable = true
group.min.session.timeout.ms = 6000
log.cleaner.io.buffer.load.factor = 0.9
offsets.retention.check.interval.ms = 600000
producer.purgatory.purge.interval.requests = 1000
metrics.sample.window.ms = 30000
broker.id = 0
offsets.topic.compression.codec = 0
log.retention.check.interval.ms = 300000
advertised.listeners = null
leader.imbalance.per.broker.percentage = 10
(kafka.server.KafkaConfig)
[2016-02-19 11:58:52,121] INFO starting (kafka.server.KafkaServer)
[2016-02-19 11:58:52,130] INFO Connecting to zookeeper on localhost:2182
(kafka.server.KafkaServer)
[2016-02-19 11:58:52,610] INFO Log directory '/tmp/kafka-logs' not found,
creating it. (kafka.log.LogManager)
[2016-02-19 11:58:52,617] INFO Loading logs. (kafka.log.LogManager)
[2016-02-19 11:58:52,625] INFO Logs loading complete. (kafka.log.LogManager)
[2016-02-19 11:58:52,626] INFO Starting log cleanup with a period of 300000 ms.
(kafka.log.LogManager)
[2016-02-19 11:58:52,628] INFO Starting log flusher with a default period of
9223372036854775807 ms. (kafka.log.LogManager)
[2016-02-19 11:58:52,632] WARN No meta.properties file under dir
/tmp/kafka-logs/meta.properties (kafka.server.BrokerMetadataCheckpoint)
[2016-02-19 11:58:52,879] INFO Awaiting socket connections on 0.0.0.0:9093.
(kafka.network.Acceptor)
[2016-02-19 11:58:52,884] INFO [Socket Server on Broker 0], Started 1 acceptor
threads (kafka.network.SocketServer)
[2016-02-19 11:58:52,907] INFO [ExpirationReaper-0], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-02-19 11:58:52,908] INFO [ExpirationReaper-0], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-02-19 11:58:52,978] INFO Creating /controller (is it secure? false)
(kafka.utils.ZKCheckedEphemeral)
[2016-02-19 11:58:52,987] INFO Result of znode creation is: OK
(kafka.utils.ZKCheckedEphemeral)
[2016-02-19 11:58:52,987] INFO 0 successfully elected as leader
(kafka.server.ZookeeperLeaderElector)
[2016-02-19 11:58:53,068] INFO [GroupCoordinator 0]: Starting up.
(kafka.coordinator.GroupCoordinator)
[2016-02-19 11:58:53,071] INFO [ExpirationReaper-0], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-02-19 11:58:53,072] INFO [ExpirationReaper-0], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-02-19 11:58:53,072] INFO [GroupCoordinator 0]: Startup complete.
(kafka.coordinator.GroupCoordinator)
[2016-02-19 11:58:53,080] INFO [Group Metadata Manager on Broker 0]: Removed 0
expired offsets in 12 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2016-02-19 11:58:53,101] INFO [ThrottledRequestReaper-Produce], Starting
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-02-19 11:58:53,102] INFO [ThrottledRequestReaper-Fetch], Starting
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-02-19 11:58:53,109] INFO Will not load MX4J, mx4j-tools.jar is not in the
classpath (kafka.utils.Mx4jLoader$)
[2016-02-19 11:58:53,122] INFO Creating /brokers/ids/0 (is it secure? false)
(kafka.utils.ZKCheckedEphemeral)
[2016-02-19 11:58:53,125] INFO Result of znode creation is: OK
(kafka.utils.ZKCheckedEphemeral)
[2016-02-19 11:58:53,127] INFO Registered broker 0 at path /brokers/ids/0 with
addresses: PLAINTEXT -> EndPoint(srvs010.ac.aixigo.de,9093,PLAINTEXT)
(kafka.utils.ZkUtils)
[2016-02-19 11:58:53,141] INFO [Kafka Server 0], started
(kafka.server.KafkaServer)
[2016-02-19 11:58:53,163] INFO New leader is 0
(kafka.server.ZookeeperLeaderElector$LeaderChangeListener)