[
https://issues.apache.org/jira/browse/SAMZA-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008832#comment-15008832
]
Rick Mangi commented on SAMZA-815:
----------------------------------
So I went ahead and deleted all of the samza topics in my kafka cluster and
tried to deploy again. The coordinator topic IS created, but the job still
fails to deploy.
After trying to deploy:
rmangi@devstream01:~$ kafka-topics --zookeeper devzk01:2181/cbdev/kafka/stream
--describe --topic __samza_coordinator_t-key-grouper_42
Topic:__samza_coordinator_t-key-grouper_42 PartitionCount:1
ReplicationFactor:2 Configs:segment.bytes=26214400,cleanup.policy=compact
Topic: __samza_coordinator_t-key-grouper_42 Partition: 0 Leader:
5 Replicas: 5,1 Isr: 5,1
But still JobRunner exits with:
[yarnmaster01] out: 2015-11-17 10:25:00 KafkaSystemAdmin [INFO] Created
coordinator stream __samza_coordinator_t-key-grouper_42.
[yarnmaster01] out: 2015-11-17 10:25:00 JobRunner [INFO] Storing config in
coordinator stream.
[yarnmaster01] out: 2015-11-17 10:25:00 CoordinatorStreamSystemProducer [INFO]
Starting coordinator stream producer.
[yarnmaster01] out: 2015-11-17 10:25:00 KafkaSystemProducer [INFO] Creating a
new producer for system mykafka.
[yarnmaster01] out: 2015-11-17 10:25:00 ProducerConfig [INFO] ProducerConfig
values:
[yarnmaster01] out: value.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer
[yarnmaster01] out: key.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer
[yarnmaster01] out: block.on.buffer.full = true
[yarnmaster01] out: retry.backoff.ms = 100
[yarnmaster01] out: buffer.memory = 33554432
[yarnmaster01] out: batch.size = 16384
[yarnmaster01] out: metrics.sample.window.ms = 30000
[yarnmaster01] out: metadata.max.age.ms = 300000
[yarnmaster01] out: receive.buffer.bytes = 32768
[yarnmaster01] out: timeout.ms = 30000
[yarnmaster01] out: max.in.flight.requests.per.connection = 1
[yarnmaster01] out: bootstrap.servers = [devstream01:9092,
devstream02:9092, devstream03:9092]
[yarnmaster01] out: metric.reporters = []
[yarnmaster01] out: client.id =
samza_producer-t_key_grouper-42-1447773900296-4
[yarnmaster01] out: compression.type = none
[yarnmaster01] out: retries = 2147483647
[yarnmaster01] out: max.request.size = 1048576
[yarnmaster01] out: send.buffer.bytes = 131072
[yarnmaster01] out: acks = 1
[yarnmaster01] out: reconnect.backoff.ms = 10
[yarnmaster01] out: linger.ms = 0
[yarnmaster01] out: metrics.num.samples = 2
[yarnmaster01] out: metadata.fetch.timeout.ms = 60000
[yarnmaster01] out:
[yarnmaster01] out: 2015-11-17 10:25:00 ProducerConfig [WARN] The configuration
batch.num.messages = null was supplied but isn't a known config.
[yarnmaster01] out: 2015-11-17 10:25:00 ProducerConfig [WARN] The configuration
producer.type = null was supplied but isn't a known config.
[yarnmaster01] out: Exception in thread "main" org.apache.samza.SamzaException:
org.apache.kafka.common.errors.TimeoutException: Failed to update metadata
after 60000 ms.
[yarnmaster01] out: at
org.apache.samza.coordinator.stream.CoordinatorStreamSystemProducer.send(CoordinatorStreamSystemProducer.java:115)
[yarnmaster01] out: at
org.apache.samza.coordinator.stream.CoordinatorStreamSystemProducer.writeConfig(CoordinatorStreamSystemProducer.java:132)
[yarnmaster01] out: at
org.apache.samza.job.JobRunner.run(JobRunner.scala:85)
[yarnmaster01] out: at
org.apache.samza.job.JobRunner$.main(JobRunner.scala:43)
[yarnmaster01] out: at org.apache.samza.job.JobRunner.main(JobRunner.scala)
[yarnmaster01] out: Caused by: org.apache.kafka.common.errors.TimeoutException:
Failed to update metadata after 60000 ms.
[yarnmaster01] out:
> CoordinatorStream - Errors in JobRunner
> ---------------------------------------
>
> Key: SAMZA-815
> URL: https://issues.apache.org/jira/browse/SAMZA-815
> Project: Samza
> Issue Type: Bug
> Components: container
> Affects Versions: 0.10.0
> Reporter: Rick Mangi
> Priority: Blocker
> Attachments: joboutput.txt, t_key_grouper.properties
>
>
> When starting a job which I have migrated from 0.9.1 I'm getting an error in
> JobRunner. I will attach full log output and configs.
> [yarnmaster01] out: Exception in thread "main"
> org.apache.samza.SamzaException:
> org.apache.kafka.common.errors.TimeoutException: Failed to update metadata
> after 60000 ms.
> [yarnmaster01] out: at
> org.apache.samza.coordinator.stream.CoordinatorStreamSystemProducer.send(CoordinatorStreamSystemProducer.java:115)
> [yarnmaster01] out: at
> org.apache.samza.coordinator.stream.CoordinatorStreamSystemProducer.writeConfig(CoordinatorStreamSystemProducer.java:132)
> [yarnmaster01] out: at
> org.apache.samza.job.JobRunner.run(JobRunner.scala:85)
> [yarnmaster01] out: at
> org.apache.samza.job.JobRunner$.main(JobRunner.scala:43)
> [yarnmaster01] out: at org.apache.samza.job.JobRunner.main(JobRunner.scala)
> [yarnmaster01] out: Caused by:
> org.apache.kafka.common.errors.TimeoutException: Failed to update metadata
> after 60000 ms.
> [yarnmaster01] out:
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
