[
https://issues.apache.org/jira/browse/KAFKA-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Emanuele Cesena updated KAFKA-4350:
-----------------------------------
Description:
I'm running 2 clusters: K9 with Kafka 0.9 and K10 with Kafka 0.10.1.
In K10, I've set up mirror maker to clone a topic from K9 to K10.
Mirror maker immediately fails while starting, any suggestion? Following error
message and configs.
Error message:
{code:java}
[2016-10-26 23:54:01,663] FATAL [mirrormaker-thread-0] Mirror maker thread
failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.protocol.types.SchemaException: Error reading field
'cluster_id': Error reading string of length 418, only 43 bytes available
at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
at
org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380)
at
org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:180)
at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:193)
at
org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:248)
at
org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013)
at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979)
at
kafka.tools.MirrorMaker$MirrorMakerNewConsumer.receive(MirrorMaker.scala:582)
at kafka.tools.MirrorMaker$MirrorMakerThread.run(MirrorMaker.scala:431)
[2016-10-26 23:54:01,679] FATAL [mirrormaker-thread-0] Mirror maker thread
exited abnormally, stopping the whole mirror maker.
(kafka.tools.MirrorMaker$MirrorMakerThread)
{code}
Consumer:
{code:}
group.id=mirrormaker001
client.id=mirrormaker001
bootstrap.servers=...K9...
security.protocol=PLAINTEXT
auto.offset.reset=earliest
{code}
(note that I first run without client.id, then tried adding a client.id because
-- same error in both cases)
Producer:
{code:}
bootstrap.servers=...K10...
security.protocol=PLAINTEXT
{code}
was:
I'm running 2 clusters: K9 with Kafka 0.9 and K10 with Kafka 0.10.1.
In K10, I've set up mirror maker to clone a topic from K9 to K10.
Mirror maker immediately fails while starting, any suggestion? Following error
message and configs.
Error message:
{{
[2016-10-26 23:54:01,663] FATAL [mirrormaker-thread-0] Mirror maker thread
failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.protocol.types.SchemaException: Error reading field
'cluster_id': Error reading string of length 418, only 43 bytes available
at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
at
org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380)
at
org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:180)
at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:193)
at
org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:248)
at
org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013)
at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979)
at
kafka.tools.MirrorMaker$MirrorMakerNewConsumer.receive(MirrorMaker.scala:582)
at kafka.tools.MirrorMaker$MirrorMakerThread.run(MirrorMaker.scala:431)
[2016-10-26 23:54:01,679] FATAL [mirrormaker-thread-0] Mirror maker thread
exited abnormally, stopping the whole mirror maker.
(kafka.tools.MirrorMaker$MirrorMakerThread)
}}
Consumer:
{{
group.id=mirrormaker001
client.id=mirrormaker001
bootstrap.servers=...K9...
security.protocol=PLAINTEXT
auto.offset.reset=earliest
}}
(note that I first run without client.id, then tried adding a client.id because
-- same error in both cases)
Producer:
{{
bootstrap.servers=...K10...
security.protocol=PLAINTEXT
}}
> Can't mirror from Kafka 0.9 to Kafka 0.10.1
> -------------------------------------------
>
> Key: KAFKA-4350
> URL: https://issues.apache.org/jira/browse/KAFKA-4350
> Project: Kafka
> Issue Type: Bug
> Reporter: Emanuele Cesena
>
> I'm running 2 clusters: K9 with Kafka 0.9 and K10 with Kafka 0.10.1.
> In K10, I've set up mirror maker to clone a topic from K9 to K10.
> Mirror maker immediately fails while starting, any suggestion? Following
> error message and configs.
> Error message:
> {code:java}
> [2016-10-26 23:54:01,663] FATAL [mirrormaker-thread-0] Mirror maker thread
> failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
> org.apache.kafka.common.protocol.types.SchemaException: Error reading field
> 'cluster_id': Error reading string of length 418, only 43 bytes available
> at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
> at
> org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380)
> at
> org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:180)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:193)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:248)
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013)
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979)
> at
> kafka.tools.MirrorMaker$MirrorMakerNewConsumer.receive(MirrorMaker.scala:582)
> at
> kafka.tools.MirrorMaker$MirrorMakerThread.run(MirrorMaker.scala:431)
> [2016-10-26 23:54:01,679] FATAL [mirrormaker-thread-0] Mirror maker thread
> exited abnormally, stopping the whole mirror maker.
> (kafka.tools.MirrorMaker$MirrorMakerThread)
> {code}
> Consumer:
> {code:}
> group.id=mirrormaker001
> client.id=mirrormaker001
> bootstrap.servers=...K9...
> security.protocol=PLAINTEXT
> auto.offset.reset=earliest
> {code}
> (note that I first run without client.id, then tried adding a client.id
> because -- same error in both cases)
> Producer:
> {code:}
> bootstrap.servers=...K10...
> security.protocol=PLAINTEXT
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
