Dear developer:
Hello,get to the point,when I start
kafka-server(kafka_2.13-3.1.0), I have encountered a prolem, I have put the
relational files on attachment position, please help me to check the problems
and give some solutions, I will be very happy for your help. Looking forward
There is typo in your consumer configuration, it should
be auto.offset.reset.
Thanks,
Nitin
On Fri, May 1, 2020 at 12:28 PM vishnu murali
wrote:
> Hey Guys,
>
> I am trying to move data between one cluster to another cluster
>
>
>
> *Source*
>
> *Destination*
>
> *Zookeeper*
>
> 2181
>
> 2182
>
Hey Guys,
I am trying to move data between one cluster to another cluster
*Source*
*Destination*
*Zookeeper*
2181
2182
*Kafka*
9092
9091
*ConsumerProperties:*
bootstrap.servers=localhost:9092
group.id=test-consumer-group
auto.offset.rest=earliest
*Producer Properties:*
bootstrap.s
hat's a failure
> to
> > > resolve the address that's killing it - my personal expectation would
> be
> > > that even though zookeeper-2.zookeeper.etc may be down, its name should
> > > still resolve.
> > >
> > > Regards,
> > >
>
o
> > resolve the address that's killing it - my personal expectation would be
> > that even though zookeeper-2.zookeeper.etc may be down, its name should
> > still resolve.
> >
> > Regards,
> >
> > Liam Clarke
> >
> >
> >
> >
failure to
> resolve the address that's killing it - my personal expectation would be
> that even though zookeeper-2.zookeeper.etc may be down, its name should
> still resolve.
>
> Regards,
>
> Liam Clarke
>
>
>
> On Wed, Sep 26, 2018 at 10:02 PM James Yu
, Sep 26, 2018 at 10:02 PM James Yu wrote:
> Hi,
>
> I fail to start kafka broker when the corresponding zookeeper cluster is in
> working but unhealthy state.
>
> The zookeeper cluster is made of 3 nodes: zookeeper-0, zookeeper-1,
> zookeeper-2.
>
> I put all 3
Hi,
I fail to start kafka broker when the corresponding zookeeper cluster is in
working but unhealthy state.
The zookeeper cluster is made of 3 nodes: zookeeper-0, zookeeper-1,
zookeeper-2.
I put all 3 zookeeper nodes into kafka's server.properties, specifically
for zookeeper.connect attr
Shyla,
Lets break it down into two sequential checks
1)
I didn't see these ZK configs. Please gracefully shutdown everything, and
add these to your zookeeper.properties before restarting ZK and broker:
tickTime=1000
initLimit=3
syncLimit=7
Now run the previously mentioned commands for zookeeper
Hi Mannna. Thanks again. I see the problem, but not sure how to fix..
server.properties -- > listener settings
--
listeners=PLAINTEXT://localhost:9092
advertised.listeners=PLAINTEXT://localhost:9092
$ bin/zookeeper-shell.sh localhost:2181 get /brok
Could you also provide the following outputs (assuming you have only 1
broker and zookeeper):
1) zookeeper-shell.sh localhost:2181
get /brokers/ids/0
from the output, can you see if your broker info is correct
Also, in your server.properties where is advertised.listeners and listeners
properties
Hi Manna , Thanks for the response. All the properties in both the files
are the defaults provided when we download kafka. I have listed them below.
zookeeper.properties
-
dataDir=/tmp/zookeeper
clientPort=2181
maxClientCnxns=0
server.properties
---
Hi,
Could you Post your zookeeper.properties and server.properties file details?
Thanks,
On 9 August 2017 at 07:08, shyla deshpande wrote:
> I have even tried deleting the contents of log.dirs and dataDir before
> starting the zookeeper and kafka server, still no success. I appreciate any
> he
I have even tried deleting the contents of log.dirs and dataDir before
starting the zookeeper and kafka server, still no success. I appreciate any
help.
On Tue, Aug 8, 2017 at 10:43 PM, shyla deshpande
wrote:
> I was successfully using it for many months, and now I am unable to.
> I have used ls
I was successfully using it for many months, and now I am unable to.
I have used lsof -i tcp:9092 to see any process using 9092 port and I don't
see any process using 9092.
On Tue, Aug 8, 2017 at 10:28 PM, shyla deshpande
wrote:
> Hello all,
>
> I am trying to use kafka locally on my Mac. When I
Hello all,
I am trying to use kafka locally on my Mac. When I am trying to start the
kafka server I get the following error. Please help. Thanks.
[2017-08-08 22:16:37,319] FATAL [Kafka Server 0], Fatal error during
KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.common.K
Ok, thanks for the info.
On Fri, Aug 12, 2016 at 8:29 AM Tom Crayford wrote:
> Hey David,
>
> There have been numerous issues with the log cleaner thread.
> https://issues.apache.org/jira/browse/KAFKA-3894 talks about the history
> of
> "log cleaner thread crashing" issues. Some of them are only
Hey David,
There have been numerous issues with the log cleaner thread.
https://issues.apache.org/jira/browse/KAFKA-3894 talks about the history of
"log cleaner thread crashing" issues. Some of them are only fixed in
0.10.0.0 (https://issues.apache.org/jira/browse/KAFKA-3587), and we're
working on
BTW, we are using Kafka 0.9.0.0.
And I found the following thread describing the same issue:
http://grokbase.com/t/kafka/users/159jbe18en/log-cleaner-thread-stops
So is this still an issue in 0.9.0.0?
Thanks,
David
On Thu, Aug 11, 2016 at 9:46 AM David Yu wrote:
> Our Kafka cleaner has stoppe
Our Kafka cleaner has stopped running log compactions. From the log, we
found:
2016-08-03 20:57:19,240 ERROR kafka.log.LogCleaner:
[kafka-log-cleaner-thread-0], Error due to
java.lang.IllegalArgumentException: requirement failed: Last clean offset
is 104326 but segment base offset is 0 for log
se
hi all.
i want to start 3 kafka server node.
i set broker id in config file,set log location and set port of each node.
and start 3 nodes of kafka server in cmd .
i use pykafka(python client of kafka)
so when i create a kafka cluster
connection(localhost:9092,localhost:9093,localhost:9094)
after ex
Thank you so much, Alexis -- good to know that those are not actual
failures.
We were able to get the cluster back up; but with minor data loss. We
picked the server with the most up to date offsets of the bunch (it wasn't
the most up to date on all topics, but most). We then configured all thre
regarding the "Allocation Failure" messages, these are not errors, it's the
standard behavior of a generational GC. I let you google the details, there
are tons of resources.
for ex,
https://plumbr.eu/blog/garbage-collection/understanding-garbage-collection-logs
I believe you should stop the broke
Hello,
Our Kafka cluster (3 servers, each server has Zookeeper and Kafka installed
and running) crashed, and actually out of the 6 processes only one
Zookeeper instance remained alive. The logs do not indicate much, the only
errors shown were:
*2016-02-21T12:21:36.881+: 27445381.013: [GC (Al
That is for a previous version.
This is for the 0.8.2-beta quick start
https://kafka.apache.org/082/documentation.html#quickstart
/***
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingsha
I am a newebee and just downloaded 0.8.2-beta following these instructions:
*> tar xzf kafka-.tgz**> cd kafka-**> ./sbt
update**> ./sbt package*
following this link : http://kafka.apache.org/07/quickstart.html
when I try following :
*> bin/zookeeper-server-start.sh config/zookeeper.properties*
Guozhang,
In this case, it seems like the controller is trying to talk to itself as
the controller establishes a channel with every broker in the cluster.
Thanks,
Neha
On Mon, Oct 28, 2013 at 4:26 PM, Guozhang Wang wrote:
> Hello Nicholas,
>
> The log shows the controller cannot connect with
Hello Nicholas,
The log shows the controller cannot connect with one of the brokers due to
"ava.net.ConnectException: Connection refused". Are all your brokers in the
same cluster?
Guozhang
On Mon, Oct 28, 2013 at 3:37 PM, Nicholas Tietz wrote:
> Hi everyone,
>
> I'm having some problems gett
Hi everyone,
I'm having some problems getting Kafka 0.8 running. (I'm running this on
Mac OS X 10.8 with the latest updates; Java version 1.6.0_51.) I followed
the instructions from the quickstart for 0.8, both from-source and
from-binary (cleaned up all related files each time). However, I am get
OK.
thanks!
Jason
On Mon, Jan 7, 2013 at 3:55 PM, Neha Narkhede wrote:
> Jason,
>
> In 0.8, we changed the zookeeper data structures as well. You might want to
> either use a new zk namespace or delete all of your zk data and restart 0.8.
>
> Thanks,
> Neha
>
>
> On Mon, Jan 7, 2013 at 12:28 PM
Jason,
In 0.8, we changed the zookeeper data structures as well. You might want to
either use a new zk namespace or delete all of your zk data and restart 0.8.
Thanks,
Neha
On Mon, Jan 7, 2013 at 12:28 PM, Jason Huang wrote:
> Never mind - I was able to start the server after removing the
> p
Never mind - I was able to start the server after removing the
previous installed 0.7.2 instance of Kafka.
Jason
On Mon, Jan 7, 2013 at 2:56 PM, Jason Huang wrote:
> Hello,
>
> I am trying out Kafka 0.8 using only one broker and I am unable to
> start the server.
>
> With the instruction from th
Hello,
I am trying out Kafka 0.8 using only one broker and I am unable to
start the server.
With the instruction from this link -
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.8+Quick+Start,
I was able to download and install 0.8. Since I only have one
machine, I did the following co
33 matches
Mail list logo
