Re: Kafka server.log deletion config

2023-07-23 Thread Gaurav Pande
Hi Guys, Can someone share any kind of example related to defining policy for server.log deletion in log4j for Kafka Regards, GP On Sat, 22 Jul, 2023, 15:16 Gaurav Pande, wrote: > Thanks Sunil, could you guide me through any example config for this in > Kafka , any documentation o

Re: Kafka server.log deletion config

2023-07-22 Thread Gaurav Pande
t; Define housekeeping policy and get rid of too many files. > > > On Sat, 22 Jul 2023 at 10:58 AM, Gaurav Pande > wrote: > > > Hi All, > > > > I am running Apache kafka 2.7.0 and I see that presently there are many > > server.logv files but how is the deletion of these

Kafka server.log deletion config

2023-07-21 Thread Gaurav Pande
Hi All, I am running Apache kafka 2.7.0 and I see that presently there are many server.logv files but how is the deletion of these file governed or can be governed? Instead of manually deleting them. Is there some config that I can set to delete them regularly. Thanks, GP

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
/var/log/mykafka/data/ > > then copy. /data/. to the new path completely and refer it in the > server.properties > > On Tue, 18 Jul 2023 at 1:09 PM, Gaurav Pande wrote: > > > Okay so the data directory has some files like checkpoints, > meta.properties > > in exi

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
ink there > will be loss or corruption > > On Tue, 18 Jul 2023 at 12:20 PM, Gaurav Pande > wrote: > > > Hi Guys, > > > > Any help on this query please. > > > > Regards, > > GP > > > > On Mon, 17 Jul, 2023, 21:00 Gaurav Pande, wrote:

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
Hi Guys, Any help on this query please. Regards, GP On Mon, 17 Jul, 2023, 21:00 Gaurav Pande, wrote: > Hi Guys, > > I have 3 node Kafka cluster running on version 2.7.0 . On one of the > broker out of three iam noticing data directory getting filled and broker > going down

Kafka data directory Move without data loss

2023-07-17 Thread Gaurav Pande
Hi Guys, I have 3 node Kafka cluster running on version 2.7.0 . On one of the broker out of three iam noticing data directory getting filled and broker going down. Presently the data is being written to / mount point(which is wrong) so I want to add a disk on my VM. For this my query is how

Re: Replication factor for a topic Increase

2023-07-13 Thread Gaurav Pande
pic is created, you can only increase the replication factor by: > 1. delete the topic and re-create the same topic (note: data will be lost > after this step) > or > 2. follow the doc to increase the replication factor (data will be kept) > > Thank you. > Luke > > On Thu, Jul 13

Re: How to get Kafka cluster.id priperty

2023-07-13 Thread Gaurav Pande
u don't need to be worried about zookeeper :) > > On Wed, Jul 12, 2023 at 11:18 AM Gaurav Pande > wrote: > > > Thanks on below info is there some set of these xli commands documented > > somewhere? If so could you share the link > > Regards, > > GP > &

Re: Replication factor for a topic Increase

2023-07-13 Thread Gaurav Pande
ease check this doc: > > https://kafka.apache.org/documentation/#basic_ops_increase_replication_factor > > Thanks. > Luke > > On Thu, Jul 13, 2023 at 12:23 PM Gaurav Pande > wrote: > > > Hi all, > > > > I have noticed that when I describe my Kafka topic I s

Replication factor for a topic Increase

2023-07-12 Thread Gaurav Pande
Hi all, I have noticed that when I describe my Kafka topic I see ReplicationFactor:1 but in my server.properties file I already have defined below values i.e a replication factor of 3 : num.partions=3 offsets.topic.replication.factor=3 transaction.state.log.replication.factor=3

Re: How to get Kafka cluster.id priperty

2023-07-11 Thread Gaurav Pande
amples % zookeeper-shell > localhost:2181 > get /cluster/id Connecting to localhost:2181 WATCHER:: WatchedEvent > state:SyncConnected type:None path:null > {"version":"1","id":"_esLic79RVSuuMOrQaxJXA"} > > On Wed, Jul 12, 2023 at 8:47 AM Gaur

Re: How to get Kafka cluster.id priperty

2023-07-11 Thread Gaurav Pande
Hi All, Any help on this query please? Regards GP On Tue, 11 Jul, 2023, 21:01 Gaurav Pande, wrote: > Hi Guys, > > Iam new to Kafka I was researching a bit about finding the cluster.id for > a newly built 3 node zookeeper ensemble so that I can switch my Kafka > brokers to

How to get Kafka cluster.id priperty

2023-07-11 Thread Gaurav Pande
Hi Guys, Iam new to Kafka I was researching a bit about finding the cluster.id for a newly built 3 node zookeeper ensemble so that I can switch my Kafka brokers to these zookeeper Is there a way to pre-find this cluster.id value that is used in meta properties by Kafka as right now it's

Re: Process to Upgrade Zookeeper from 2.7.0 to 3.4.1

2023-06-15 Thread Gaurav Pande
and restart them first or should I restart the standalone existing Zookeeper by adding two new zk nodes entry ? Regards, Gaurav Pande On Wed, 14 Jun, 2023, 22:50 Divij Vaidya, wrote: > Gaurav > > You can find the compatibility matrix for Zk here: > > https://cwiki.apache.org/c

Re: Process to Upgrade Zookeeper from 2.7.0 to 3.4.1

2023-06-14 Thread Gaurav Pande
Thanks. > Luke > > On Wed, Jun 14, 2023 at 12:03 PM Gaurav Pande > wrote: > > > Hi Guys, > > > > Could anyone help on this query? > > > > Regards, > > Gaurav > > > > On Tue, 13 Jun, 2023, 11:40 Gaurav Pande, wrote: > > > &

Re: Process to Upgrade Zookeeper from 2.7.0 to 3.4.1

2023-06-13 Thread Gaurav Pande
Hi Guys, Could anyone help on this query? Regards, Gaurav On Tue, 13 Jun, 2023, 11:40 Gaurav Pande, wrote: > Hello Guys, > > Iam new in this space, I was going through the documentation of Upgrading > Kafka brokers to 3.4 from any previous version with Zookeeper mode , but I >

Process to Upgrade Zookeeper from 2.7.0 to 3.4.1

2023-06-13 Thread Gaurav Pande
Hello Guys, Iam new in this space, I was going through the documentation of Upgrading Kafka brokers to 3.4 from any previous version with Zookeeper mode , but I couldn't find any Upgrade process for Zookeeper. Iam using Zookeeper provided by Kafka binary in this case 2.7.0 and not installed zk