Re: Deleting topics in windows - fix estimate or workaround

2019-12-01 Thread Sachin Mittal
Hi Edward, I hear you. So basically we are saying that unless major sponsors of Kafka project get actual requirement for support on windows this issue will linger on. Anyway my couple of takes from this issue is: 1. One should not overlook the potential opportunity for windows based systems. Ther

Re: Deleting topics in windows - fix estimate or workaround

2019-12-01 Thread Edward Capriolo
My development environment is windows. I am actually able to run integration tests launching Kafka and Zookeeper. However I have noticed that the test warn likely about deleting a file that is locked and I tried deleting a topic at one point and saw some of the issues you mentioned. I personally t

Re: Deleting topics in windows - fix estimate or workaround

2019-12-01 Thread Sachin Mittal
Hi, Firstly development environment is windows and I have been able to run almost any big data framework on windows (or cygwin) be it HBase, Cassandra or anything else. Now just for running Kafka switching to linux is bit difficult. Further Kafka site does mention that windows is supported and I f

Re: Deleting topics in windows - fix estimate or workaround

2019-12-01 Thread M. Manna
Hi both, It’s been going around for a long time, but Kafka is officially not fully tested and verified for Windows. The disclaimer is on the official site. Windows servers are easy choice because a lot of infrastructures are on Windows and a lot of businesses are dependent on those infrastructure.

Re: Deleting topics in windows - fix estimate or workaround

2019-12-01 Thread Israel Ekpo
Sachin Are you running production Kafka on Windows? Is it possible to migrate to an alternate UNIX based environment? It would be great to learn why you chose to run it on Windows On Sun, Dec 1, 2019 at 2:22 AM Sachin Mittal wrote: > Hi All, > I hope we are well aware of the critical bug in

Deleting topics in windows - fix estimate or workaround

2019-11-30 Thread Sachin Mittal
Hi All, I hope we are well aware of the critical bug in windows where kafka crashes when we delete a topic. This affects other areas too like in stream processing when trying to reset a stream using StreamsResetter. Right now only workaround I have found is to stop zookeeper and kafka server and m

Re: Kafka topic data automatically restore after deleting topics

2019-02-12 Thread kiran kumar
if you want to delete the messages from topic you can use kafka-delete-records.sh. I guess thats whay you are looking for. Thanks, Kiran On Mon, 4 Feb 2019 at 11:34 AM, Soheil Pourbafrani wrote: > I'll try it > For your information, I connect another single node Kafka to the same > Zookeeper cl

Re: Kafka topic data automatically restore after deleting topics

2019-02-03 Thread Soheil Pourbafrani
I'll try it For your information, I connect another single node Kafka to the same Zookeeper cluster and it got data without any error. In addition, I turned off one of the Kafka nodes and the single remaining node did the same thing, it created topics but in less than one minutes the log dir direct

Re: Kafka topic data automatically restore after deleting topics

2019-02-03 Thread ANJANEYA PRASAD NIDUBROLU
Can you please try with 3 zookeeper nodes? I guess the leader election is not happening correctly due to even number of servers. Thanks, Anji. On Sun, 3 Feb 2019, 17:27 Soheil Pourbafrani Hi, > > I use Kafka 0.11.3 > > I delete topics from Kafka using the command *kafka-topic.sh *and after a > w

Kafka topic data automatically restore after deleting topics

2019-02-03 Thread Soheil Pourbafrani
Hi, I use Kafka 0.11.3 I delete topics from Kafka using the command *kafka-topic.sh *and after a while, I observer Kafka just mark topics for deletion while the property *delete.topic.enable *was true! So I stop Kafka cluster and delete the data log directory of Kafka using the command *rm -r /da

JMX metrices are not updated after deleting topics

2015-09-15 Thread shanthu Venkatesan
Hi all, I have a cluster with 3 brokers. I've created a topic "test" with 3 partitions and replication factor 3. I produced 2 messages to "test-2". Then I checked JMX metrices (LogEndOffset) which showed 2 for "test-2". Now I deleted "test", the logs related to "test" are deleted in both

Re: Problem deleting topics in 0.8.2?

2015-03-04 Thread Jeff Schroeder
Timothy and Harsha, Conveniently, a coworker figured this out almost immediately after I sent this email. I was passing the zookeeper bits as: --zookeeper 'host1:2181,host2:2181,host3:2181/path/to/zk/chroot' When the actual correct thing to do was: --zookeeper 'host1:2181/path/to/zk/chroot' I

Re: Problem deleting topics in 0.8.2?

2015-03-04 Thread Timothy Chen
Hi Jeff, The controller should have a Topic deletion thread running coordinating the delete in the cluster, and the progress should be logged to the controller log. Can you look at the controller log to see what's going on? Tim On Wed, Mar 4, 2015 at 10:28 AM, Jeff Schroeder wrote: > So I've g

Re: Problem deleting topics in 0.8.2?

2015-03-04 Thread Harsha
Hi Jeff, Are you seeing any errors in state-change.log or controller.log after issuing kafka-topics.sh --delete command. There is another known issue is if you have auto.topic.enable.create = true (this is true by default) your consumer or producer can re-create the topic. So try

Problem deleting topics in 0.8.2?

2015-03-04 Thread Jeff Schroeder
So I've got 3 kafka brokers that were started with delete.topic.enable set to true. When they start, I can see in the logs that the property was successfully set. The dataset in each broker is only approximately 2G (per du). When running kafaka-delete.sh with the correct arguments to delete all of

Re: deleting topics

2014-06-04 Thread Guozhang Wang
The delete topic utility should be workable in the next release 0.8.2. Guozhang On Wed, Jun 4, 2014 at 1:29 AM, Piotr Jagielski wrote: > Hi all, > > Can anyone explain the current state of deleting topics? We've > found delete.topic.enable config property and after sett

deleting topics

2014-06-04 Thread Piotr Jagielski
Hi all, Can anyone explain the current state of deleting topics? We've found delete.topic.enable config property and after setting it to true on 0.8.1.1 deletion seems to work ok. There is also a fix of https://issues.apache.org/jira/browse/KAFKA-1397 in the trunk is it possible that 0.8.2