Ajay Kapoor created KAFKA-10419: ----------------------------------- Summary: KAFKA BROKER Shuts down when a topic is deleted manually from command line on Windows 1) operating System. Key: KAFKA-10419 URL: https://issues.apache.org/jira/browse/KAFKA-10419 Project: Kafka Issue Type: Bug Components: KafkaConnect Affects Versions: 2.6.0 Environment: WIndows 10 Operating System Reporter: Ajay Kapoor
KAFKA VERSION: KAFKA_2.13-2.6.0 Delete of topic on Windows causes kafka broker shutdown: [2020-08-18 15:18:22,858] INFO [ReplicaAlterLogDirsManager on broker 0] Removed fetcher for partitions Set(quickstart-events-0) (kafka.server.ReplicaAlterLogDirsManager) [2020-08-18 15:18:22,899] ERROR Error while renaming dir for quickstart-events-0 in log dir C:\tmp\kafka-logs (kafka.server.LogDirFailureChannel) java.nio.file.AccessDeniedException: C:\tmp\kafka-logs\quickstart-events-0 -> C:\tmp\kafka-logs\quickstart-events-0.d767af7933ae4fe087c212994ef02e90-delete at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:89) at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103) at java.base/sun.nio.fs.WindowsFileCopy.move(WindowsFileCopy.java:395) at java.base/sun.nio.fs.WindowsFileSystemProvider.move(WindowsFileSystemProvider.java:292) at java.base/java.nio.file.Files.move(Files.java:1425) at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:913) at kafka.log.Log.$anonfun$renameDir$2(Log.scala:981) at kafka.log.Log.renameDir(Log.scala:2340) at kafka.log.LogManager.asyncDelete(LogManager.scala:935) at kafka.cluster.Partition.$anonfun$delete$1(Partition.scala:470) at kafka.cluster.Partition.delete(Partition.scala:461) at kafka.server.ReplicaManager.stopReplica(ReplicaManager.scala:344) at kafka.server.ReplicaManager.$anonfun$stopReplicas$9(ReplicaManager.scala:448) at scala.collection.mutable.HashMap$Node.foreach(HashMap.scala:587) at scala.collection.mutable.HashMap.foreach(HashMap.scala:475) at kafka.server.ReplicaManager.stopReplicas(ReplicaManager.scala:445) at kafka.server.KafkaApis.handleStopReplicaRequest(KafkaApis.scala:252) at kafka.server.KafkaApis.handle(KafkaApis.scala:137) at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:70) at java.base/java.lang.Thread.run(Thread.java:830) Suppressed: java.nio.file.AccessDeniedException: C:\tmp\kafka-logs\quickstart-events-0 -> C:\tmp\kafka-logs\quickstart-events-0.d767af7933ae4fe087c212994ef02e90-delete at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:89) at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103) at java.base/sun.nio.fs.WindowsFileCopy.move(WindowsFileCopy.java:309) at java.base/sun.nio.fs.WindowsFileSystemProvider.move(WindowsFileSystemProvider.java:292) at java.base/java.nio.file.Files.move(Files.java:1425) at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:910) ... 14 more [2020-08-18 15:18:22,914] WARN [ReplicaManager broker=0] Stopping serving replicas in dir C:\tmp\kafka-logs (kafka.server.ReplicaManager) [2020-08-18 15:18:22,930] WARN [ReplicaManager broker=0] Broker 0 stopped fetcher for partitions and stopped moving logs for partitions because they are in the failed log directory C:\tmp\kafka-logs. (kafka.server.ReplicaManager) [2020-08-18 15:18:22,932] WARN Stopping serving logs in dir C:\tmp\kafka-logs (kafka.log.LogManager) [2020-08-18 15:18:22,946] ERROR Shutdown broker because all log dirs in C:\tmp\kafka-logs have failed (kafka.log.LogManager) How to reproduce:: 1. Start Zookeeper on windows >bin\windows\zookeeper-server-start.bat config\zookeeper.properties 2. Start Kafka Broker on Windows >bin\windows\kafka-server-start.bat config\server.properties 3. Create a Topic on Kafka Broker >bin\windows\kafka-topics.bat --create --topic quickstart-events >--bootstrap-server localhost:9092 4. Delete the Kafka Topic created above. >bin\windows\kafka-topics.bat --delete --topic quickstart-events >--bootstrap-server localhost:9092 -- This message was sent by Atlassian Jira (v8.3.4#803005)