[
https://issues.apache.org/jira/browse/KAFKA-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019176#comment-17019176
]
panpan.liu commented on KAFKA-9142:
-----------------------------------
[~guozhang] Yes.
Before I restart broker, I found there is no cleaner thread by jstack.
This is loading log after restart broker.
```
/server.log.2020-01-15-08:[2020-01-15 08:32:26,819] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 223641 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,017] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 223839 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,140] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 223962 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,281] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 224103 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,399] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 224221 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,509] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 224331 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,693] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 224515 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,863] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 224685 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:27,993] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 224815 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:28,313] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 225135 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:28,456] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 225278 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:28,656] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 225478 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:28,982] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 225804 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:29,167] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 225989 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:29,493] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 226315 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:29,506] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 226328 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:29,715] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 226537 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:29,919] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 226741 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:30,149] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 226971 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:30,424] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 227246 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:30,698] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 227520 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:30,920] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 227742 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:31,242] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 228064 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
./server.log.2020-01-15-08:[2020-01-15 08:32:31,640] INFO [Transaction State
Manager 0]: Finished loading 9 transaction metadata from __transaction_state-24
in 228462 milliseconds (kafka.coordinator.transaction.TransactionStateManager)
```
> topic __transaction_state disk space grows too big
> --------------------------------------------------
>
> Key: KAFKA-9142
> URL: https://issues.apache.org/jira/browse/KAFKA-9142
> Project: Kafka
> Issue Type: Improvement
> Components: log cleaner
> Affects Versions: 2.0.0
> Reporter: panpan.liu
> Priority: Critical
> Attachments: image-2019-11-05-15-31-46-859.png,
> image-2019-11-05-15-33-55-632.png, image-2019-11-05-15-36-52-235.png
>
>
> kafka broker :2.0.0
> kafka stream client: 2.1.0
> topic description please see attachements.
> The broker runs from 10/2018. I find the topic grows up and does not delete
> (*cleanup.policy=compact*).
> How can I handle it ?
>
> {code:java}
> # topic description(default)
> Topic:__transaction_state PartitionCount:50 ReplicationFactor:2
> Configs:segment.bytes=104857600,unclean.leader.election.enable=false,compression.type=uncompressed,cleanup.policy=compact,min.insync.replicas=1
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
