[jira] [Updated] (AMQ-5695) KahaDB not cleaning up log files
[ https://issues.apache.org/jira/browse/AMQ-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arthur Naseef updated AMQ-5695: --- Assignee: (was: Arthur Naseef) > KahaDB not cleaning up log files > > > Key: AMQ-5695 > URL: https://issues.apache.org/jira/browse/AMQ-5695 > Project: ActiveMQ > Issue Type: Bug >Affects Versions: 5.11.1 >Reporter: Stefan Warten > > Since we have upgraded ActiveMQ from 5.10.0 to 5.11.1, KahaDB is not cleaning > up log files properly. It seems to keep all of them. It helped once to > restart the service and minutes later, ActiveMQ cleaned up 95% of log files > but mostly it is not cleaning up at all. > When partition was full, I stopped ActiveMQ, copied the KahaDB to another > host and started it with empty queues again. Then I forwarded all messages > from that other host back. Even when all messages were forwarded and all > queues were empty, the old KahaDB log files were not cleaned up. > I stopped ActiveMQ, removed db.data and db.redo to rebuild index which took > around 3h (350GB of log files) but still, the log files are not cleaned up. > [...] > 2015-03-30 18:21:55,532 | INFO | @13786:158508, 32130 entries recovered > .. | org.apache.activemq.store.kahadb.MessageDatabase | WrapperSimpleAppMain > 2015-03-30 18:22:02,090 | INFO | Recovery replayed 321378917 operations from > the journal in 9226.159 seconds. | > org.apache.activemq.store.kahadb.MessageDatabase | WrapperSimpleAppMain > 2015-03-30 18:22:02,402 | INFO | installing runtimeConfiguration plugin | > org.apache.activemq.plugin.RuntimeConfigurationPlugin | WrapperSimpleAppMain > 2015-03-30 18:22:04,576 | INFO | Apache ActiveMQ 5.11.1 > (prd-mig-02-sat.example.com, > ID:prd-mig-02-sat.example.com-26260-1427730492201-1:1) is starting | > org.apache.activemq.broker.BrokerService | WrapperSimpleAppMain > 2015-03-30 18:22:04,946 | INFO | pending local transactions: [] | > org.apache.activemq.store.kahadb.MultiKahaDBTransactionStore | > WrapperSimpleAppMain > 2015-03-30 18:22:08,488 | INFO | Configuration class path resource > [activemq.xml] | org.apache.activemq.plugin.RuntimeConfigurationBroker | > WrapperSimpleAppMain > 2015-03-30 18:22:12,198 | INFO | Listening for connections at: > nio://prd-mig-02-sat.example.com:61616?transport.reuseAddress=true | > org.apache.activemq.transport.TransportServerThreadSupport | > WrapperSimpleAppMain > 2015-03-30 18:22:12,199 | INFO | Connector openwire started | > org.apache.activemq.broker.TransportConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,232 | INFO | Listening for connections at: > stomp+nio://prd-mig-02-sat.example.com:61613?transport.closeAsync=false=true > | org.apache.activemq.transport.TransportServerThreadSupport | > WrapperSimpleAppMain > 2015-03-30 18:22:12,234 | INFO | Connector stomp started | > org.apache.activemq.broker.TransportConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,237 | INFO | Establishing network connection from > vm://prd-mig-02-sat.example.com?async=false=true to > tcp://172.42.15.40:61616 | > org.apache.activemq.network.DiscoveryNetworkConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,286 | INFO | Connector vm://prd-mig-02-sat.example.com > started | org.apache.activemq.broker.TransportConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,318 | INFO | Establishing network connection from > vm://prd-mig-02-sat.example.com?async=false=true to > tcp://172.42.15.39:61616 | > org.apache.activemq.network.DiscoveryNetworkConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,321 | INFO | Network Connector > DiscoveryNetworkConnector:FORWARDER:BrokerService[prd-mig-02-sat.example.com] > started | org.apache.activemq.network.NetworkConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,325 | INFO | Apache ActiveMQ 5.11.1 > (prd-mig-02-sat.example.com, > ID:prd-mig-02-sat.example.com-26260-1427730492201-1:1) started | > org.apache.activemq.broker.BrokerService | WrapperSimpleAppMain > 2015-03-30 18:22:12,326 | INFO | For help or more information please see: > http://activemq.apache.org | org.apache.activemq.broker.BrokerService | > WrapperSimpleAppMain > 2015-03-30 18:22:12,381 | INFO | Network connection between > vm://prd-mig-02-sat.example.com#0 and tcp:///172.42.15.40:61616@58567 > (prdvip-amq-01-sat.example.com) has been established. | > org.apache.activemq.network.DemandForwardingBridgeSupport | > triggerStartAsyncNetworkBridgeCreation: > remoteBroker=tcp:///172.42.15.40:61616@58567, localBroker= > vm://prd-mig-02-sat.example.com#0 > 2015-03-30 18:22:12,381 | INFO | Network connection between > vm://prd-mig-02-sat.example.com#2 and tcp:///172.42.15.39:61616@4523 > (prdvip-amq-02-sat.example.com) has been established. | > org.apache.activemq.network.DemandForwardingBridgeSupport | >
[jira] [Updated] (AMQ-5695) KahaDB not cleaning up log files
[ https://issues.apache.org/jira/browse/AMQ-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arthur Naseef updated AMQ-5695: --- Priority: Blocker (was: Major) > KahaDB not cleaning up log files > > > Key: AMQ-5695 > URL: https://issues.apache.org/jira/browse/AMQ-5695 > Project: ActiveMQ > Issue Type: Bug >Affects Versions: 5.11.1 >Reporter: Stefan Warten >Priority: Blocker > > Since we have upgraded ActiveMQ from 5.10.0 to 5.11.1, KahaDB is not cleaning > up log files properly. It seems to keep all of them. It helped once to > restart the service and minutes later, ActiveMQ cleaned up 95% of log files > but mostly it is not cleaning up at all. > When partition was full, I stopped ActiveMQ, copied the KahaDB to another > host and started it with empty queues again. Then I forwarded all messages > from that other host back. Even when all messages were forwarded and all > queues were empty, the old KahaDB log files were not cleaned up. > I stopped ActiveMQ, removed db.data and db.redo to rebuild index which took > around 3h (350GB of log files) but still, the log files are not cleaned up. > [...] > 2015-03-30 18:21:55,532 | INFO | @13786:158508, 32130 entries recovered > .. | org.apache.activemq.store.kahadb.MessageDatabase | WrapperSimpleAppMain > 2015-03-30 18:22:02,090 | INFO | Recovery replayed 321378917 operations from > the journal in 9226.159 seconds. | > org.apache.activemq.store.kahadb.MessageDatabase | WrapperSimpleAppMain > 2015-03-30 18:22:02,402 | INFO | installing runtimeConfiguration plugin | > org.apache.activemq.plugin.RuntimeConfigurationPlugin | WrapperSimpleAppMain > 2015-03-30 18:22:04,576 | INFO | Apache ActiveMQ 5.11.1 > (prd-mig-02-sat.example.com, > ID:prd-mig-02-sat.example.com-26260-1427730492201-1:1) is starting | > org.apache.activemq.broker.BrokerService | WrapperSimpleAppMain > 2015-03-30 18:22:04,946 | INFO | pending local transactions: [] | > org.apache.activemq.store.kahadb.MultiKahaDBTransactionStore | > WrapperSimpleAppMain > 2015-03-30 18:22:08,488 | INFO | Configuration class path resource > [activemq.xml] | org.apache.activemq.plugin.RuntimeConfigurationBroker | > WrapperSimpleAppMain > 2015-03-30 18:22:12,198 | INFO | Listening for connections at: > nio://prd-mig-02-sat.example.com:61616?transport.reuseAddress=true | > org.apache.activemq.transport.TransportServerThreadSupport | > WrapperSimpleAppMain > 2015-03-30 18:22:12,199 | INFO | Connector openwire started | > org.apache.activemq.broker.TransportConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,232 | INFO | Listening for connections at: > stomp+nio://prd-mig-02-sat.example.com:61613?transport.closeAsync=false=true > | org.apache.activemq.transport.TransportServerThreadSupport | > WrapperSimpleAppMain > 2015-03-30 18:22:12,234 | INFO | Connector stomp started | > org.apache.activemq.broker.TransportConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,237 | INFO | Establishing network connection from > vm://prd-mig-02-sat.example.com?async=false=true to > tcp://172.42.15.40:61616 | > org.apache.activemq.network.DiscoveryNetworkConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,286 | INFO | Connector vm://prd-mig-02-sat.example.com > started | org.apache.activemq.broker.TransportConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,318 | INFO | Establishing network connection from > vm://prd-mig-02-sat.example.com?async=false=true to > tcp://172.42.15.39:61616 | > org.apache.activemq.network.DiscoveryNetworkConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,321 | INFO | Network Connector > DiscoveryNetworkConnector:FORWARDER:BrokerService[prd-mig-02-sat.example.com] > started | org.apache.activemq.network.NetworkConnector | WrapperSimpleAppMain > 2015-03-30 18:22:12,325 | INFO | Apache ActiveMQ 5.11.1 > (prd-mig-02-sat.example.com, > ID:prd-mig-02-sat.example.com-26260-1427730492201-1:1) started | > org.apache.activemq.broker.BrokerService | WrapperSimpleAppMain > 2015-03-30 18:22:12,326 | INFO | For help or more information please see: > http://activemq.apache.org | org.apache.activemq.broker.BrokerService | > WrapperSimpleAppMain > 2015-03-30 18:22:12,381 | INFO | Network connection between > vm://prd-mig-02-sat.example.com#0 and tcp:///172.42.15.40:61616@58567 > (prdvip-amq-01-sat.example.com) has been established. | > org.apache.activemq.network.DemandForwardingBridgeSupport | > triggerStartAsyncNetworkBridgeCreation: > remoteBroker=tcp:///172.42.15.40:61616@58567, localBroker= > vm://prd-mig-02-sat.example.com#0 > 2015-03-30 18:22:12,381 | INFO | Network connection between > vm://prd-mig-02-sat.example.com#2 and tcp:///172.42.15.39:61616@4523 > (prdvip-amq-02-sat.example.com) has been established. | >
