In production with ActiveMQ 5.11 with multi-kahadb per destination on NFSv4 M|S (Linux 7.1), we're seeing the following log messages intermittently during operations:
*Slow KahaDB access: Journal append took: 2 ms, Index update took 16901 ms* Also, on startup, we see the following in our kahadb logs; this condition severely impacts start up time, sometimes taking up to 90m for the broker to start, and that's for relatively small persistent store (< 5Gb). We have not adjusted indexCacheSize, that will be our first attempt to resolve this; we also plan to benchmark NFSv4 file system performance. Aside from that, is there any other broker config 2017-09-25 14:35:27,352 [AMQ-1-thread-1 ] DEBUG ListIndex - loading 2017-09-25 14:35:27,365 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovering from the journal @1:76785 2017-09-25 14:35:27,365 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovering from the journal @1:76785 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovery replayed 1 operations from the journal in 0.012 seconds. 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovery replayed 1 operations from the journal in 0.012 seconds. 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopping async queue tasks 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopping async topic tasks 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopped KahaDB 2017-09-25 14:35:27,855 [AMQ-1-thread-1 ] DEBUG KahaDBStore - Store OpenWire version configured as: 6 2017-09-25 14:35:30,234 [AMQ-1-thread-1 ] TRACE Journal - Startup took: 2372 ms 2017-09-25 14:35:30,276 [AMQ-1-thread-1 ] INFO MessageDatabase - KahaDB is version 5 2017-09-25 14:35:30,276 [AMQ-1-thread-1 ] INFO MessageDatabase - KahaDB is version 5 2017-09-25 14:35:30,281 [AMQ-1-thread-1 ] DEBUG ListIndex - loading 2017-09-25 14:35:30,282 [AMQ-1-thread-1 ] DEBUG ListIndex - loading 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovering from the journal @1:70835 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovering from the journal @1:70835 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovery replayed 1 operations from the journal in 0.012 seconds. 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovery replayed 1 operations from the journal in 0.012 seconds. 2017-09-25 14:35:30,297 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopping async queue tasks 2017-09-25 14:35:30,297 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopping async topic tasks 2017-09-25 14:35:30,297 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopped KahaDB 2017-09-25 14:35:30,785 [AMQ-1-thread-1 ] DEBUG KahaDBStore - Store OpenWire version configured as: 6 2017-09-25 14:35:33,023 [AMQ-1-thread-1 ] TRACE Journal - Startup took: 2231 ms 2017-09-25 14:35:33,060 [AMQ-1-thread-1 ] INFO MessageDatabase - KahaDB is version 5 2017-09-25 14:35:33,060 [AMQ-1-thread-1 ] INFO MessageDatabase - KahaDB is version 5 2017-09-25 14:35:33,065 [AMQ-1-thread-1 ] DEBUG ListIndex - loading 2017-09-25 14:35:33,066 [AMQ-1-thread-1 ] DEBUG ListIndex - loading 2017-09-25 14:35:33,080 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovering from the journal @1:55603 2017-09-25 14:35:33,080 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovering from the journal @1:55603 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovery replayed 1 operations from the journal in 0.013 seconds. 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO MessageDatabase - Recovery replayed 1 operations from the journal in 0.013 seconds. 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopping async queue tasks 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopping async topic tasks 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO KahaDBStore - Stopped KahaDB -- Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
