[ 
https://issues.apache.org/jira/browse/ARTEMIS-2823?focusedWorklogId=485135&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485135
 ]

ASF GitHub Bot logged work on ARTEMIS-2823:
-------------------------------------------

                Author: ASF GitHub Bot
            Created on: 16/Sep/20 13:09
            Start Date: 16/Sep/20 13:09
    Worklog Time Spent: 10m 
      Work Description: franz1981 commented on pull request #3204:
URL: https://github.com/apache/activemq-artemis/pull/3204#issuecomment-693393537


   Nope it seems related to how we configure the network connection timeout 
(still need to understand if it makes sense...).
   
   I see a similar problem on backup side while live is restarting, see:
   ```
   2020-09-16 15:07:09,990 INFO  [org.apache.activemq.artemis.core.server] 
AMQ221008: live server wants to restart, restarting server in backup
   2020-09-16 15:07:10,181 INFO  [org.apache.activemq.artemis.core.server] 
AMQ221002: Apache ActiveMQ Artemis Message Broker version 2.14.0-SNAPSHOT 
[b25dd37c-f77c-11ea-9566-1aabf22f14df] stopped, uptime 1 minute
   2020-09-16 15:07:10,183 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.AbstractJDBCDriver.createTableIfNotExists(AbstractJDBCDriver.java:90)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.AbstractJDBCDriver.createTable(AbstractJDBCDriver.java:63)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.createSchema(JdbcSharedStateManager.java:68)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.AbstractJDBCDriver.start(AbstractJDBCDriver.java:50)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.usingConnectionProvider(JdbcSharedStateManager.java:58)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.lambda$usingConnectionProvider$0(JdbcNodeManager.java:91)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.start(JdbcNodeManager.java:162)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation$FailbackChecker$1.run(SharedStoreBackupActivation.java:217)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_265]
   
   2020-09-16 15:07:10,191 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.setup(JdbcSharedStateManager.java:193)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.start(JdbcNodeManager.java:164)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation$FailbackChecker$1.run(SharedStoreBackupActivation.java:217)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_265]
   
   2020-09-16 15:07:10,195 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.readState(JdbcSharedStateManager.java:285)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.readSharedState(JdbcNodeManager.java:477)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.awaitLiveStatus(JdbcNodeManager.java:451)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation$FailbackChecker$1.run(SharedStoreBackupActivation.java:219)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_265]
   
   2020-09-16 15:07:12,198 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.readState(JdbcSharedStateManager.java:285)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.readSharedState(JdbcNodeManager.java:477)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.awaitLiveStatus(JdbcNodeManager.java:451)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation$FailbackChecker$1.run(SharedStoreBackupActivation.java:219)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_265]
   
   2020-09-16 15:07:12,201 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.sql.PropertySQLProvider$Factory.investigateDialect(PropertySQLProvider.java:405)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.sql.PropertySQLProvider$Factory.<init>(PropertySQLProvider.java:366)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.with(JdbcNodeManager.java:67)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.createNodeManager(ActiveMQServerImpl.java:501)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.internalStart(ActiveMQServerImpl.java:578)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.start(ActiveMQServerImpl.java:526)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation$FailbackChecker$1.run(SharedStoreBackupActivation.java:230)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_265]
   
   2020-09-16 15:07:12,202 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.AbstractJDBCDriver.createTableIfNotExists(AbstractJDBCDriver.java:90)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.AbstractJDBCDriver.createTable(AbstractJDBCDriver.java:63)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.createSchema(JdbcSharedStateManager.java:68)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.AbstractJDBCDriver.start(AbstractJDBCDriver.java:50)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.usingConnectionProvider(JdbcSharedStateManager.java:58)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.lambda$usingConnectionProvider$0(JdbcNodeManager.java:91)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.start(JdbcNodeManager.java:162)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.internalStart(ActiveMQServerImpl.java:580)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.start(ActiveMQServerImpl.java:526)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation$FailbackChecker$1.run(SharedStoreBackupActivation.java:230)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_265]
   
   2020-09-16 15:07:12,205 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcSharedStateManager.setup(JdbcSharedStateManager.java:193)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.start(JdbcNodeManager.java:164)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.internalStart(ActiveMQServerImpl.java:580)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.start(ActiveMQServerImpl.java:526)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation$FailbackChecker$1.run(SharedStoreBackupActivation.java:230)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_265]
   
   2020-09-16 15:07:12,207 INFO  [org.apache.activemq.artemis.core.server] 
AMQ221000: backup Message Broker is starting with configuration Broker 
Configuration 
(clustered=true,jdbcDriverClassName=com.mysql.cj.jdbc.Driver,jdbcConnectionUrl=jdbc:mysql://localhost:3306/mysql,messageTableName=MESSAGE_TABLE,bindingsTableName=BINDINGS_TABLE,largeMessageTableName=LARGE_MESSAGES_TABLE,pageStoreTableName=PAGE_TABLE,)
   2020-09-16 15:07:14,586 INFO  [org.apache.activemq.artemis.core.server] 
AMQ221032: Waiting to become backup node
   2020-09-16 15:07:14,587 WARN  
[org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider] Unable 
to set a network timeout on the JDBC connection: 
java.util.concurrent.RejectedExecutionException: Task 
org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$61/1394940518@15f4294c
 rejected from 
org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor@69d38d0a[Terminated,
 pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 265]
           at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
 [rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) 
[rt.jar:1.8.0_265]
           at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
[rt.jar:1.8.0_265]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.onAddedTaskIfNotRunning(ProcessorBase.java:186)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.ProcessorBase.task(ProcessorBase.java:174)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.utils.actors.OrderedExecutor.execute(OrderedExecutor.java:54)
 [artemis-commons-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
com.mysql.cj.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:2488) 
[mysql-connector-java-8.0.21.jar:8.0.21]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.Jdbc41Bridge.setNetworkTimeout(Jdbc41Bridge.java:386) 
[commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.commons.dbcp2.DelegatingConnection.setNetworkTimeout(DelegatingConnection.java:985)
 [commons-dbcp2-2.7.0.jar:2.7.0]
           at 
org.apache.activemq.artemis.jdbc.store.drivers.JDBCConnectionProvider.getConnection(JDBCConnectionProvider.java:62)
 [artemis-jdbc-store-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcLeaseLock.tryAcquire(JdbcLeaseLock.java:175)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.LeaseLock.tryAcquire(LeaseLock.java:91)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.LeaseLock.tryAcquire(LeaseLock.java:109)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.lock(JdbcNodeManager.java:267)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.jdbc.JdbcNodeManager.startBackup(JdbcNodeManager.java:360)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.SharedStoreBackupActivation.run(SharedStoreBackupActivation.java:62)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
           at 
org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$ActivationThread.run(ActiveMQServerImpl.java:3981)
 [artemis-server-2.14.0-SNAPSHOT.jar:2.14.0-SNAPSHOT]
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Issue Time Tracking
-------------------

    Worklog Id:     (was: 485135)
    Time Spent: 6h 10m  (was: 6h)

> Improve JDBC connection management
> ----------------------------------
>
>                 Key: ARTEMIS-2823
>                 URL: https://issues.apache.org/jira/browse/ARTEMIS-2823
>             Project: ActiveMQ Artemis
>          Issue Type: Improvement
>          Components: Broker
>            Reporter: Mikko
>            Priority: Major
>          Time Spent: 6h 10m
>  Remaining Estimate: 0h
>
> I have a case where the whole clustering reliability and HA must rely on HA 
> capabilities of clustered database, and running on top of application server 
> is not an option.
> The current JDBC store implementation is rather bare bones on the connection 
> management side. JDBC driver is used directly with no management layer. At 
> startup, the broker just opens couple of direct connections to database and 
> expects them to be available forever. This is something that cannot be 
> expected in HA production environment. So, similarly to the discussion linked 
> below, in our case we lose the db connection after one hour, and all the 
> brokers need to be restared to get new connections:
> [http://activemq.2283324.n4.nabble.com/Artemis-does-not-reconnect-to-MySQL-after-connection-timeout-td4751956.html]
>  
> This is something that could be resolved by simply using JDBC4 isValid 
> checks, but proper connection handling and pooling through datasource would 
> be preferrable.
> I have implemented a solution for this by using DBCP2 datasource. Our test 
> cluster has been successfully running this forked version since the release 
> of Artemis 2.13.0. I will prepare of pull request if this is seen to be 
> something that can be useful.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to