[jira] Commented: (OFBIZ-2315) TransactionUtil : 3 Map corruptions related to mis synchronization
[ https://issues.apache.org/jira/browse/OFBIZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12714862#action_12714862 ] Philippe Mouawad commented on OFBIZ-2315: - Hello M. Le Roux, I confirm they have fixed the problems. Can you look at other issues I submitted and the patches. I also confirm that all the patches I submitted have been tested successfully in production. Philippe www.ubik-ingenierie.com TransactionUtil : 3 Map corruptions related to mis synchronization -- Key: OFBIZ-2315 URL: https://issues.apache.org/jira/browse/OFBIZ-2315 Project: OFBiz Issue Type: Bug Affects Versions: Release Branch 4.0, SVN trunk Reporter: Philippe Mouawad Fix For: SVN trunk Attachments: ContentionLog.txt, patch-TransactionUtil.patch Randomly we are having Thread contention problems in production related to synchronization issues in this class. See attached log file. As you can see, a lot of threads are locked by some code called by TransactionUtil.setTransactionBeginStack that has been running for 180165 ms : Thread[default-invoker-Thread-4582999,5,main]:4590333, stackTrace: javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.access$1200(Unknown Source) javolution.util.FastMap$3.run(Unknown Source) javax.realtime.MemoryArea.executeInArea(Unknown Source) javolution.util.FastMap.resizeTable(Unknown Source) javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.addEntry(Unknown Source) javolution.util.FastMap.put(Unknown Source) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:657) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:646) org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:135) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:297) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:208) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:149) org.ofbiz.service.job.GenericServiceJob.exec(GenericServiceJob.java:69) org.ofbiz.service.job.JobInvoker.run(JobInvoker.java:240) java.lang.Thread.run(Thread.java:595) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (OFBIZ-2315) TransactionUtil : 3 Map corruptions related to mis synchronization
[ https://issues.apache.org/jira/browse/OFBIZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12714871#action_12714871 ] Jacques Le Roux commented on OFBIZ-2315: Thanks for the update Philippe, I have no time in a predictable future to look seriously at the other issues. But I have not forgotten since I have a client who has also some issues of that kind (thoug not with the trunk but something near R4.0 where I have already switched from Minerva to DBCP) My client told me that this issues could be related to orders with a lot of lines (up to thousands) and at least 25 people creating such orders concurrently in backend (not at a high speed though, like with an heavily used eCommerce frontend, since there are a lot of item to put and lines to create in each order) He also told me that maybe async jobs could be involved (orders confirmations). But this client does not use an SMTP server, so maybe simply avoiding to send orders confirmations will solve his issues (crossing fingers ;)) TransactionUtil : 3 Map corruptions related to mis synchronization -- Key: OFBIZ-2315 URL: https://issues.apache.org/jira/browse/OFBIZ-2315 Project: OFBiz Issue Type: Bug Affects Versions: Release Branch 4.0, SVN trunk Reporter: Philippe Mouawad Fix For: SVN trunk Attachments: ContentionLog.txt, patch-TransactionUtil.patch Randomly we are having Thread contention problems in production related to synchronization issues in this class. See attached log file. As you can see, a lot of threads are locked by some code called by TransactionUtil.setTransactionBeginStack that has been running for 180165 ms : Thread[default-invoker-Thread-4582999,5,main]:4590333, stackTrace: javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.access$1200(Unknown Source) javolution.util.FastMap$3.run(Unknown Source) javax.realtime.MemoryArea.executeInArea(Unknown Source) javolution.util.FastMap.resizeTable(Unknown Source) javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.addEntry(Unknown Source) javolution.util.FastMap.put(Unknown Source) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:657) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:646) org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:135) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:297) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:208) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:149) org.ofbiz.service.job.GenericServiceJob.exec(GenericServiceJob.java:69) org.ofbiz.service.job.JobInvoker.run(JobInvoker.java:240) java.lang.Thread.run(Thread.java:595) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (OFBIZ-2315) TransactionUtil : 3 Map corruptions related to mis synchronization
[ https://issues.apache.org/jira/browse/OFBIZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12714679#action_12714679 ] Jacques Le Roux commented on OFBIZ-2315: Please Philippe, could you confirm this commit has fixed the problems you encountered ? Thanks TransactionUtil : 3 Map corruptions related to mis synchronization -- Key: OFBIZ-2315 URL: https://issues.apache.org/jira/browse/OFBIZ-2315 Project: OFBiz Issue Type: Bug Affects Versions: Release Branch 4.0, SVN trunk Reporter: Philippe Mouawad Attachments: ContentionLog.txt, patch-TransactionUtil.patch Randomly we are having Thread contention problems in production related to synchronization issues in this class. See attached log file. As you can see, a lot of threads are locked by some code called by TransactionUtil.setTransactionBeginStack that has been running for 180165 ms : Thread[default-invoker-Thread-4582999,5,main]:4590333, stackTrace: javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.access$1200(Unknown Source) javolution.util.FastMap$3.run(Unknown Source) javax.realtime.MemoryArea.executeInArea(Unknown Source) javolution.util.FastMap.resizeTable(Unknown Source) javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.addEntry(Unknown Source) javolution.util.FastMap.put(Unknown Source) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:657) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:646) org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:135) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:297) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:208) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:149) org.ofbiz.service.job.GenericServiceJob.exec(GenericServiceJob.java:69) org.ofbiz.service.job.JobInvoker.run(JobInvoker.java:240) java.lang.Thread.run(Thread.java:595) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (OFBIZ-2315) TransactionUtil : 3 Map corruptions related to mis synchronization
[ https://issues.apache.org/jira/browse/OFBIZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12700584#action_12700584 ] Jacques Le Roux commented on OFBIZ-2315: Philippe, David has commited changes at r766429. Not sure if it's complete since Davd did not close this issue yet... TransactionUtil : 3 Map corruptions related to mis synchronization -- Key: OFBIZ-2315 URL: https://issues.apache.org/jira/browse/OFBIZ-2315 Project: OFBiz Issue Type: Bug Affects Versions: Release Branch 4.0, SVN trunk Reporter: Philippe Mouawad Attachments: ContentionLog.txt, patch-TransactionUtil.patch Randomly we are having Thread contention problems in production related to synchronization issues in this class. See attached log file. As you can see, a lot of threads are locked by some code called by TransactionUtil.setTransactionBeginStack that has been running for 180165 ms : Thread[default-invoker-Thread-4582999,5,main]:4590333, stackTrace: javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.access$1200(Unknown Source) javolution.util.FastMap$3.run(Unknown Source) javax.realtime.MemoryArea.executeInArea(Unknown Source) javolution.util.FastMap.resizeTable(Unknown Source) javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.addEntry(Unknown Source) javolution.util.FastMap.put(Unknown Source) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:657) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:646) org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:135) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:297) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:208) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:149) org.ofbiz.service.job.GenericServiceJob.exec(GenericServiceJob.java:69) org.ofbiz.service.job.JobInvoker.run(JobInvoker.java:240) java.lang.Thread.run(Thread.java:595) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (OFBIZ-2315) TransactionUtil : 3 Map corruptions related to mis synchronization
[ https://issues.apache.org/jira/browse/OFBIZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12700153#action_12700153 ] Philippe Mouawad commented on OFBIZ-2315: - After analysis, we can see that 2 maps : - allThreadsTransactionBeginStack - allThreadsTransactionBeginStackSave Are not synchronized and can be accessed (corrupted) from non synchronized blocks. This IMHO provokes corruption of FastMap and explains why the FastMap.resizeTable has been running for so long. TransactionUtil : 3 Map corruptions related to mis synchronization -- Key: OFBIZ-2315 URL: https://issues.apache.org/jira/browse/OFBIZ-2315 Project: OFBiz Issue Type: Bug Affects Versions: Release Branch 4.0, SVN trunk Reporter: Philippe Mouawad Attachments: ContentionLog.txt Randomly we are having Thread contention problems in production related to synchronization issues in this class. See attached log file. As you can see, a lot of threads are locked by some code called by TransactionUtil.setTransactionBeginStack that has been running for 180165 ms : Thread[default-invoker-Thread-4582999,5,main]:4590333, stackTrace: javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.access$1200(Unknown Source) javolution.util.FastMap$3.run(Unknown Source) javax.realtime.MemoryArea.executeInArea(Unknown Source) javolution.util.FastMap.resizeTable(Unknown Source) javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.addEntry(Unknown Source) javolution.util.FastMap.put(Unknown Source) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:657) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:646) org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:135) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:297) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:208) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:149) org.ofbiz.service.job.GenericServiceJob.exec(GenericServiceJob.java:69) org.ofbiz.service.job.JobInvoker.run(JobInvoker.java:240) java.lang.Thread.run(Thread.java:595) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (OFBIZ-2315) TransactionUtil : 3 Map corruptions related to mis synchronization
[ https://issues.apache.org/jira/browse/OFBIZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12700158#action_12700158 ] Philippe Mouawad commented on OFBIZ-2315: - Notice other synchronization problem on debugResMap. TransactionUtil : 3 Map corruptions related to mis synchronization -- Key: OFBIZ-2315 URL: https://issues.apache.org/jira/browse/OFBIZ-2315 Project: OFBiz Issue Type: Bug Affects Versions: Release Branch 4.0, SVN trunk Reporter: Philippe Mouawad Attachments: ContentionLog.txt, patch-TransactionUtil.patch Randomly we are having Thread contention problems in production related to synchronization issues in this class. See attached log file. As you can see, a lot of threads are locked by some code called by TransactionUtil.setTransactionBeginStack that has been running for 180165 ms : Thread[default-invoker-Thread-4582999,5,main]:4590333, stackTrace: javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.access$1200(Unknown Source) javolution.util.FastMap$3.run(Unknown Source) javax.realtime.MemoryArea.executeInArea(Unknown Source) javolution.util.FastMap.resizeTable(Unknown Source) javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.addEntry(Unknown Source) javolution.util.FastMap.put(Unknown Source) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:657) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:646) org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:135) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:297) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:208) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:149) org.ofbiz.service.job.GenericServiceJob.exec(GenericServiceJob.java:69) org.ofbiz.service.job.JobInvoker.run(JobInvoker.java:240) java.lang.Thread.run(Thread.java:595) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (OFBIZ-2315) TransactionUtil : 3 Map corruptions related to mis synchronization
[ https://issues.apache.org/jira/browse/OFBIZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12700357#action_12700357 ] David E. Jones commented on OFBIZ-2315: --- Thanks Phillippe, I'll take a look at this. TransactionUtil : 3 Map corruptions related to mis synchronization -- Key: OFBIZ-2315 URL: https://issues.apache.org/jira/browse/OFBIZ-2315 Project: OFBiz Issue Type: Bug Affects Versions: Release Branch 4.0, SVN trunk Reporter: Philippe Mouawad Attachments: ContentionLog.txt, patch-TransactionUtil.patch Randomly we are having Thread contention problems in production related to synchronization issues in this class. See attached log file. As you can see, a lot of threads are locked by some code called by TransactionUtil.setTransactionBeginStack that has been running for 180165 ms : Thread[default-invoker-Thread-4582999,5,main]:4590333, stackTrace: javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.access$1200(Unknown Source) javolution.util.FastMap$3.run(Unknown Source) javax.realtime.MemoryArea.executeInArea(Unknown Source) javolution.util.FastMap.resizeTable(Unknown Source) javolution.util.FastMap.mapEntry(Unknown Source) javolution.util.FastMap.addEntry(Unknown Source) javolution.util.FastMap.put(Unknown Source) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:657) org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:646) org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:135) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:297) org.ofbiz.service.ServiceDispatcher.runSync(ServiceDispatcher.java:208) org.ofbiz.service.GenericDispatcher.runSync(GenericDispatcher.java:149) org.ofbiz.service.job.GenericServiceJob.exec(GenericServiceJob.java:69) org.ofbiz.service.job.JobInvoker.run(JobInvoker.java:240) java.lang.Thread.run(Thread.java:595) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
