[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Tom FENNELLY updated JENKINS-37921 Closing it as the work here is being looked at under JENKINS-38252 Jenkins / JENKINS-37921 SSE failures and deadlocking with github auth plugin installed (needs investigation) Change By: Tom FENNELLY Status: In Review Resolved Resolution: Duplicate Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Tom FENNELLY updated JENKINS-37921 Jenkins / JENKINS-37921 SSE failures and deadlocking with github auth plugin installed (needs investigation) Change By: Tom FENNELLY Status: In Progress Review Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title James Dumay updated an issue Jenkins / JENKINS-37921 SSE failures and deadlocking with github auth plugin installed (needs investigation) Change By: James Dumay Sprint: 1.0-beta-1 , 1.0-b05/b-06 Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Tom FENNELLY started work on JENKINS-37921 Change By: Tom FENNELLY Status: Open In Progress Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Michael Neale edited a comment on JENKINS-37921 Re: SSE failures and deadlocking with github auth plugin installed (needs investigation) [~tfennelly] I think this is worth investigating, including james proposed fixes (alarming for a product manager to pick up concurrent code but here we are !). This hasn't been seen "in the wild" but myself and Ivan can reliably reproduce this. I took a thread dump to see what was locking things up. Currently only impacting when github oauth plugin is installed (and only in some cases) but it may highlight some underlying issue that may bite hard. Its only marked as important as this does stop you from accessing classic for a while (it does seem to get unblocked eventually). If this isn't as serious as it looks, can bump down the priority. Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Michael Neale updated an issue Jenkins / JENKINS-37921 SSE failures and deadlocking with github auth plugin installed (needs investigation) Change By: Michael Neale Sprint: 1.0-beta- 2 1 Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title
Michael Neale updated an issue
Jenkins / JENKINS-37921
SSE failures and deadlocking with github auth plugin installed (needs investigation)
Change By:
Michael Neale
When running blue ocean with github auth enabled, SSE events often don't arrive when running in mvn hpi:run mode. Jenkins can "lock up" (all web threads busy) and blocking SSE threads were noted in a thread dump.This hasn't been observed running in the wild (eg on dogfood), but is worth investigation as it is a bit of a DOS problem if it is "real". To reproduce: run blueocean via mvn hpi:runSetup brand new workspaceInstall github authorization plugin https://wiki.jenkins-ci.org/display/JENKINS/GitHub+OAuth+PluginFollow its instructions for setting up an app and callbackCreate a pipeline (simple one will do, anything really, a few shell steps)Run the pipeline a few times from blue ocean - notice SSE events will not arriveKeep clicking around. (see video link above for what I do to see this). When the dashboard looks "broken" or it stops responding, try to go to the classic UI and you will see it is waiting on a socket. It is at this point I took a thread dump. Thread dump that showed blocking SSE threads: {noformat}"Handling POST /jenkins/sse-gateway/configure from 0:0:0:0:0:0:0:1 : qtp1780682194-650" #650 prio=5 os_prio=31 tid=0x7fec9106a800 nid=0xac4b waiting for monitor entry [0x73dcd000] java.lang.Thread.State: BLOCKED (on object monitor) at org.jenkinsci.plugins.ssegateway.Endpoint.doConfigure(Endpoint.java:165) - waiting to lock <0x0007b5b05cd8> (a java.lang.String) at sun.reflect.GeneratedMethodAccessor211.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:324) at org.kohsuke.stapler.interceptor.RequirePOST$Processor.invoke(RequirePOST.java:52) at org.kohsuke.stapler.PreInvokeInterceptedFunction.invoke(PreInvokeInterceptedFunction.java:26) at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:167) at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:100) at org.kohsuke.stapler.MetaClass$1.doDispatch(MetaClass.java:124) at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58) at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876) at org.kohsuke.stapler.MetaClass$11.dispatch(MetaClass.java:380) at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:649) at org.kohsuke.stapler.Stapler.service(Stapler.java:238) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) at
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Michael Neale edited a comment on JENKINS-37921 Re: SSE failures and deadlocking with github auth plugin installed (needs investigation) [~tfennelly] I think this is worth investigating, including james proposed fixes (alarming for a product manager to pick up concurrent code but here we are !). This hasn't been seen "in the wild" but myself and Ivan can reliably reproduce this. I took a thread dump to see what was locking things up. Currently only impacting when github oauth plugin is installed (and only in some cases) but it may highlight some underlying issue that may bite hard. Its only marked as important as this does stop you from accessing classic for a while (it does seem to get unblocked eventually). Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Michael Neale updated an issue Jenkins / JENKINS-37921 SSE failures and deadlocking with github auth plugin installed (needs investigation) Change By: Michael Neale Sprint: 1.0-beta-2 Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Michael Neale assigned an issue to Tom FENNELLY Jenkins / JENKINS-37921 SSE failures and deadlocking with github auth plugin installed (needs investigation) Change By: Michael Neale Assignee: Tom FENNELLY Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-37921) SSE failures and deadlocking with github auth plugin installed (needs investigation)
Title: Message Title Michael Neale updated an issue Jenkins / JENKINS-37921 SSE failures and deadlocking with github auth plugin installed (needs investigation) Change By: Michael Neale Summary: SSE failures and deadlocking with github auth plugin installed (needs investigation) Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
