[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title mark mann commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures i recently upgraded to Jenkins 1.651.1 (on windows) we make a lot of use of the parallel builds function... running 15 jobs in parallel. proportionately.. only a couple spit out this error... and can end up killing the entire job run. In the same parallel run, I can end up with different fault reasons among the jobs suggesting that dependent on the timing, a couple were competing with each other. eg: access denied, file already exists -- job@1 16:32:42 ln builds\lastStableBuild C:\.jenkins\jobs\X\lastStable failed 16:32:42 java.nio.file.AccessDeniedException: C:\.jenkins\jobs\X\lastStable 16:32:42 at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) 16:32:42 at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) 16:32:42 at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) 16:32:42 at sun.nio.fs.WindowsFileSystemProvider.implDelete(Unknown Source) 16:32:42 at sun.nio.fs.AbstractFileSystemProvider.deleteIfExists(Unknown Source) 16:32:42 at java.nio.file.Files.deleteIfExists(Unknown Source) 16:32:42 at sun.reflect.GeneratedMethodAccessor1458.invoke(Unknown Source) 16:32:42 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) 16:32:42 at java.lang.reflect.Method.invoke(Unknown Source) 16:32:42 at hudson.Util.createSymlinkJava7(Util.java:1233) 16:32:42 at hudson.Util.createSymlink(Util.java:1151) 16:32:42 at hudson.model.Run.createSymlink(Run.java:1840) 16:32:42 at hudson.model.Run.updateSymlinks(Run.java:1822) 16:32:42 at hudson.model.Run.execute(Run.java:1736) 16:32:42 at com.tikal.jenkins.plugins.multijob.MultiJobBuild.run(MultiJobBuild.java:73) 16:32:42 at hudson.model.ResourceController.execute(ResourceController.java:98) 16:32:42 at hudson.model.Executor.run(Executor.java:410) -- job@2 16:32:41 ln builds\lastSuccessfulBuild C:\.jenkins\jobs\\lastSuccessful failed 16:32:41 java.nio.file.FileAlreadyExistsException: C:\.jenkins\jobs\X\lastSuccessful 16:32:41 at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) 16:32:41 at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) 16:32:41 at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) 16:32:41 at sun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(Unknown Source) 16:32:41 at java.nio.file.Files.createSymbolicLink(Unknown Source) 16:32:41 at sun.reflect.GeneratedMethodAccessor1459.invoke(Unknown Source) 16:32:41 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) 16:32:41 at java.lang.reflect.Method.invoke(Unknown Source) 16:32:41 at hudson.Util.createSymlinkJava7(Util.java:1235) 16:32:41 at hudson.Util.createSymlink(Util.java:1151) 16:32:41 at hudson.model.Run.createSymlink(Run.java:1840) 16:32:41 at hudson.model.Run.updateSymlinks(Run.java:1821) 16:32:41 at hudson.model.Run.execute(Run.java:1736) 16:32:41 at com.tikal.jenkins.plugins.multijob.MultiJobBuild.run(MultiJobBuild.java:73) 16:32:41 at hudson.model.ResourceController.execute(ResourceController.java:98) 16:32:41 at hudson.model.Executor.run(Executor.java:410)
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Ali Sadik Kumlali commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures You seem to be right Kenneth. Thanks for the clarification. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Kenneth Baltrinic commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures Not sure if it is really the mutli-job plugin or just the ability to start the jobs really closely together. We are experiencing this and do no have the multi-job plugin installed. In stead we use the build-flow plugin. Our use case is that we kick of multiple jobs in parallel using the parallel command in the build-flow dsl. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Ali Sadik Kumlali commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures I figured out, in Windows, MultiJob Plug-in does not execute the jobs in parallel. In addition, the parallel job directories (e.g. myjob@1, myjob@2, ...) were not created. This behavior explains why I do not see the problem on Windows. In Linux, to confirm the problem is related with MultiJob Plug-in, I created a shell script to execute the job in parallel through Jenkins' Remote API: #!/bin/sh ( curl -X POST http://jenkins.mycompany.com/jenkins/job/myjob/build?delay=0sec --user jenkinsuser:jenkinspassword ) & ( curl -X POST http://jenkins.mycompany.com/jenkins/job/myjob/build?delay=0sec --user jenkinsuser:jenkinspassword ) & ( curl -X POST http://jenkins.mycompany.com/jenkins/job/myjob/build?delay=0sec --user jenkinsuser:jenkinspassword ) & wait echo "completed" The job executed in parallel and the problem did not happen. I confirmed that the parallel job directories were created successfully. Should we changed the issue's component to multijob-plugin? Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Ali Sadik Kumlali commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures It seems the problem only occurs when the job triggered by MultiJob Plug-in. The job can run parallel if I trigger it manually. The other thing is the problem does not occur on Windows. I can reproduce it in Linux. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Ali Sadik Kumlali commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures The problem still exists in 1.643 version. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Leo Gallucci commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures I can recreate, any updates on this? Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Adam Beben edited a comment on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures Thesameissueoccureswhentwobuildsstartsatthesametime(parallelbuilds)ondifferentJenkinsnodes.Platform:Windows(masterandnodes)Jenkins:ver.1.619BuildsruninparallelwithBuildFlowPlugin0.18 Inmycaseexceptionsoccursinoneoftwobuilds(firstorseconds,it'srandom)butbuildcontinuesnormally. lnbuilds\lastSuccessfulBuild[path_to_project_workspace]\lastSuccessfulfailedjava.nio.file.FileAlreadyExistsException:[path_to_project_workspace]\lastSuccessful atsun.nio.fs.WindowsException.translateToIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(UnknownSource) atjava.nio.file.Files.createSymbolicLink(UnknownSource) atsun.reflect.GeneratedMethodAccessor359.invoke(UnknownSource) atsun.reflect.DelegatingMethodAccessorImpl.invoke(UnknownSource) atjava.lang.reflect.Method.invoke(UnknownSource) athudson.Util.createSymlinkJava7(Util.java:1227) athudson.Util.createSymlink(Util.java:1143) athudson.model.Run.createSymlink(Run.java:1845) athudson.model.Run.updateSymlinks(Run.java:1826) athudson.model.Run.execute(Run.java:1739) athudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) athudson.model.ResourceController.execute(ResourceController.java:98) athudson.model.Executor.run(Executor.java:381)lnbuilds\lastStableBuild[path_to_project_workspace]\lastStablefailedjava.nio.file.FileAlreadyExistsException:[path_to_project_workspace]\lastStable atsun.nio.fs.WindowsException.translateToIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(UnknownSource) atjava.nio.file.Files.createSymbolicLink(UnknownSource) atsun.reflect.GeneratedMethodAccessor359.invoke(UnknownSource) atsun.reflect.DelegatingMethodAccessorImpl.invoke(UnknownSource) atjava.lang.reflect.Method.invoke(UnknownSource) athudson.Util.createSymlinkJava7(Util.java:1227) athudson.Util.createSymlink(Util.java:1143) athudson.model.Run.createSymlink(Run.java:1845) athudson.model.Run.updateSymlinks(Run.java:1827) athudson.model.Run.execute(Run.java:1739) athudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) athudson.model.ResourceController.execute(ResourceController.java:98) athudson.model.Executor.run(Executor.java:381) Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Adam Beben edited a comment on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures Thesameissueoccureswhentwobuildsstartsatthesametime(parallelbuilds)ondifferentJenkinsnodes.Platform:Windows(masterandnodes)Jenkins:ver.1.619BuildsruninparallelwithBuildFlowPlugin0.18Inmycaseexceptionsoccursinoneoftwobuilds(firstor seconds second ,it'srandom)butbuildcontinuesnormally.lnbuilds\lastSuccessfulBuild[path_to_project_workspace]\lastSuccessfulfailedjava.nio.file.FileAlreadyExistsException:[path_to_project_workspace]\lastSuccessful atsun.nio.fs.WindowsException.translateToIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(UnknownSource) atjava.nio.file.Files.createSymbolicLink(UnknownSource) atsun.reflect.GeneratedMethodAccessor359.invoke(UnknownSource) atsun.reflect.DelegatingMethodAccessorImpl.invoke(UnknownSource) atjava.lang.reflect.Method.invoke(UnknownSource) athudson.Util.createSymlinkJava7(Util.java:1227) athudson.Util.createSymlink(Util.java:1143) athudson.model.Run.createSymlink(Run.java:1845) athudson.model.Run.updateSymlinks(Run.java:1826) athudson.model.Run.execute(Run.java:1739) athudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) athudson.model.ResourceController.execute(ResourceController.java:98) athudson.model.Executor.run(Executor.java:381)lnbuilds\lastStableBuild[path_to_project_workspace]\lastStablefailedjava.nio.file.FileAlreadyExistsException:[path_to_project_workspace]\lastStable atsun.nio.fs.WindowsException.translateToIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsException.rethrowAsIOException(UnknownSource) atsun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(UnknownSource) atjava.nio.file.Files.createSymbolicLink(UnknownSource) atsun.reflect.GeneratedMethodAccessor359.invoke(UnknownSource) atsun.reflect.DelegatingMethodAccessorImpl.invoke(UnknownSource) atjava.lang.reflect.Method.invoke(UnknownSource) athudson.Util.createSymlinkJava7(Util.java:1227) athudson.Util.createSymlink(Util.java:1143) athudson.model.Run.createSymlink(Run.java:1845) athudson.model.Run.updateSymlinks(Run.java:1827) athudson.model.Run.execute(Run.java:1739) athudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) athudson.model.ResourceController.execute(ResourceController.java:98) athudson.model.Executor.run(Executor.java:381) Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Adam Beben commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures The same issue occures when two builds starts at the same time (parallel builds) on different Jenkins nodes. Platform: Windows (master and nodes) Jenkins: ver. 1.619 Builds run in parallel with Build Flow Plugin 0.18 ln builds\lastSuccessfulBuild [path_to_project_workspace]\lastSuccessful failed java.nio.file.FileAlreadyExistsException: [path_to_project_workspace]\lastSuccessful at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at sun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(Unknown Source) at java.nio.file.Files.createSymbolicLink(Unknown Source) at sun.reflect.GeneratedMethodAccessor359.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at hudson.Util.createSymlinkJava7(Util.java:1227) at hudson.Util.createSymlink(Util.java:1143) at hudson.model.Run.createSymlink(Run.java:1845) at hudson.model.Run.updateSymlinks(Run.java:1826) at hudson.model.Run.execute(Run.java:1739) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:381) ln builds\lastStableBuild [path_to_project_workspace]\lastStable failed java.nio.file.FileAlreadyExistsException: [path_to_project_workspace]\lastStable at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at sun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(Unknown Source) at java.nio.file.Files.createSymbolicLink(Unknown Source) at sun.reflect.GeneratedMethodAccessor359.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at hudson.Util.createSymlinkJava7(Util.java:1227) at hudson.Util.createSymlink(Util.java:1143) at hudson.model.Run.createSymlink(Run.java:1845) at hudson.model.Run.updateSymlinks(Run.java:1827) at hudson.model.Run.execute(Run.java:1739) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:381) Add Comment
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Title: Message Title Angelo Perera commented on JENKINS-25930 Re: Race condition creating build links during concurrent builds causes build failures We have a very large distributed Jenkins CI undertaking at the moment and our first few tests always fail due to this error. TraderPlus.UI.Test #4641 completed : FAILURE TraderPlus.UI.Test #4646 completed : FAILURE Build TraderPlus.UI.Test #4655 started Build TraderPlus.UI.Test #4654 started TraderPlus.UI.Test #4645 completed : FAILURE Build TraderPlus.UI.Test #4656 started TraderPlus.UI.Test #4648 completed : FAILURE Build TraderPlus.UI.Test #4657 started TraderPlus.UI.Test #4639 completed : FAILURE Build TraderPlus.UI.Test #4658 started TraderPlus.UI.Test #4642 completed : FAILURE Build TraderPlus.UI.Test #4659 started TraderPlus.UI.Test #4647 completed Build TraderPlus.UI.Test #4660 started TraderPlus.UI.Test #4644 completed Build TraderPlus.UI.Test #4661 started (Rest of the tests pass) Failure details: ln builds\lastSuccessfulBuild C:\Users\Administrator\.jenkins\jobs\TraderPlus.UI.Test\lastSuccessful failed java.nio.file.FileAlreadyExistsException: C:\Users\Administrator\.jenkins\jobs\TraderPlus.UI.Test\lastSuccessful at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at sun.nio.fs.WindowsFileSystemProvider.createSymbolicLink(Unknown Source) at java.nio.file.Files.createSymbolicLink(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at hudson.Util.createSymlinkJava7(Util.java:1227) at hudson.Util.createSymlink(Util.java:1143) at hudson.model.Run.createSymlink(Run.java:1848) at hudson.model.Run.updateSymlinks(Run.java:1829) at hudson.model.Run.execute(Run.java:1742) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:374) [EnvInject] - Loading node environment variables. Building remotely on au03-devcivm4 (UITest) in workspace D:\Jenkins\workspace\TraderPlus.UI.Test Running Jenkins ver. 1.616 Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Josh Landin commented on JENKINS-25930 Race condition creating build links during concurrent builds causes build failures This issue is still present in Jenkins 1.604 for the creation of both lastSuccessful and lastStable symlinks. This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators. For more information on JIRA, see: http://www.atlassian.com/software/jira -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Daniel Beck commented on JENKINS-25930 Race condition creating build links during concurrent builds causes build failures Unsurprising, given it's still open and nobody worked on it. This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators. For more information on JIRA, see: http://www.atlassian.com/software/jira -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-25930) Race condition creating build links during concurrent builds causes build failures
Craig Phillips created JENKINS-25930 Race condition creating build links during concurrent builds causes build failures Issue Type: Bug Assignee: Unassigned Components: core Created: 05/Dec/14 10:20 AM Description: I have a job defined to run across approximately 60 build nodes concurrently. If any two of those jobs complete at exactly the same time, one build will fail during link creation, because the links aren't being created atomically: ln builds/lastStableBuild /jk/jobs/install-system-files-slave/lastStable failed java.nio.file.FileAlreadyExistsException: /jk/jobs/install-system-files-slave/lastStable at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.createSymbolicLink(UnixFileSystemProvider.java:456) at java.nio.file.Files.createSymbolicLink(Files.java:996) at sun.reflect.GeneratedMethodAccessor5497.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at hudson.Util.createSymlinkJava7(Util.java:1202) at hudson.Util.createSymlink(Util.java:1118) at hudson.model.Run.createSymlink(Run.java:1865) at hudson.model.Run.updateSymlinks(Run.java:1847) at hudson.model.Run.execute(Run.java:1757) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:89) at hudson.model.Executor.run(Executor.java:240) Building remotely on d-rg-mt-adm (pack) in workspace /jk/workspace/install-system-files-slave Project: Jenkins Priority: Major Reporter: Craig Phillips This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators. For more information on JIRA, see: http://www.atlassian.com/software/jira -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
