[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Upgrade the two plugins together. Git plugin 3.x might work with git client plugin 3.0.0, but you'll be the first (and possibly only) person to test that configuration. It is intended that git plugin 4.0.0 and git client plugin 3.0.0 upgrade together. It is much better to travel with large groups of people in this case. Large groups of people have tested git client plugin 3.0.0 with git plugin 4.0.0. I'm not aware of anyone that has tested git client plugin 3.0.0 with git plugin 3.x releases. Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.186841.1511861183000.729.1573736761868%40Atlassian.JIRA.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title ASHOK MOHANTY commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Can I only upgrade git-client plugin to v3.0.0 (right now we have git plugin v3.9.1) !? OR we should upgrade git client plugin 3.0.0 and git plugin 4.0.0 together !! Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.186841.1511861183000.727.1573736221135%40Atlassian.JIRA.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite updated JENKINS-48258 Released with git client plugin 3.0.0 and git plugin 4.0.0 on Nov 2, 2019. Jenkins / JENKINS-48258 git client plugin occasionally fails with "text file busy" error Change By: Mark Waite Status: Fixed but Unreleased Closed Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.186841.1511861183000.7453.1572696427668%40Atlassian.JIRA.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite edited a comment on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error [~sebawo] when I've resolved the blocking bugs that are identified in the [git client plugin 3.0 milestone| https://github.com/jenkinsci/ git - client - plugin 3.0 / milestone /1 ] and in the [git plugin 4.0 milestone|https://github.com/jenkinsci/git-plugin/milestone/3]. You're welcome to help test the beta versions and report your results of testing the beta versions. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.186841.1511861183000.19804.1557235441260%40Atlassian.JIRA. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Sebastian Wojas when I've resolved the blocking bugs that are identified in the [git client plugin 3.0 milestone|git client plugin 3.0 milestone] and in the git plugin 4.0 milestone. You're welcome to help test the beta versions and report your results of testing the beta versions. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.186841.1511861183000.19802.1557235441237%40Atlassian.JIRA. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Sebastian Wojas edited a comment on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error [~markewaite] when you're planning to release fixed version (3.0, not beta) of git-plugin ? Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.186841.1511861183000.19752.1557232740505%40Atlassian.JIRA. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Sebastian Wojas commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite when you're planning to release fixed version of git-plugin ? Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.186841.1511861183000.19729.1557232620396%40Atlassian.JIRA. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title phgr100x phgr100x updated an issue Jenkins / JENKINS-48258 git client plugin occasionally fails with "text file busy" error Change By: phgr100x phgr100x Comment: This is probably caused by https://bugs.openjdk.java.net/browse/JDK-8068370 Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title phgr100x phgr100x commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error This is probably caused by https://bugs.openjdk.java.net/browse/JDK-8068370 Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Pavel Novak commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error joe ferr Yes, I can confirm that, once we upgraded to the latest ( git plugin to 4.0.0-rc and git client plugin to 3.0.0-rc), git operations were not working correctly. Downgrade to 3.9.1 and 2.7.2 solved the issue, but it seems (of course) busy file persist. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title joe ferr commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite After installing beta4 our gitlab integration from jenkins to gitlab stopped working. There seem to be lots of reported issues w. the gitlab plugin so I'm not sure what broke it (e.g may be unrelated to your stuff)...here's a ticket that we found https://github.com/jenkinsci/gitlab-plugin/issues/893. We have hundreds of pipeline jobs that use this and they all stopped reporting pipeline status back to gitlab. I turned on logging for the gitlab plugin and I'm seeing this. If you do think it's related to your changes let me know if I can do any testing for you to help troubleshoot. Build does not contain build data. Feb 05, 2019 9:46:44 AM INFO com.dabsquared.gitlabjenkins.util.CommitStatusUpdater retrieveGitlabProjectIds Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Thanks very much joe ferr! Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title joe ferr commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Way above in this thread I mentioned that I compiled/deployed from the Pull Request and it fixed the issue. We have a large number of parallel gitlab activity going on in this jenkins instancelots of pipeline builds to support many microservices and most jobs retrieve from multiple git repos. Just wanted to let you know that someone "upgraded" our instance to the latest released version and as-expected the problem came back. I installed the latest beta (4) a few days back and everything is great againjust another confirmation real-world that the fix works fine. Thanks, Joe Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Pavel Novak edited a comment on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error [~markewaite] Hello, Mark, I apologize but I can't afford to install beta version.Anyway thanks for the feedback about the update.I noticed it looks like solution was found, good job. From my experience, I did not found any relation between environment, we are running on RHEL and tried with jenkins LTS 2.107.3 and 2.150.2, issue occurs on both machines, randomly and not so frequently. I am guessing if its not having eg. some relation to the credentials which are being used, but I am not sure (eg. stored on the global level and then being used in parallel) Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Pavel Novak commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite Hello, Mark, I apologize but I can't afford to install beta version. Anyway thanks for the feedback about the update. I noticed it looks like solution was found, good job. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Thanks Christopher Unkel! Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Christopher Unkel commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error FYI, I've been running a snapshot build of beta2 + this fix for nearly 8 months. Prior to this fix I encountered the bug several times a week. It has not happened a single time since installing the snapshot version. It has completely resolved the issue for me. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite edited a comment on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error [~pavenova] I provided the status update in a [preceding comment|https://issues.jenkins-ci.org/browse/JENKINS-48258?focusedCommentId=341685=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-341685]. That status report is still correct. The change that is intended to fix this problem is included in the current git client plugin 3.0.0 beta releases.I can't duplicate the problem and have never been able to duplicate the problem.Could you please provide a status report of your experiences using the git client plugin 3.0.0 beta release and the git plugin 4.0.0 beta release?If you haven't installed the beta release of the plugin, when can I expect that you will install the beta release of the plugin?How long will you run the beta release in your environment to assure that the issue is resolved?While I'm happy to hear that you're interested in the fix, I'm much more interested in test results from users that can duplicate the problem. The fix that has been included in the beta release for multiple months. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Pavel Novak I provided the status update in a preceding comment. That status report is still correct. The change that is intended to fix this problem is included in the current git client plugin 3.0.0 beta releases. I can't duplicate the problem and have never been able to duplicate the problem. Could you please provide a status report of your experiences using the git client plugin 3.0.0 beta release and the git plugin 4.0.0 beta release? If you haven't installed the beta release of the plugin, when can I expect that you will install the beta release of the plugin? How long will you run the beta release in your environment to assure that the issue is resolved? While I'm happy to hear that you're interested in the fix, I'm much more interested in test results from users that can duplicate the problem. The fix that has been included in the beta release for multiple months. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Pavel Novak commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Hi, I noticed this issue still occurs, mostly randomly, not so frequently. Anyway, can you provide some status update? Is there a fix in plan? If, then when we can expect fix? Thanks in advance. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error I've created a git client plugin 3.0 milestone and a git plugin 4.0 milestone in GitHub to show the pull requests that I intend to evaluate before release. I've set the due date for those milestones as Feb 28, 2019, in hopes that provides enough time to evaluate those pull requests, thoroughly. I intend to release another beta of the plugins within the next few days. Please help by testing the beta when it is released. Report your test results either in bug reports like this one or on the pull requests that were the focus of your testing. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title ASHOK MOHANTY edited a comment on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Any idea when plan for GA Date ( V.3.x will be released available) !! Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title ASHOK MOHANTY commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Any idea when V.3.x will be released !! Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite updated JENKINS-48258 Jenkins / JENKINS-48258 git client plugin occasionally fails with "text file busy" error Change By: Mark Waite Status: Reopened Fixed but Unreleased Resolution: Fixed Add Comment This message was sent by Atlassian JIRA (v7.10.1#710002-sha1:6efc396) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title joe ferr commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite I built/installed your PR code into two of our jenkins instances last week as a "does this break anything test". Those instances get a lot of use but probably not enough parallel clones for us to have seen this issue. Yesterday I installed into the instance where we saw the problem and so far so good. I'll let you know if anything changes but it appears so far to have fixed the issue from our testing. Thanks, Joe Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title SCM/JIRA link daemon commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Code changed in jenkins User: Mark Waite Path: src/main/java/org/jenkinsci/plugins/gitclient/CliGitAPIImpl.java http://jenkins-ci.org/commit/git-client-plugin/315ad4e689897dedb20c900b8f32f1ce607fb32c Log: Merge pull request #313 from presPetkov/JENKINS-48258-busy-ssh-text-file Jenkins 48258 busy ssh text file fix Compare: https://github.com/jenkinsci/git-client-plugin/compare/98eea34dc4e2...315ad4e68989 *NOTE:* This service been marked for deprecation: https://developer.github.com/changes/2018-04-25-github-services-deprecation/ Functionality will be removed from GitHub.com on January 31st, 2019. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title SCM/JIRA link daemon commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Code changed in jenkins User: presPetkov Path: src/main/java/org/jenkinsci/plugins/gitclient/CliGitAPIImpl.java http://jenkins-ci.org/commit/git-client-plugin/1199beea0743e60e09c987b1306cc0a8fdfb6879 Log: Jenkins 48258 ssh text file busy (#2) JENKINS-48258 Use a copy of ssh file Corrected exception handling as per bug report Fixed error Fixed error Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title joe ferr commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite perfect, will do. I'll let you know the outcome. Thanks Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error joe ferr please download the pull request build and install it in your environment. If it resolves the problem, please note that in the pull request or in this thread. I can't duplicate the problem. I'm relying on users to report their success with the proposed change. Evaluating a pull request by running it in your environment is a great way to be a contributor without compiling anything and with an easy way to "fall back" to the previous version if the pull request build doesn't meet your needs. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title joe ferr commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Apologies if this is the wrong place for this. I'm an end user, not a contributor. Seems like the PR has been ready for quite some time. This issue is actually huge for us. We have a Jenkins based kubernetes continuous delivery system (homegrown, I grew it!) that uses the multi-scm plugin and uses around 5 git repos per environment. We deploy to 8 envs for our production deploy so we are getting 40+ repos w. every deploy with up to 30 deploys a dayso this impacts us at least once a day, more often multiple times a day. Any status updates on this? At my company this is getting very high visibility Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Christopher Unkel commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Yup–that's it. Other discussion aside, I like the fix in PR313. It's a bit ugly to have to execute 'cp', but I think it will solve the problem completely and do so with a fix local to the git client. As far as the stack overflow article, I'm not sure either, but I have at least two theories: There's more than one JVM in the world: maybe openjdk doesn't set FD_CLOEXEC but other JVMs do. Even with FD_CLOEXEC there's still a short race window between fork() in the parent and the exec() in the child. On Linux this can be solved by using vfork() instead of fork(), but the POSIX semantics don't guarantee such. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Christopher Unkel commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite: this bug cannot be understood by thinking about the behavior of one git client thread in isolation. The straight-line code in the git client is correct and it does always close the unique temporary file before the call to command-line git. The problem is that there are other threads in the JVM and they may also run commands and make subprocesses. The mechanics of making subprocesses creates duplicates of open files. It is one of the duplicates that is open, not the version opened by the git client code. To be more explicit, imagine that I have two build jobs running: job 1 needs to do a git checkout, and job 2 needs to run make. Say that Jenkins is running as process ID 1000, thread 1 is running the git checkout, and thread 2 is running the make. Here's a thread/process execution interleaving in which the bug manifests: Process 1000, thread 1: open ssh123456.sh for writing, file descriptor 4 Process 1000, thread 2: fork in preparation to run make, creating process 1001. Inherits file descriptor 4 open for writing to ssh123456.sh. Process 1001: exec() make. Process 1000, thread 1: write contents of ssh123456.sh. Process 1000, thread 1: close ssh123456.sh. Process 1000 no longer has ssh123456.sh open for writing. However, this does not close file descriptor 4 in process 1001 (running make), hence ssh123456.sh is still open somewhere on the system for writing. Process 1000, thread 1: fork() in preparation to run git, creating process 1002. Process 1002: exec() git. Process 1002: fork in preparation to run SSH_AGENT script, creating process 1003. Process 1003: exec() ssh123456.sh --> ETXTBSY. ssh123456.sh is open for writing as file descriptor 4 in process 1001 (make). So the script file is not open in the Jenkins process, but nonetheless it is open somewhere on the system, hence ETXTBSY. And the fact that some other totally unrelated code can make a copy of the file descriptor and mess things up is why it's a Java runtime bug. A combination of vfork() and the close-on-exec flag would ensure that the file descriptor 4 in process 1001 in step 3, thus closing the copy. That's what's being contemplated as the fix in the JVM. One workaround is what's in PR313: copy the script using cp, which doesn't create children, so can't have stranded an open file descriptor to its destination. Another is what I proposed, which is to use a lock to ensure that steps 2 and 3 above cannot happen between steps 1 and 5.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite edited a comment on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error [~dscunkel] each invocation of command line git which needs a credentials file is allocated a unique temporary file by a call to Files.createTempFile(). The process which will consume that unique temporary file is not forked until after the JVM has been told to close the unique temporary file. I'm sure I must be missing something, but the sequence of calls tries very, very hard to assure that the unique temporary file is closed before the call to command line git.I think you're suggesting that the fork of a potentially unrelated process is holding file descriptors open which were opened by the git client plugin. If that's the case, then it will need someone with much better threading skills than mine to propose a change to the Jenkins core which does not damage process fork performance and still resolves this case. A [stackoverflow article|https://stackoverflow.com/questions/8997643/launch-a-child-process-from-java-that-doesnt-inherit-files-ports-on-unix] claims that Java on Unix sets the FD_CLOEXEC flag when it execs a process. I still don't have an explanation of the problem, just observations that seem to contradict the rational reasons this problem happens. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite edited a comment on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error [~dscunkel] each invocation of command line git which needs a credentials file is allocated a unique temporary file by a call to Files.createTempFile(). The process which will consume that unique temporary file is not forked until after the JVM has been told to close the unique temporary file. I'm sure I must be missing something, but the sequence of calls tries very, very hard to assure that the unique temporary file is closed before the call to command line git. I think you're suggesting that the fork of a potentially unrelated process is holding file descriptors open which were opened by the git client plugin. If that's the case, then it will need someone with much better threading skills than mine to propose a change to the Jenkins core which does not damage process fork performance and still resolves this case. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Christopher Unkel each invocation of command line git which needs a credentials file is allocated a unique temporary file by a call to Files.createTempFile(). The process which will consume that unique temporary file is not forked until after the JVM has been told to close the unique temporary file. I'm sure I must be missing something, but the sequence of calls tries very, very hard to assure that the unique temporary file is closed before the call to command line git. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Christopher Unkel commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite: "thread 2" in the above could be any other thread in the Java virtual machine. From a Java language point of view, the PrintWriter object and the underlying FileOutputStream would seem to be local to the thread that is executing createUnixGitSSH() and subsequently asks for the git CLI process to be launched. However, on a Unix JVM implementation, underlying the FileOutputStream is an open file descriptor to the script. File descriptors always have process scope. They are not thread local. So when I see the bug I'm guessing that thread 2 is a different thread launching a shell build step from some unrelated job. On Unix Runtime.exec() is implemented with a fork(), producing a child process, followed by an exec() in the child process. The child process inherits all open file descriptors. If badly timed, this includes the open file descriptor for the SSH script, and that's how the script file is still open: it's open in a child process totally unrelated to what the git client plugin code is doing. By the time the git client code runs git, the script is closed in the Jenkins process itself. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Christopher Unkel as far as I understand the git client plugin code, the temporary file is opened, written, and closed in the same thread that runs the command line git process. As far as I can tell, there is only a single thread which creates the script and then runs command line git in a subprocess. I can't explain why the temporary file is occasionally still open when the script is executed by command line git. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Christopher Unkel commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mark Waite: as I understand the issue as described in JDK-8068370, the issue isn't that the file descriptor for the fix isn't closed, but rather that the open file descriptor is inherited into a child process forked by another thread, so there's a race between writing the GIT_SSH file contents and launching processes: In thread 1: open GIT_SSH script file for writing. In thread 2: fork process; child inherits open file descriptor of GIT_SSH file. In thread 1: close GIT_SSH file. In thread 1: fork thread to run git. GIT_SSH file is still open in previous child, so ETXTBSY results. So if a lock can preclude step 2 from happening between step 1 and step 3, the race would be fixed That said, PR313 has a more local fix and would seem preferable if it works. I see this issue, but only intermittently, so it will probably take a month of testing to be confident the PR is a solution. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Christopher Unkel the git client plugin already asks the Java libraries to close the script before the process which will reference it is forked. Unfortunately, a bug in the Java libraries causes that request to close the file to sometimes be ignored. Refer to the earlier comment from Tomasz Śniatowski for more details. Refer to PR313 for the work-around as a pull request. Since I have never seen the problem, I can't reliably test that the patch fixes the problem. If you've seen the problerm, please download the pull request build, test it, and report your results on that pull request. Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Christopher Unkel commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error It seems like it should be possible to eliminate the race with the use of a lock to prevent processes from being forked while the GIT_SSH target script is open for writing. Roughly: In hudson.Launcher, add a static ReadWriteLock field using a ReentrantReadWriteLock. Hold the read lock in hudson.Launcher.ProcStarter.start() when calling launch(). Also hold the read lock in the various deprecated final hudson.Launcher.launch() overloads. Expose the (write) lock publicly for use in preventing launching. When writing files that will be executed, hold the write lock from when that file is created to when it is closed. Specifically, hold the lock for the lifetime of the PrintWriter in each of org.jenkinsci.plugins.gitclient.CliGitApiImpl.createUnixSshAskpass(), .createUnixStandardAskpass(), and .createUnixGitSSH(). Does this seem like a viable approach? Worth developing a patch? Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title
Tomasz Śniatowski commented on JENKINS-48258
Re: git client plugin occasionally fails with "text file busy" error
We haven't seen the error since we implemented the local workaround, so that's over a month now. It looks like it has definitely helped. Unfortunately it's a shell wrapper and not really a usable patch:
$ which git
/usr/local/bin/git
$ cat /usr/local/bin/git
#!/bin/sh
# Wrapper to avoid "fatal: cannot exec '/tmp/aa': Text file busy" errors when
# git is called with GIT_SSH pointing to something that's still open for writing
# (see https://issues.jenkins-ci.org/browse/JENKINS-48258)
GIT_SSH_COPY=
if [ -n "$GIT_SSH" ]; then
GIT_SSH_COPY="$(mktemp "${GIT_SSH}.X")"
cp -a "$GIT_SSH" "$GIT_SSH_COPY"
GIT_SSH="$GIT_SSH_COPY"
fi
/usr/bin/git "$@"
RET=$?
if [ -n "$GIT_SSH_COPY" ]; then
rm -f "$GIT_SSH_COPY"
fi
exit $RET
I'm not quite sure how to solve this purely in Java in the git plugin code, as my tests indicate merely creating the file on the Java side introduces a race condition that can make this issue come back. A quick hacky workaround could make this go from a 0.1% issue to a 0.001% but still something that will occasionally break. Likely a more substantial change of approach on Linux is needed, to avoid the "write file then make GIT_SSH point to it" pattern altogether.
Add Comment
This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title Mark Waite commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Mostyn Bramley-Moore what were the results of your tests with the change from Tomasz Śniatowski? Is Tomasz Śniatowski interested in submitting a pull request that could be used by others? Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title SCM/JIRA link daemon commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Code changed in jenkins User: Mostyn Bramley-Moore Path: src/main/java/org/jenkinsci/plugins/gitclient/CliGitAPIImpl.java http://jenkins-ci.org/commit/git-client-plugin/d4e55360e2dd5f41bc556d7c181ecc29e4258109 Log: JENKINS-48258 add distinctive temp file prefix to aid debugging Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-48258) git client plugin occasionally fails with "text file busy" error
Title: Message Title SCM/JIRA link daemon commented on JENKINS-48258 Re: git client plugin occasionally fails with "text file busy" error Code changed in jenkins User: Mark Waite Path: src/main/java/org/jenkinsci/plugins/gitclient/CliGitAPIImpl.java http://jenkins-ci.org/commit/git-client-plugin/4241e818dbe27fb78093094f29ebcd2203166610 Log: Merge pull request #293 from mostynb/text_file_busy_debugging JENKINS-48258 add distinctive temp file prefix to aid debugging Compare: https://github.com/jenkinsci/git-client-plugin/compare/1bfc00f0d56a...4241e818dbe2 Add Comment This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
