[JIRA] (JENKINS-58290) WebSocket / OkHttp thread leak from BourneShellScript + ContainerExecDecorator

[email protected] (JIRA) Thu, 01 Aug 2019 06:08:06 -0700

Title: Message Title

Hello,
fix for this issue causes one of our pipelines to stuck. Passing

 
                                                                -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true

parameter reverts to old behavior, so I blame running sh build step in subshell as a cause of this.

Pipeline code is:

 
                                                                pipeline {
    agent { label "xxxxxx" + (env.JOB_NAME.find(/-(u14|u16|u18|w7|w10)(?=-)/) ?:'') }
    
    options {
        timeout(time: 60, unit: 'MINUTES')
    }
        
    environment {
        TMP = "${env.WORKSPACE}/tmp"
        PROJECT_NAME = "${env.JOB_NAME}".find(/^[^-]+/)
        PROJECT_BRANCH = "${env.JOB_NAME}".find(/(?<=^[^-]+-)[^-]+/)
        PROJECT_RELEASE = "${env.PROJECT_BRANCH}".replace('MAIN', '9999rc')
        P4_BRANCH = "REL/${env.PROJECT_BRANCH}".replace('REL/MAIN', 'MAIN')
    }
    
    parameters {
        string(name: 'change', defaultValue: '', description: 'Changelist to build.', trim: true)
        string(name: 'status', defaultValue: '', description: 'Changelist status (shelved/submitted).', trim: true)
        string(name: 'review', defaultValue: '', description: 'Helix Swarm review number.', trim: true)
        string(name: 'pass', defaultValue: '', description: 'Success callback URL.', trim: true)
        string(name: 'fail', defaultValue: '', description: 'Failure callback URL.', trim: true)
    }
    
    triggers {
        pollSCM('@midnight')
    }
    
    stages {
        stage('sync') {
            steps {
                p4sync(
                    credential: 'xxxxx',
                    format: 'xxxx.xxxx-${NODE_NAME}-${JOB_NAME}-${EXECUTOR_NUMBER}_ws',
                    populate: forceClean(),
                    source: depotSource("//path/${env.P4_BRANCH}/...")
                )
        
                buildName "${env.P4_CHANGELIST} ${params.status?:''} ${params.change?:''}".trim()
                sh '''sed 's/\\\$Change: [0-9]\\+ \\\$/\$Change: '$P4_CHANGELIST' \$/' -i xxxxx/version.py'''
                    
                script {
                    def dot = env.PROJECT_RELEASE.find(/rc$/) ? '' : '.'
                    env.PACKAGE_NAME = "${env.PROJECT_NAME}-${env.PROJECT_RELEASE}${dot}${env.P4_CHANGELIST}.tar.gz"
                }
                echo "PROJECT_NAME = $PROJECT_NAME"
                echo "PROJECT_BRANCH = $PROJECT_BRANCH"
                echo "PROJECT_RELEASE = $PROJECT_RELEASE"
                echo "P4_BRANCH = $P4_BRANCH"
                echo "PACKAGE_NAME = $PACKAGE_NAME"
            }
        }
        stage('build') {
            steps { 
                sh '''
                #!/bin/bash -xe
        
                # Clean up possible orphans from other test sessions
                pkill -P1 -U $(id -u)  || true
                
                mkdir $TMP
                
                virtualenv venv
                . venv/bin/activate
                
                python setup.py sdist
                pip install dist/${PROJECT_NAME}-${PROJECT_RELEASE}*.tar.gz
                imgee master --print-requirements | xargs pip install
                pip install -r tests/test_requirements.txt
                '''
            }
        }
        stage('test') { 
            steps { 
                sh '''
                    . venv/bin/activate
                    pytest -n 4 \
                      --timeout=300 \
                      --junit-xml ${WORKSPACE}/testresults.xml \
                      --verbose \
                      --cov=${PROJECT_NAME} \
                      --cov-branch \
                      --cov-report xml:${WORKSPACE}/coverage.xml \
                      --replay-record-dir=testreplay \
                      tests || true
                '''
                junit 'testresults.xml'
                cobertura coberturaReportFile: 'coverage.xml'
            }
        }
    }
}
 
                                                            

It never gets to "test" stage, seems that "sh" step in "build" stage never ends.

Add Comment

--
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.200355.1562021560000.5401.1564664880271%40Atlassian.JIRA.

[JIRA] (JENKINS-58290) WebSocket / OkHttp thread leak from BourneShellScript + ContainerExecDecorator

Reply via email to