[JIRA] (JENKINS-58901) Log file

[email protected] (JIRA) Mon, 12 Aug 2019 13:12:31 -0700

Title: Message Title

C H created an issue

Issue Type:	Bug
Assignee:	Unassigned
Components:	core, pipeline
Created:	2019-08-12 20:11
Environment:	Jenkins 2.176.2 System Properties Name ↓ Value awt.toolkit sun.awt.X11.XToolkit executable-war /usr/share/jenkins/jenkins.war file.encoding UTF-8 file.encoding.pkg sun.io file.separator / java.awt.graphicsenv sun.awt.X11GraphicsEnvironment java.awt.headless true java.awt.printerjob sun.print.PSPrinterJob java.class.path /usr/share/jenkins/jenkins.war java.class.version 52.0 java.endorsed.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/endorsed java.ext.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/ext:/usr/java/packages/lib/ext java.home /usr/lib/jvm/java-8-openjdk-amd64/jre java.io.tmpdir /tmp java.library.path /usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib java.runtime.name OpenJDK Runtime Environment java.runtime.version 1.8.0_222-8u222-b10-1ubuntu1~18.04.1-b10 java.specification.name Java Platform API Specification java.specification.vendor Oracle Corporation java.specification.version 1.8 java.vendor Private Build java.vendor.url http://java.oracle.com/ java.vendor.url.bug http://bugreport.sun.com/bugreport/ java.version 1.8.0_222 java.vm.info mixed mode java.vm.name OpenJDK 64-Bit Server VM java.vm.specification.name Java Virtual Machine Specification java.vm.specification.vendor Oracle Corporation java.vm.specification.version 1.8 java.vm.vendor Private Build java.vm.version 25.222-b10 javax.accessibility.assistive_technologies org.GNOME.Accessibility.AtkWrapper jetty.git.hash eb70b240169fcf1abbd86af36482d1c49826fa0b jna.loaded true jna.platform.library.path /usr/lib/x86_64-linux-gnu:/lib/x86_64-linux-gnu:/lib64:/usr/lib:/lib:/usr/lib/x86_64-linux-gnu/libfakeroot jnidispatch.path /tmp/jna-3506402/jna4452657821541405680.tmp line.separator mail.smtp.sendpartial true mail.smtps.sendpartial true org.apache.commons.jelly.tags.fmt.timeZone America/Los_Angeles os.arch amd64 os.name Linux os.version 4.15.0-1044-aws path.separator : sun.arch.data.model 64 sun.boot.class.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/classes sun.boot.library.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64 sun.cpu.endian little sun.cpu.isalist sun.font.fontmanager sun.awt.X11FontManager sun.io.unicode.encoding UnicodeLittle sun.java.command /usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war --httpPort=8080 sun.java.launcher SUN_STANDARD sun.jnu.encoding UTF-8 sun.management.compiler HotSpot 64-Bit Tiered Compilers sun.os.patch.level unknown svnkit.http.methods Digest,Basic,NTLM,Negotiate svnkit.ssh2.persistent false user.dir / user.home /root user.language en user.name root user.timezone Etc/UTC Environment Variables Name ↓ Value _ /usr/bin/daemon HOME /root JENKINS_HOME /var/lib/jenkins LANG C.UTF-8 LOGNAME root MAIL /var/mail/root PATH /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin PWD /root SHELL /bin/bash SHLVL 1 USER root XDG_DATA_DIRS /usr/local/share:/usr/share:/var/lib/snapd/desktop XDG_RUNTIME_DIR /run/user/0 XDG_SESSION_ID c1 Plugins Name ↓ Version Enabled ace-editor 1.1 true ansicolor 0.6.2 true ant 1.9 true antisamy-markup-formatter 1.5 true apache-httpcomponents-client-4-api 4.5.5-3.0 true authentication-tokens 1.3 true aws-credentials 1.27 true aws-java-sdk 1.11.594 true blueocean 1.18.0 true blueocean-autofavorite 1.2.4 true blueocean-bitbucket-pipeline 1.18.0 true blueocean-commons 1.18.0 true blueocean-config 1.18.0 true blueocean-core-js 1.18.0 true blueocean-dashboard 1.18.0 true blueocean-display-url 2.3.0 true blueocean-events 1.18.0 true blueocean-git-pipeline 1.18.0 true blueocean-github-pipeline 1.18.0 true blueocean-i18n 1.18.0 true blueocean-jira 1.18.0 true blueocean-jwt 1.18.0 true blueocean-personalization 1.18.0 true blueocean-pipeline-api-impl 1.18.0 true blueocean-pipeline-editor 1.18.0 true blueocean-pipeline-scm-api 1.18.0 true blueocean-rest 1.18.0 true blueocean-rest-impl 1.18.0 true blueocean-web 1.18.0 true bouncycastle-api 2.17 true branch-api 2.5.4 true build-time-blame 1.2.0 true build-timeout 1.19 true cloudbees-bitbucket-branch-source 2.4.5 true cloudbees-folder 6.9 true collapsing-console-sections 1.7.0 true command-launcher 1.3 true credentials 2.2.1 true credentials-binding 1.19 true display-url-api 2.3.1 true docker-commons 1.15 true docker-workflow 1.18 true durable-task 1.30 true email-ext 2.66 true favorite 2.3.2 true git 3.11.0 true git-client 2.8.0 true git-server 1.7 true github 1.29.4 true github-api 1.95 true github-branch-source 2.5.5 true gitlab-plugin 1.5.12 true gradle 1.33 true handlebars 1.1.1 true handy-uri-templates-2-api 2.1.7-1.0 true htmlpublisher 1.18 true jackson2-api 2.9.9.1 true jdk-tool 1.3 true jenkins-design-language 1.18.0 true jira 3.0.8 true jquery 1.12.4-0 true jquery-detached 1.2.1 true jsch 0.1.55.1 true junit 1.28 true ldap 1.20 true lockable-resources 2.5 true mailer 1.24 true mapdb-api 1.0.9.0 true matrix-auth 2.4.2 true matrix-project 1.14 true mercurial 2.8 true momentjs 1.1.1 true pam-auth 1.5.1 true pipeline-aws 1.38 true pipeline-build-step 2.9 true pipeline-github-lib 1.0 true pipeline-graph-analysis 1.10 true pipeline-input-step 2.10 true pipeline-milestone-step 1.3.1 true pipeline-model-api 1.3.9 true pipeline-model-declarative-agent 1.1.1 true pipeline-model-definition 1.3.9 true pipeline-model-extensions 1.3.9 true pipeline-rest-api 2.11 true pipeline-stage-step 2.3 true pipeline-stage-tags-metadata 1.3.9 true pipeline-stage-view 2.11 true plain-credentials 1.5 true pubsub-light 1.12 true resource-disposer 0.13 true scm-api 2.6.3 true script-security 1.62 true slack 2.28 true sse-gateway 1.19 true ssh-credentials 1.17.1 true ssh-slaves 1.30.1 true structs 1.20 true subversion 2.12.2 true timestamper 1.10 true token-macro 2.8 true variant 1.3 true workflow-aggregator 2.6 true workflow-api 2.36 true workflow-basic-steps 2.18 true workflow-cps 2.73 true workflow-cps-global-lib 2.15 true workflow-durable-task-step 2.33 true workflow-job 2.33 true workflow-multibranch 2.21 true workflow-scm-step 2.9 true workflow-step-api 2.20 true workflow-support 3.3 true ws-cleanup 0.37 true
Priority:	Minor
Reporter:	C H

I've been developing a pipeline that uses serverless to deploy an AWS website backed with lambda functions. I started noticing that some expected log statements were absent from the console log. Upon looking at the physical log in /var/lib/jenkins/jobs/OurProjectPortal/branches/SomeBranchName/builds/155/log, I saw that part of the log had been overwritten with NUL bytes (0x00), and this corresponded with the missing log output in the console log. Sample:

 
                                                                vi /var/lib/jenkins/jobs/OurProjectPortal/branches/SomeBranchName/builds/155/log
========
[2019-08-12T19:35:23.994Z] + echo Installing 'serverless' and plugins:
[2019-08-12T19:35:23.994Z] Installing 'serverless' and plugins:
[2019-08-12T19:35:23.994Z] + [ -e node_modules.zip ]
[2019-08-12T19:35:23.994Z] + unzip node_modules.zip
[2019-08-12T19:35:45.805Z] ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@....
@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@+ echo This decrypts secrets.blah-blah.yml.encrypted, containing db credentials and cognito user pool
[2019-08-12T19:35:45.805Z] This decrypts secrets.blah-blah.yml.encrypted, containing db credentials and cognito user pool
[2019-08-12T19:35:45.805Z] + echo
 
                                                            

In previous situations where I've seen this, it's been caused by two processes writing to the same file using buffered I/O and no locking.

Here's the affected part of the Jenkinsfile:

 
                                                                sedhex=2f5b2e5d5b5e205c2f302d392e5d2a202f207b2020732f2e2a5c285b2e5d5b5e205c2f302d392e5d2a5c29202e2a2f5c312f3b2070207d 
sedprog=\$(echo \$sedhex | xxd -p -r)
echo "Installing 'serverless' and plugins:"
 if [ -e node_modules.zip ]; then
 unzip node_modules.zip > /dev/null 2>&1
 else
 npm install serverless serverless-python-requirements serverless-secrets-plugin serverless-plugin-git-variables
 fi
 echo ""
echo "Creating dummy secrets file:" > /dev/null
 (echo "a:"; echo " n: x") > secrets.blah-blah.yml
echo "Zipping up python functions and requirements:"
 echo "Count|Filename Extension"
 zip -r9 function.zip -x '*/requirements.txt' \
 \$(echo */requirements.txt | sed s,/requirements.txt,,g) \
 | sed -n "\$sedprog" \
 | sort | uniq -c | sort -nr
 echo ""
echo "Waiting for CloudFormation stack to be available:"
 while aws cloudformation list-stacks | jq -r '.StackSummaries[] | select(.StackName == "blah-blah") | .StackStatus' | tee /dev/stderr | grep _IN_PROGRESS; do
 date +"%F %T"
 sleep 30
 done
echo "This decrypts secrets.blah-blah.yml.encrypted, containing db credentials and cognito user pool"
 echo ""
 serverless decrypt --stage blah-blah --password 'blah-blah'
 echo ""
 
                                                            

Is it possible that the

 
                                                                tee /dev/stderr 
                                                            

is what's causing this?

Thanks!

Add Comment

--
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.201239.1565640713000.1397.1565640720117%40Atlassian.JIRA.

[JIRA] (JENKINS-58901) Log file

Reply via email to