Mahesh, Please see attached.
Warm regards, Pankaj On Tuesday, June 27, 2017 at 6:13:19 PM UTC+5:30, Mahesh Panchaksharaiah wrote: > > Can you provide the raw output of logs with any sensitive information > masked. > > Thanks, > Mahesh > > On Tuesday, June 27, 2017 at 4:51:06 PM UTC+5:30, Pankaj Lal wrote: >> >> I just upgraded to 17.5 yesterday. I am seeing this very funny behaviour. >> All the tasks in a job are executing in a loop. They are supposed to >> execute only once. Why is this happening. >> >> See the attached image. You would notice the same things multiple times. >> >> >> <https://lh3.googleusercontent.com/-29RjqdeXKfg/WVI_j6Va4GI/AAAAAAAAALA/ktNQOLoop7AQ33pytaz0ao4zu6BWCllWQCLcBGAs/s1600/Screenshot%2Bfrom%2B2017-06-27%2B16-47-28.png> >> >> - Pankaj >> > -- You received this message because you are subscribed to the Google Groups "go-cd" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
##|16:09:51.177 [go] Job Started: 2017-06-27 16:09:51 IST ##|16:09:51.177 pr|16:09:51.177 [go] Start to prepare dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] ##|16:09:51.478 [go] Cleaning working directory "/var/lib/go-agent/pipelines/dv_unit_tests" since stage is configured to clean working directory pr|16:09:51.478 [go] Start to update materials. pr|16:09:51.478 pr|16:09:51.478 [go] Start updating operations at revision 7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9 from [email protected]:example/operations.git pe|16:09:51.484 STDERR: Cloning into '/var/lib/go-agent/pipelines/dv_unit_tests/operations'... pr|16:09:56.603 [GIT] Fetching changes pr|16:09:59.043 [GIT] Performing git gc pr|16:09:59.045 [GIT] Reset working directory pipelines/dv_unit_tests/operations pr|16:09:59.045 [GIT] Cleaning all unversioned files in working copy pr|16:09:59.150 [GIT] Cleaning submodule configurations in .git/config pr|16:09:59.252 [GIT] Updating working copy to revision 7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9 pr|16:09:59.263 HEAD is now at 7e7bd72 updated pl_unit_tests.yml pr|16:09:59.263 [GIT] Removing modified files in submodules pr|16:09:59.279 [GIT] Cleaning all unversioned files in working copy pr|16:09:59.283 [go] Done. pr|16:09:59.283 pr|16:09:59.283 [go] setting environment variable 'GO_ENVIRONMENT_NAME' to value 'linux_build_machines' pr|16:09:59.283 [go] setting environment variable 'AWS_ACCESS_KEY' to value '********' pr|16:09:59.283 [go] setting environment variable 'AWS_ACCESS_KEY_ID' to value '********' pr|16:09:59.283 [go] setting environment variable 'AWS_SECRET_ACCESS_KEY' to value '********' pr|16:09:59.283 [go] setting environment variable 'AWS_SECRET_KEY' to value '********' pr|16:09:59.283 [go] setting environment variable 'GA_CLIENT_ID' to value '********' pr|16:09:59.283 [go] setting environment variable 'GA_CLIENT_SECRET' to value '********' pr|16:09:59.283 [go] setting environment variable 'S3_UPLOADER_ACCESS_KEY' to value '********' pr|16:09:59.283 [go] setting environment variable 'S3_UPLOADER_SECRET_KEY' to value '********' pr|16:09:59.283 [go] setting environment variable 'S3_UPLOADER_BUCKET_NAME' to value '********' pr|16:09:59.283 [go] setting environment variable 'GO_SERVER_URL' to value 'https://go.example.com:8154/go' pr|16:09:59.283 [go] setting environment variable 'GO_TRIGGER_USER' to value '[email protected]' pr|16:09:59.283 [go] setting environment variable 'GO_PIPELINE_NAME' to value 'dv_unit_tests' pr|16:09:59.283 [go] setting environment variable 'GO_PIPELINE_COUNTER' to value '261' pr|16:09:59.283 [go] setting environment variable 'GO_PIPELINE_LABEL' to value '261' pr|16:09:59.283 [go] setting environment variable 'GO_STAGE_NAME' to value 'UnitTests' pr|16:09:59.283 [go] setting environment variable 'GO_STAGE_COUNTER' to value '3' pr|16:09:59.283 [go] setting environment variable 'GO_JOB_NAME' to value 'unitTestsJob' pr|16:09:59.283 [go] setting environment variable 'GO_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:09:59.283 [go] setting environment variable 'GO_TO_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:09:59.283 [go] setting environment variable 'GO_FROM_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:09:59.283 [go] setting environment variable 'GO_DEPENDENCY_LABEL_DV_BUILD' to value '383' pr|16:09:59.283 [go] setting environment variable 'GO_DEPENDENCY_LOCATOR_DV_BUILD' to value 'dv_build/383/defaultStage/1' pr|16:09:59.283 [go] setting environment variable 'AWS_SSH_KEY' to value '/var/go/.ssh/aws_ubuntu_user.pem' pr|16:09:59.283 [go] setting environment variable 'EC2_INI_PATH' to value 'library/ec2_dynamic_inventory.ini' pr|16:09:59.283 ##|16:09:59.885 [go] Start to build dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] !!|16:09:59.886 [go] Task: fetch artifact [env/version.txt] => [operations/playbooks/] from [dv_build/defaultStage/defaultJob] &1|16:09:59.886 [go] Fetching artifact [env/version.txt] from [dv_build/383/defaultStage/1/defaultJob] &1|16:10:01.693 [go] Saved artifact to [pipelines/dv_unit_tests/operations/playbooks/version.txt] after verifying the integrity of its contents. ?0|16:10:01.693 [go] Task status: passed (1807 ms) !!|16:10:01.693 [go] Task: /bin/bash go_scripts/run_unit_tests.sh &1|16:10:47.836 &1|16:10:47.836 PLAY [Run Unit Tests for the Example App] ************************************** &1|16:10:47.868 &1|16:10:47.868 TASK [setup] ******************************************************************* &1|16:10:54.892 ok: [34.228.142.110] &1|16:10:54.904 &1|16:10:54.904 TASK [Run Unit Tests] ********************************************************** &1|16:25:40.893 fatal: [34.228.142.110]: FAILED! => {"changed": true, "cmd": "/home/ubuntu/venv/bin/py.test --junit-xml=/tmp/develop_junit.xml", "delta": "0:14:41.632857", "end": "2017-06-27 16:25:40.509624", "failed": true, "rc": 1, "start": "2017-06-27 16:10:58.876767", "stderr": "masked" } &1|16:25:40.895 ...ignoring &1|16:25:40.902 &1|16:25:40.902 TASK [Copy the test output from server to local] ******************************* &1|16:25:51.940 changed: [34.228.142.110] &1|16:25:51.941 &1|16:25:51.941 PLAY RECAP ********************************************************************* &1|16:25:51.941 34.228.142.110 : ok=3 changed=1 unreachable=0 failed=0 &1|16:25:51.941 &1|16:25:51.942 TASK: Run Unit Tests -------------------------------------------------- 886.00s &1|16:25:51.942 TASK: Copy the test output from server to local ------------------------ 11.04s &1|16:25:51.942 TASK: setup ------------------------------------------------------------- 7.04s ?0|16:25:51.969 [go] Task status: passed (950276 ms) !!|16:25:51.969 [go] Task: /bin/bash -c "junit2html junit.xml results.html" ?0|16:25:52.388 [go] Task status: passed (419 ms) j0|16:25:52.989 [go] Current job status: passed ##|16:25:53.296 [go] Start to create properties dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] ar|16:25:53.296 [go] Start to upload dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] ar|16:25:53.446 [go] Uploading artifacts from /var/lib/go-agent/pipelines/dv_unit_tests/operations/playbooks/results.html to results.html ar|16:26:00.077 [go] Uploading artifacts from /var/lib/go-agent/pipelines/dv_unit_tests/operations/playbooks/junit.xml to junit.xml |16:26:06.734 Ignoring file results.html - it is not a recognised test file. ##|16:26:31.380 [go] Job Started: 2017-06-27 16:26:31 IST ##|16:26:31.380 pr|16:26:31.380 [go] Start to prepare dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] ##|16:26:31.708 [go] Cleaning working directory "/var/lib/go-agent/pipelines/dv_unit_tests" since stage is configured to clean working directory pr|16:26:31.708 [go] Start to update materials. pr|16:26:31.708 pr|16:26:31.708 [go] Start updating operations at revision 7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9 from [email protected]:example/operations.git pe|16:26:31.711 STDERR: Cloning into '/var/lib/go-agent/pipelines/dv_unit_tests/operations'... pr|16:26:36.624 [GIT] Fetching changes pr|16:26:39.055 [GIT] Performing git gc pr|16:26:39.057 [GIT] Reset working directory pipelines/dv_unit_tests/operations pr|16:26:39.057 [GIT] Cleaning all unversioned files in working copy pr|16:26:39.061 [GIT] Cleaning submodule configurations in .git/config pr|16:26:39.063 [GIT] Updating working copy to revision 7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9 pr|16:26:39.073 HEAD is now at 7e7bd72 updated pl_unit_tests.yml pr|16:26:39.074 [GIT] Removing modified files in submodules pr|16:26:39.090 [GIT] Cleaning all unversioned files in working copy pr|16:26:39.194 [go] Done. pr|16:26:39.194 pr|16:26:39.195 [go] setting environment variable 'GO_ENVIRONMENT_NAME' to value 'linux_build_machines' pr|16:26:39.195 [go] setting environment variable 'AWS_ACCESS_KEY' to value '********' pr|16:26:39.195 [go] setting environment variable 'AWS_ACCESS_KEY_ID' to value '********' pr|16:26:39.195 [go] setting environment variable 'AWS_SECRET_ACCESS_KEY' to value '********' pr|16:26:39.195 [go] setting environment variable 'AWS_SECRET_KEY' to value '********' pr|16:26:39.195 [go] setting environment variable 'GA_CLIENT_ID' to value '********' pr|16:26:39.195 [go] setting environment variable 'GA_CLIENT_SECRET' to value '********' pr|16:26:39.195 [go] setting environment variable 'S3_UPLOADER_ACCESS_KEY' to value '********' pr|16:26:39.195 [go] setting environment variable 'S3_UPLOADER_SECRET_KEY' to value '********' pr|16:26:39.195 [go] setting environment variable 'S3_UPLOADER_BUCKET_NAME' to value '********' pr|16:26:39.195 [go] setting environment variable 'GO_SERVER_URL' to value 'https://go.example.com:8154/go' pr|16:26:39.195 [go] setting environment variable 'GO_TRIGGER_USER' to value '[email protected]' pr|16:26:39.195 [go] setting environment variable 'GO_PIPELINE_NAME' to value 'dv_unit_tests' pr|16:26:39.195 [go] setting environment variable 'GO_PIPELINE_COUNTER' to value '261' pr|16:26:39.195 [go] setting environment variable 'GO_PIPELINE_LABEL' to value '261' pr|16:26:39.195 [go] setting environment variable 'GO_STAGE_NAME' to value 'UnitTests' pr|16:26:39.195 [go] setting environment variable 'GO_STAGE_COUNTER' to value '3' pr|16:26:39.195 [go] setting environment variable 'GO_JOB_NAME' to value 'unitTestsJob' pr|16:26:39.195 [go] setting environment variable 'GO_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:26:39.195 [go] setting environment variable 'GO_TO_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:26:39.195 [go] setting environment variable 'GO_FROM_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:26:39.195 [go] setting environment variable 'GO_DEPENDENCY_LABEL_DV_BUILD' to value '383' pr|16:26:39.195 [go] setting environment variable 'GO_DEPENDENCY_LOCATOR_DV_BUILD' to value 'dv_build/383/defaultStage/1' pr|16:26:39.195 [go] setting environment variable 'AWS_SSH_KEY' to value '/var/go/.ssh/aws_ubuntu_user.pem' pr|16:26:39.195 [go] setting environment variable 'EC2_INI_PATH' to value 'library/ec2_dynamic_inventory.ini' pr|16:26:39.195 ##|16:26:39.802 [go] Start to build dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] !!|16:26:39.802 [go] Task: fetch artifact [env/version.txt] => [operations/playbooks/] from [dv_build/defaultStage/defaultJob] &1|16:26:39.802 [go] Fetching artifact [env/version.txt] from [dv_build/383/defaultStage/1/defaultJob] &1|16:26:41.587 [go] Saved artifact to [pipelines/dv_unit_tests/operations/playbooks/version.txt] after verifying the integrity of its contents. ?0|16:26:41.587 [go] Task status: passed (1785 ms) !!|16:26:41.587 [go] Task: /bin/bash go_scripts/run_unit_tests.sh &1|16:26:42.185 &1|16:26:42.185 PLAY [Run Unit Tests for the Example App] ************************************** &1|16:26:42.219 &1|16:26:42.219 TASK [setup] ******************************************************************* &1|16:26:47.084 ok: [34.228.142.110] &1|16:26:47.094 &1|16:26:47.094 TASK [Run Unit Tests] ********************************************************** &1|16:41:41.460 fatal: [34.228.142.110]: FAILED! => {"changed": true, "cmd": "/home/ubuntu/venv/bin/py.test --junit-xml=/tmp/develop_junit.xml", "delta": "0:14:49.992403", "end": "2017-06-27 16:41:41.085634", "failed": true, "rc": 1, "start": "2017-06-27 16:26:51.093231", "stderr": "masked"} &1|16:41:41.461 ...ignoring &1|16:41:41.476 &1|16:41:41.476 TASK [Copy the test output from server to local] ******************************* &1|16:41:52.560 changed: [34.228.142.110] &1|16:41:52.563 &1|16:41:52.563 PLAY RECAP ********************************************************************* &1|16:41:52.563 34.228.142.110 : ok=3 changed=1 unreachable=0 failed=0 &1|16:41:52.563 &1|16:41:52.563 TASK: Run Unit Tests -------------------------------------------------- 894.38s &1|16:41:52.564 TASK: Copy the test output from server to local ------------------------ 11.09s &1|16:41:52.564 TASK: setup ------------------------------------------------------------- 4.88s ?0|16:41:52.689 [go] Task status: passed (911102 ms) !!|16:41:52.689 [go] Task: /bin/bash -c "junit2html junit.xml results.html" ?0|16:41:53.116 [go] Task status: passed (427 ms) j0|16:41:53.712 [go] Current job status: passed ##|16:41:54.009 [go] Start to create properties dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] ar|16:41:54.010 [go] Start to upload dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] ar|16:41:54.158 [go] Uploading artifacts from /var/lib/go-agent/pipelines/dv_unit_tests/operations/playbooks/results.html to results.html ar|16:42:00.765 [go] Uploading artifacts from /var/lib/go-agent/pipelines/dv_unit_tests/operations/playbooks/junit.xml to junit.xml |16:42:07.223 Ignoring file results.html - it is not a recognised test file. ##|16:42:31.748 [go] Job Started: 2017-06-27 16:42:31 IST ##|16:42:31.748 pr|16:42:31.748 [go] Start to prepare dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] ##|16:42:32.072 [go] Cleaning working directory "/var/lib/go-agent/pipelines/dv_unit_tests" since stage is configured to clean working directory pr|16:42:32.072 [go] Start to update materials. pr|16:42:32.072 pr|16:42:32.072 [go] Start updating operations at revision 7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9 from [email protected]:example/operations.git pe|16:42:32.075 STDERR: Cloning into '/var/lib/go-agent/pipelines/dv_unit_tests/operations'... pr|16:42:37.333 [GIT] Fetching changes pr|16:42:39.787 [GIT] Performing git gc pr|16:42:39.788 [GIT] Reset working directory pipelines/dv_unit_tests/operations pr|16:42:39.788 [GIT] Cleaning all unversioned files in working copy pr|16:42:39.792 [GIT] Cleaning submodule configurations in .git/config pr|16:42:39.793 [GIT] Updating working copy to revision 7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9 pr|16:42:39.804 HEAD is now at 7e7bd72 updated pl_unit_tests.yml pr|16:42:39.804 [GIT] Removing modified files in submodules pr|16:42:39.820 [GIT] Cleaning all unversioned files in working copy pr|16:42:39.925 [go] Done. pr|16:42:39.925 pr|16:42:39.926 [go] setting environment variable 'GO_ENVIRONMENT_NAME' to value 'linux_build_machines' pr|16:42:39.926 [go] setting environment variable 'AWS_ACCESS_KEY' to value '********' pr|16:42:39.926 [go] setting environment variable 'AWS_ACCESS_KEY_ID' to value '********' pr|16:42:39.926 [go] setting environment variable 'AWS_SECRET_ACCESS_KEY' to value '********' pr|16:42:39.926 [go] setting environment variable 'AWS_SECRET_KEY' to value '********' pr|16:42:39.926 [go] setting environment variable 'GA_CLIENT_ID' to value '********' pr|16:42:39.926 [go] setting environment variable 'GA_CLIENT_SECRET' to value '********' pr|16:42:39.926 [go] setting environment variable 'S3_UPLOADER_ACCESS_KEY' to value '********' pr|16:42:39.926 [go] setting environment variable 'S3_UPLOADER_SECRET_KEY' to value '********' pr|16:42:39.926 [go] setting environment variable 'S3_UPLOADER_BUCKET_NAME' to value '********' pr|16:42:39.926 [go] setting environment variable 'GO_SERVER_URL' to value 'https://go.example.com:8154/go' pr|16:42:39.926 [go] setting environment variable 'GO_TRIGGER_USER' to value '[email protected]' pr|16:42:39.926 [go] setting environment variable 'GO_PIPELINE_NAME' to value 'dv_unit_tests' pr|16:42:39.926 [go] setting environment variable 'GO_PIPELINE_COUNTER' to value '261' pr|16:42:39.926 [go] setting environment variable 'GO_PIPELINE_LABEL' to value '261' pr|16:42:39.926 [go] setting environment variable 'GO_STAGE_NAME' to value 'UnitTests' pr|16:42:39.926 [go] setting environment variable 'GO_STAGE_COUNTER' to value '3' pr|16:42:39.926 [go] setting environment variable 'GO_JOB_NAME' to value 'unitTestsJob' pr|16:42:39.926 [go] setting environment variable 'GO_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:42:39.926 [go] setting environment variable 'GO_TO_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:42:39.926 [go] setting environment variable 'GO_FROM_REVISION_OPERATIONS' to value '7e7bd722f6899ccc7469f8c1a9abe92ce1679ef9' pr|16:42:39.926 [go] setting environment variable 'GO_DEPENDENCY_LABEL_DV_BUILD' to value '383' pr|16:42:39.926 [go] setting environment variable 'GO_DEPENDENCY_LOCATOR_DV_BUILD' to value 'dv_build/383/defaultStage/1' pr|16:42:39.926 [go] setting environment variable 'AWS_SSH_KEY' to value '/var/go/.ssh/aws_ubuntu_user.pem' pr|16:42:39.926 [go] setting environment variable 'EC2_INI_PATH' to value 'library/ec2_dynamic_inventory.ini' pr|16:42:39.926 ##|16:42:40.531 [go] Start to build dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent] !!|16:42:40.531 [go] Task: fetch artifact [env/version.txt] => [operations/playbooks/] from [dv_build/defaultStage/defaultJob] &1|16:42:40.531 [go] Fetching artifact [env/version.txt] from [dv_build/383/defaultStage/1/defaultJob] &1|16:42:42.337 [go] Saved artifact to [pipelines/dv_unit_tests/operations/playbooks/version.txt] after verifying the integrity of its contents. ?0|16:42:42.337 [go] Task status: passed (1806 ms) !!|16:42:42.337 [go] Task: /bin/bash go_scripts/run_unit_tests.sh &1|16:43:25.863 &1|16:43:25.863 PLAY [Run Unit Tests for the Example App] ************************************** &1|16:43:25.896 &1|16:43:25.896 TASK [setup] ******************************************************************* &1|16:43:32.464 ok: [34.228.142.110] &1|16:43:32.474 &1|16:43:32.474 TASK [Run Unit Tests] ********************************************************** !x|16:51:47.839 [go] On Cancel Task: Kills child processes x0|16:51:47.902 [go] On Cancel Task completed ^C|16:51:48.003 [go] Task status: failed (545666 ms) (exit code: 143) ex|16:51:48.908 [go] Job completed dv_unit_tests/261/UnitTests/3/unitTestsJob on ubuntu [/var/lib/go-agent]
