See 
<https://builds.apache.org/job/beam_PerformanceTests_Python/1136/display/redirect?page=changes>

Changes:

[rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to 
work

[relax] Update python version.

[relax] Update container version.

[kirpichov] Cherrypick of #3995 to 2.2.0: Add custom tempLocation support to

[jbonofre] [BEAM-1017] Add RedisIO

[kenn] Use 2.2.0 container tag for Dataflow

[chamikara] Sets user agent in BigTableIO.Read.getBigTableService().

[valentyn] Pin runner harness container image for Dataflow distributions of BEAM

[valentyn] Make linter happy.

[valentyn] [BEAM-2600] Add minimal python SDK harness container

[valentyn] Use 2.2.0 version instead of 2.3.0 for container Maven project on the

[valentyn] Use tox instead of detox. Looks like we reverted to tox on the master

[valentyn] Pin runner harness also for official BEAM releases.

[relax] [maven-release-plugin] prepare release

[relax] [maven-release-plugin] prepare for next development iteration

[relax] Revert "[maven-release-plugin] prepare for next development iteration"

[relax] Revert "[maven-release-plugin] prepare release

[relax] [maven-release-plugin] prepare release v2.2.0-RC1

[relax] [maven-release-plugin] rollback changes from release preparation of

[altay] Add an element batching transform.

[altay] Align names with those produced by the dataflow runner harness.

[altay] Fix from any -> bytes transition.

[altay] Add an option for dataflow job labels.

[altay] Unit test for label pipeline option

[altay] Update container version for python DataflowRunner for the 2.2.0 release

[relax] [maven-release-plugin] prepare release v2.2.0-RC2

[relax] [maven-release-plugin] rollback changes from release preparation of

[relax] [maven-release-plugin] prepare release v2.2.0-RC3

[relax] [maven-release-plugin] rollback changes from release preparation of

[valentyn] Set save_main_session to True for csv module

[valentyn] Set OnTimeBehavior in windowing strategy to FIRE_ALWAYS.

[valentyn] Update urns.py

[ccy] CP #4112, #4122: Properly handle side input exception when all reader

[relax] Cherrypick WriteFiles fix.

[relax] [maven-release-plugin] prepare release v2.2.0-RC4

[relax] [maven-release-plugin] rollback changes from release preparation of

[rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to 
work

[rezarokni] [maven-release-plugin] prepare for next development iteration

[rezarokni] Bump Python version for next release.

[rezarokni] Only fail nightly release at end, for more detailed signal

[rezarokni] Only fail Java postcommit at end

[rezarokni] Move the Job Server into a Submodule

[rezarokni] Add Artifact Staging Endpoint to PrepareJobResponse

[rezarokni] Add model/ and submodules to Maven structure and gen_protos.py

[rezarokni] Move sdk/common/runner-api protos into model/pipeline and

[rezarokni] Move sdks/common/fn-api protos to model/fn-execution

[rezarokni] Remove sdks/common

[rezarokni] Re-namespace model/pipeline to model.pipeline

[rezarokni] Re-namespace model/job-management to model.job_management

[rezarokni] Re-namespace model/fn-execution to model.fn_execution

[rezarokni] Improve error message when standard_coders.yaml not found

[rezarokni] Dataflow runner: shade protobuf and beam model

[rezarokni] PipelineOptionsFactory should prevent non PipelineOptions interfaces

[rezarokni] [BEAM-3016] Fix blocking issue within run() when channel terminates

[rezarokni] [BEAM-2576] Reflect portability proto changes in Go

[rezarokni] Add licenses to generated code

[rezarokni] Improve the documentation for CombineFn

[rezarokni] Remove coders from DoFn's Remove extra space in hello.cc file Remove

[rezarokni] Fix Bug if more than one external lib DoFn is used in same pipeline 
the

[rezarokni] Removed more complex examples for later PR Added semaphore logic to

[7542791+rezarokni] Added Assert for test pipeline. Added comments and new file 
names for

[7542791+rezarokni] Added ability to read Binary output from files for use with 
Protobuf

[7542791+rezarokni] Moved files from java8 to java

[7542791+rezarokni] Correct checkstyle issues

[amyrvold] [BEAM-4035] Fix spark validatesrunner

[amyrvold] Change ver of zookeeper instead of removing mavenLocal

[7542791+rezarokni] Fix findBugs issues

[lcwik] [BEAM-3249, BEAM-4014] Automatically propagate shading configuration to

[lcwik] [BEAM-3249] Add support for translating 'provided' scope dependencies to

[kenn] Basic run task for nexmark with runner selection

------------------------------------------
[...truncated 1.63 KB...]
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins2607328252619943026.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins1366556890383245229.sh
+ virtualenv .env --system-site-packages
New python executable in 
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/bin/python>
Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins297334369144073779.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins5179966366160117575.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins5009690477420920034.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in 
/usr/local/lib/python2.7/dist-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages 
(from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
  Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in 
/home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r 
PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe in 
/usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r 
PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in 
/usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r 
PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in 
/home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != 
"PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from 
cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in 
/usr/local/lib/python2.7/dist-packages (from 
cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in 
/home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; 
platform_python_implementation != 
"PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r 
PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
  Found existing installation: numpy 1.11.3
    Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, 
outside environment 
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins1439504510777788505.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining 
file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
  Using cached grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
  Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 
in /home/jenkins/.local/lib/python2.7/site-packages (from 
apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
  Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in 
/home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages 
(from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages 
(from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in 
/home/jenkins/.local/lib/python2.7/site-packages (from 
google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
  Found existing installation: grpcio 1.3.5
    Not uninstalling grpcio at 
/home/jenkins/.local/lib/python2.7/site-packages, outside environment 
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
  Found existing installation: apache-beam 2.5.0.dev0
    Not uninstalling apache-beam at 
/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TextIOIT/src/sdks/python,
 outside environment 
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
  Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 
pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins435660883398492763.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing 
--dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn 
--bigquery_table=beam_performance.pkb_results 
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> 
--official=true --beam_sdk=python --benchmarks=beam_integration_benchmark 
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-11 18:31:09,802 591b2fe8 MainThread INFO     Verbose logging to: 
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/pkb.log>
2018-04-11 18:31:09,802 591b2fe8 MainThread INFO     PerfKitBenchmarker 
version: v1.12.0-478-g2db3b21
2018-04-11 18:31:09,803 591b2fe8 MainThread INFO     Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-11 18:31:09,968 591b2fe8 MainThread WARNING  The key "flags" was not in 
the default config, but was in user overrides. This may indicate a typo.
2018-04-11 18:31:09,969 591b2fe8 MainThread INFO     Initializing the edw 
service decoder
2018-04-11 18:31:10,099 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Provisioning resources for benchmark beam_integration_benchmark
2018-04-11 18:31:10,102 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Preparing benchmark beam_integration_benchmark
2018-04-11 18:31:10,103 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Running: git clone https://github.com/apache/beam.git
2018-04-11 18:31:17,181 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Running: /home/jenkins/tools/maven/latest/bin/mvn clean install 
-DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-11 18:39:55,803 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Running benchmark beam_integration_benchmark
2018-04-11 18:39:55,816 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Running: python setup.py nosetests 
--tests=apache_beam.examples.wordcount_it_test --attr=IT 
--test-pipeline-options="--project=apache-beam-testing" 
"--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" 
"--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" 
"--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" 
--runner=TestDataflowRunner 
--sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-11 18:39:56,337 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Ran: {python setup.py nosetests 
--tests=apache_beam.examples.wordcount_it_test --attr=IT 
--test-pipeline-options="--project=apache-beam-testing" 
"--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" 
"--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" 
"--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" 
--runner=TestDataflowRunner 
--sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}>
  ReturnCode:1
STDOUT: 
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: 
UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
  normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
   or: setup.py --help [cmd1 cmd2 ...]
   or: setup.py --help-commands
   or: setup.py cmd --help

error: invalid command 'nosetests'

2018-04-11 18:39:56,338 591b2fe8 MainThread beam_integration_benchmark(1/1) 
ERROR    Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
 line 623, in RunBenchmark
    DoRunPhase(spec, collector, detailed_timer)
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
 line 526, in DoRunPhase
    samples = spec.BenchmarkRun(spec)
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
 line 159, in Run
    job_type=job_type)
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
 line 90, in SubmitJob
    assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 18:39:56,339 591b2fe8 MainThread beam_integration_benchmark(1/1) 
INFO     Cleaning up benchmark beam_integration_benchmark
2018-04-11 18:39:56,341 591b2fe8 MainThread beam_integration_benchmark(1/1) 
ERROR    Exception running benchmark
Traceback (most recent call last):
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
 line 757, in RunBenchmarkTask
    RunBenchmark(spec, collector)
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
 line 623, in RunBenchmark
    DoRunPhase(spec, collector, detailed_timer)
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
 line 526, in DoRunPhase
    samples = spec.BenchmarkRun(spec)
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
 line 159, in Run
    job_type=job_type)
  File 
"<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
 line 90, in SubmitJob
    assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 18:39:56,341 591b2fe8 MainThread beam_integration_benchmark(1/1) 
ERROR    Benchmark 1/1 beam_integration_benchmark (UID: 
beam_integration_benchmark0) failed. Execution will continue.
2018-04-11 18:39:56,364 591b2fe8 MainThread INFO     Benchmark run statuses:
---------------------------------------------------------------------------------
Name                        UID                          Status  Failed 
Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark  beam_integration_benchmark0  FAILED                 
 
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-11 18:39:56,364 591b2fe8 MainThread INFO     Complete logs can be found 
at: 
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/pkb.log>
2018-04-11 18:39:56,364 591b2fe8 MainThread INFO     Completion statuses can be 
found at: 
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.kret...@gmail.com
Not sending mail to unregistered user sweg...@google.com
Not sending mail to unregistered user eh...@google.com
Not sending mail to unregistered user ro...@frantil.com
Not sending mail to unregistered user wtan...@yahoo.com
Not sending mail to unregistered user daniel.o.program...@gmail.com
Not sending mail to unregistered user ankurgoe...@gmail.com
Not sending mail to unregistered user da...@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarc...@gmail.com
Not sending mail to unregistered user fjetum...@gmail.com
Not sending mail to unregistered user mari...@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmi...@gmail.com
Not sending mail to unregistered user andreas.ehrencr...@velik.it
Not sending mail to unregistered user timrobertson...@gmail.com
Not sending mail to unregistered user abhyan...@gmail.com
Not sending mail to unregistered user 7542791+rezaro...@users.noreply.github.com
Not sending mail to unregistered user 1028332...@qq.com
Not sending mail to unregistered user mari...@google.com
Not sending mail to unregistered user alan.myrv...@comcast.net
Not sending mail to unregistered user arnaudfournier...@gmail.com
Not sending mail to unregistered user swegn...@gmail.com
Not sending mail to unregistered user w...@google.com
Not sending mail to unregistered user luke_...@brown.edu
Not sending mail to unregistered user arost...@google.com
Not sending mail to unregistered user 
bat...@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezaro...@google.com
Not sending mail to unregistered user arnaudfournier...@gmail.com
Not sending mail to unregistered user axelm...@gmail.com
Not sending mail to unregistered user rob...@frantil.com
Not sending mail to unregistered user meliss...@google.com
Not sending mail to unregistered user holdenka...@google.com
Not sending mail to unregistered user z...@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggo...@healthsparq.com
Not sending mail to unregistered user jiang...@gmail.com
Not sending mail to unregistered user sid...@google.com
Not sending mail to unregistered user 
yifan...@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gaj...@polidea.com
Not sending mail to unregistered user ke...@google.com
Not sending mail to unregistered user 
re...@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user c...@google.com
Not sending mail to unregistered user k...@google.com
Not sending mail to unregistered user g...@telligent-data.com
Not sending mail to unregistered user ccla...@bluewin.ch
Not sending mail to unregistered user hero...@google.com
Not sending mail to unregistered user apill...@google.com
Not sending mail to unregistered user samu...@google.com
Not sending mail to unregistered user dariusz.aniszew...@polidea.com
Not sending mail to unregistered user git...@alasdairhodge.co.uk
Not sending mail to unregistered user valen...@google.com
Not sending mail to unregistered user mott...@gmail.com
Not sending mail to unregistered user wi...@bounceexchange.com
Not sending mail to unregistered user aal...@gmail.com
Not sending mail to unregistered user boyu...@google.com
Not sending mail to unregistered user ekirpic...@gmail.com
Not sending mail to unregistered user zhouha...@meituan.com
Not sending mail to unregistered user ni...@google.com
Not sending mail to unregistered user amyrv...@google.com
Not sending mail to unregistered user mair...@google.com
Not sending mail to unregistered user j...@nanthrax.net
Not sending mail to unregistered user sdus...@google.com
Not sending mail to unregistered user joey.bar...@gmail.com
Not sending mail to unregistered user xuming...@users.noreply.github.com
Not sending mail to unregistered user mark...@google.com
Not sending mail to unregistered user 1147435+chua...@users.noreply.github.com
Not sending mail to unregistered user szewi...@gmail.com
Not sending mail to unregistered user dcava...@google.com
Not sending mail to unregistered user grzegorz.kolakow...@getindata.com
Not sending mail to unregistered user kirpic...@google.com
Not sending mail to unregistered user aromanenko....@gmail.com

Reply via email to