See
<https://ci-beam.apache.org/job/beam_LoadTests_Python_SideInput_Dataflow_Batch/260/display/redirect?page=changes>
Changes:
[egalpin] [BEAM-12421] Migrates ElasticsearchIOTest to use testContainers
[egalpin] Adds factory method for creating consistent ES containers
[egalpin] Renames elasticsearchIOTestContainerFactory to createTestContainer
[egalpin] Reduces number of docs for UTests from 400 to 100
[Robert Bradshaw] [BEAM-12475] Reject splits for previous bundles.
[noreply] Add 2.30 release date
[noreply] Remove placeholder entries from 2.30
[Robert Bradshaw] mypy
[Boyuan Zhang] [BEAM-12475] Ensure the BundleProcessor.getId() is null before
calling
[benjamin.gonzalez] [BEAM-37137] Fix xlang dependency error
[heejong] Update Dataflow Python container version to 20210622
[Robert Burke] [BEAM-12528] Discard failed plans.
[noreply] [BEAM-9547] Add support for `Series.dt` methods (#14940)
------------------------------------------
[...truncated 319.78 KB...]
[beam_LoadTests_Python_SideInput_Dataflow_Batch] $ /bin/bash -xe
/tmp/jenkins4426338189927166058.sh
+ echo '*** SideInput Python Load test:
1gb-1kb-10****s-1000window-99key-percent-dict ***'
*** SideInput Python Load test: 1gb-1kb-10****s-1000window-99key-percent-dict
***
[Gradle] - Launching build.
[src] $
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/gradlew
-PloadTest.mainClass=apache_beam.testing.load_tests.sideinput_test
-Prunner=DataflowRunner
'-PloadTest.args=--job_name=load-tests-python-dataflow-batch-sideinput-8-0623100400
--project=apache-beam-testing --region=us-central1
--temp_location=gs://temp-storage-for-perf-tests/loadtests
--publish_to_big_query=true --metrics_dataset=load_test
--metrics_table=python_dataflow_batch_sideinput_8
--influx_measurement=python_batch_sideinput_8 --num_****s=10
--autoscaling_algorithm=NONE --experiments=use_runner_v2,
shuffle_mode=appliance --input_options='{"num_records": 1000000,"key_size":
100,"value_size": 900}' --side_input_type=dict --access_percentage=99
--window_count=1000 --influx_db_name=beam_test_metrics
--influx_hostname=http://10.128.0.96:8086 --runner=DataflowRunner'
-PpythonVersion=3.7 --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g
-Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses
:sdks:python:apache_beam:testing:load_tests:run
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:python:setupVirtualenv UP-TO-DATE
> Task :sdks:python:sdist UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:setupVirtualenv UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:installGcpTest
Processing
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/sdks/python/build/apache-beam.tar.gz
Requirement already satisfied: avro-python3!=1.9.2,<1.10.0,>=1.8.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.9.2.1)
Requirement already satisfied: crcmod<2.0,>=1.7 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.7)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (0.3.1.1)
Requirement already satisfied: fastavro<2,>=0.21.4 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.4.1)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.29.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.38.1)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (2.6.0)
Requirement already satisfied: httplib2<0.20.0,>=0.8 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (0.19.1)
Requirement already satisfied: numpy<1.21.0,>=1.14.3 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.20.3)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (3.11.4)
Requirement already satisfied: oauth2client<5,>=2.0.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (4.1.3)
Requirement already satisfied: protobuf<4,>=3.12.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (3.17.3)
Requirement already satisfied: pyarrow<5.0.0,>=0.15.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (4.0.1)
Requirement already satisfied: pydot<2,>=1.2.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.4.2)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (2.8.1)
Requirement already satisfied: pytz>=2018.3 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (2021.1)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (2.25.1)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (3.7.4.3)
Requirement already satisfied: orjson<4.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (3.5.3)
Requirement already satisfied: azure-storage-blob>=12.3.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (12.8.1)
Requirement already satisfied: azure-core>=1.7.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.15.0)
Requirement already satisfied: boto3>=1.9 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.17.98)
Requirement already satisfied: freezegun>=0.3.12 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.1.0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (2.0.0)
Requirement already satisfied: nose>=1.3.7 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.3.7)
Requirement already satisfied: nose_xunitmp>=0.4.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (0.4.1)
Requirement already satisfied: pandas<1.3.0,>=1.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.2.5)
Requirement already satisfied: parameterized<0.8.0,>=0.7.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (0.7.5)
Requirement already satisfied: pyhamcrest!=1.10.0,<2.0.0,>=1.9 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.10.1)
Requirement already satisfied: pyyaml<6.0.0,>=3.12 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (5.4.1)
Requirement already satisfied: requests_mock<2.0,>=1.7 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.9.3)
Requirement already satisfied: tenacity<6.0,>=5.0.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (5.1.5)
Requirement already satisfied: pytest<5.0,>=4.4.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (4.6.11)
Requirement already satisfied: pytest-xdist<2,>=1.29.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.34.0)
Requirement already satisfied: pytest-timeout<2,>=1.3.3 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.4.2)
Requirement already satisfied: sqlalchemy<2.0,>=1.3 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.4.19)
Requirement already satisfied: psycopg2-binary<3.0.0,>=2.8.5 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (2.9.1)
Requirement already satisfied: testcontainers<4.0.0,>=3.0.3 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (3.4.1)
Requirement already satisfied: cachetools<5,>=3.1.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (4.2.2)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (0.5.31)
Requirement already satisfied: google-auth<2,>=1.18.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.32.0)
Requirement already satisfied: google-cloud-datastore<2,>=1.8.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.15.3)
Requirement already satisfied: google-cloud-pubsub<2,>=0.39.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.7.0)
Requirement already satisfied: google-cloud-bigquery<3,>=1.6.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (2.20.0)
Requirement already satisfied: google-cloud-core<2,>=0.28.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.7.0)
Requirement already satisfied: google-cloud-bigtable<2,>=0.31.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.7.0)
Requirement already satisfied: google-cloud-spanner<2,>=1.13.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.19.1)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (0.2.2)
Requirement already satisfied: google-cloud-dlp<2,>=0.12.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.0.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-videointelligence<2,>=1.8.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.16.1)
Requirement already satisfied: google-cloud-vision<2,>=0.38.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (1.0.0)
Requirement already satisfied: google-cloud-profiler<4,>=3.0.4 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from apache-beam==2.32.0.dev0) (3.0.4)
Requirement already satisfied: six>=1.11.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from azure-core>=1.7.0->apache-beam==2.32.0.dev0) (1.16.0)
Requirement already satisfied: msrest>=0.6.18 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0) (0.6.21)
Requirement already satisfied: cryptography>=2.1.4 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0) (3.4.7)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from boto3>=1.9->apache-beam==2.32.0.dev0) (0.10.0)
Requirement already satisfied: botocore<1.21.0,>=1.20.98 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from boto3>=1.9->apache-beam==2.32.0.dev0) (1.20.98)
Requirement already satisfied: s3transfer<0.5.0,>=0.4.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from boto3>=1.9->apache-beam==2.32.0.dev0) (0.4.2)
Requirement already satisfied: urllib3<1.27,>=1.25.4 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from botocore<1.21.0,>=1.20.98->boto3>=1.9->apache-beam==2.32.0.dev0) (1.26.5)
Requirement already satisfied: cffi>=1.12 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from
cryptography>=2.1.4->azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0)
(1.14.5)
Requirement already satisfied: pycparser in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from
cffi>=1.12->cryptography>=2.1.4->azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0)
(2.20)
Requirement already satisfied: fasteners>=0.14 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-apitools<0.5.32,>=0.5.31->apache-beam==2.32.0.dev0) (0.16.3)
Requirement already satisfied: rsa<5,>=3.1.4 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-auth<2,>=1.18.0->apache-beam==2.32.0.dev0) (4.7.2)
Requirement already satisfied: setuptools>=40.3.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-auth<2,>=1.18.0->apache-beam==2.32.0.dev0) (57.0.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-auth<2,>=1.18.0->apache-beam==2.32.0.dev0) (0.2.8)
Requirement already satisfied: google-resumable-media<2.0dev,>=0.6.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.32.0.dev0) (1.3.1)
Requirement already satisfied: proto-plus>=1.10.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.32.0.dev0) (1.18.1)
Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.29.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.32.0.dev0) (1.30.0)
Requirement already satisfied: packaging>=14.3 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.32.0.dev0) (20.9)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from
google-api-core[grpc]<2.0.0dev,>=1.29.0->google-cloud-bigquery<3,>=1.6.0->apache-beam==2.32.0.dev0)
(1.53.0)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-cloud-bigtable<2,>=0.31.1->apache-beam==2.32.0.dev0) (0.12.3)
Requirement already satisfied: google-auth-httplib2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-cloud-profiler<4,>=3.0.4->apache-beam==2.32.0.dev0) (0.1.0)
Requirement already satisfied: google-api-python-client!=1.12.0,!=2.0.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from google-cloud-profiler<4,>=3.0.4->apache-beam==2.32.0.dev0) (2.10.0)
Requirement already satisfied: uritemplate<4dev,>=3.0.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from
google-api-python-client!=1.12.0,!=2.0.2->google-cloud-profiler<4,>=3.0.4->apache-beam==2.32.0.dev0)
(3.0.1)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from
google-resumable-media<2.0dev,>=0.6.0->google-cloud-bigquery<3,>=1.6.0->apache-beam==2.32.0.dev0)
(1.1.2)
Requirement already satisfied: docopt in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from hdfs<3.0.0,>=2.1.0->apache-beam==2.32.0.dev0) (0.6.2)
Requirement already satisfied: pyparsing<3,>=2.4.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from httplib2<0.20.0,>=0.8->apache-beam==2.32.0.dev0) (2.4.7)
Requirement already satisfied: pbr>=0.11 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from mock<3.0.0,>=1.0.1->apache-beam==2.32.0.dev0) (5.6.0)
Requirement already satisfied: certifi>=2017.4.17 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0)
(2021.5.30)
Requirement already satisfied: isodate>=0.6.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0)
(0.6.0)
Requirement already satisfied: requests-oauthlib>=0.5.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0)
(1.3.0)
Requirement already satisfied: pyasn1>=0.1.7 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from oauth2client<5,>=2.0.1->apache-beam==2.32.0.dev0) (0.4.8)
Requirement already satisfied: atomicwrites>=1.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (1.4.0)
Requirement already satisfied: attrs>=17.4.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (21.2.0)
Requirement already satisfied: pluggy<1.0,>=0.12 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (0.13.1)
Requirement already satisfied: wcwidth in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (0.2.5)
Requirement already satisfied: py>=1.5.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (1.10.0)
Requirement already satisfied: more-itertools>=4.0.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (8.8.0)
Requirement already satisfied: importlib-metadata>=0.12 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0) (2.1.1)
Requirement already satisfied: zipp>=0.5 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.32.0.dev0)
(3.4.1)
Requirement already satisfied: execnet>=1.1 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest-xdist<2,>=1.29.0->apache-beam==2.32.0.dev0) (1.9.0)
Requirement already satisfied: pytest-forked in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from pytest-xdist<2,>=1.29.0->apache-beam==2.32.0.dev0) (1.3.0)
Requirement already satisfied: chardet<5,>=3.0.2 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from requests<3.0.0,>=2.24.0->apache-beam==2.32.0.dev0) (4.0.0)
Requirement already satisfied: idna<3,>=2.5 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from requests<3.0.0,>=2.24.0->apache-beam==2.32.0.dev0) (2.10)
Requirement already satisfied: oauthlib>=3.0.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from
requests-oauthlib>=0.5.0->msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.32.0.dev0)
(3.1.1)
Requirement already satisfied: greenlet!=0.4.17 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from sqlalchemy<2.0,>=1.3->apache-beam==2.32.0.dev0) (1.1.0)
Requirement already satisfied: wrapt in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from testcontainers<4.0.0,>=3.0.3->apache-beam==2.32.0.dev0) (1.12.1)
Requirement already satisfied: docker in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from testcontainers<4.0.0,>=3.0.3->apache-beam==2.32.0.dev0) (5.0.0)
Requirement already satisfied: deprecation in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from testcontainers<4.0.0,>=3.0.3->apache-beam==2.32.0.dev0) (2.1.0)
Requirement already satisfied: websocket-client>=0.32.0 in
/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/build/gradleenv/1329484227/lib/python3.7/site-packages
(from docker->testcontainers<4.0.0,>=3.0.3->apache-beam==2.32.0.dev0) (1.1.0)
DEPRECATION: Source distribution is being reinstalled despite an installed
package having the same name and version as the installed package. pip 21.2
will remove support for this functionality. A possible replacement is use
--force-reinstall. You can find discussion regarding this at
https://github.com/pypa/pip/issues/8711.
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam:
filename=apache_beam-2.32.0.dev0-py3-none-any.whl size=2501770
sha256=77df614b7f4581b3b9154a02407ccff4e91389b347ac36e679979d77acf4c7cc
Stored in directory:
/home/jenkins/.cache/pip/wheels/c1/f5/a3/8f5ec48b796c1b690bd340ec7688fb88886afa83d7f14ff737
Successfully built apache-beam
Installing collected packages: apache-beam
Attempting uninstall: apache-beam
Found existing installation: apache-beam 2.32.0.dev0
Uninstalling apache-beam-2.32.0.dev0:
Successfully uninstalled apache-beam-2.32.0.dev0
Successfully installed apache-beam-2.32.0.dev0
> Task :sdks:python:apache_beam:testing:load_tests:run
INFO:root:990 out of 1000 total elements in each window will be accessed.
INFO:apache_beam.runners.portability.stager:Copying Beam SDK
"/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Python_SideInput_Dataflow_Batch/src/sdks/python/build/apache-beam.tar.gz"
to staging location.
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.7 interpreter.
INFO:root:Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.32.0.dev
INFO:root:Using provided Python SDK container image:
gcr.io/cloud-dataflow/v1beta3/python37:beam-master-20210622
INFO:root:Python SDK container image set to
"gcr.io/cloud-dataflow/v1beta3/python37:beam-master-20210622" for Docker
environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function pack_combiners at 0x7f7af0c03048> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sort_stages at 0x7f7af0c037b8> ====================
INFO:apache_beam.runners.dataflow.internal.apiclient:Defaulting to the
temp_location as staging_location: gs://temp-storage-for-perf-tests/loadtests
INFO:apache_beam.internal.gcp.auth:Setting socket default timeout to 60 seconds.
INFO:apache_beam.internal.gcp.auth:socket default timeout is 60.0 seconds.
INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to
gs://temp-storage-for-perf-tests/loadtests/load-tests-python-dataflow-batch-sideinput-8-0623100400.1624456069.756224/dataflow_python_sdk.tar...
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to
gs://temp-storage-for-perf-tests/loadtests/load-tests-python-dataflow-batch-sideinput-8-0623100400.1624456069.756224/dataflow_python_sdk.tar
in 0 seconds.
INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to
gs://temp-storage-for-perf-tests/loadtests/load-tests-python-dataflow-batch-sideinput-8-0623100400.1624456069.756224/pipeline.pb...
INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to
gs://temp-storage-for-perf-tests/loadtests/load-tests-python-dataflow-batch-sideinput-8-0623100400.1624456069.756224/pipeline.pb
in 0 seconds.
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args:
['shuffle_mode=appliance', '--side_input_type=dict', '--access_percentage=99',
'--window_count=1000']
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args:
['shuffle_mode=appliance', '--side_input_type=dict', '--access_percentage=99',
'--window_count=1000']
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
createTime: '2021-06-23T13:47:51.126183Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2021-06-23_06_47_50-13166606027550662442'
location: 'us-central1'
name: 'load-tests-python-dataflow-batch-sideinput-8-0623100400'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2021-06-23T13:47:51.126183Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id:
[2021-06-23_06_47_50-13166606027550662442]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job:
2021-06-23_06_47_50-13166606027550662442
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow
monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-06-23_06_47_50-13166606027550662442?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2021-06-23_06_47_50-13166606027550662442 is in state JOB_STATE_PENDING
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:56.591Z:
JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-c.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.318Z:
JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.358Z:
JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.399Z:
JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.436Z:
JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.489Z:
JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.517Z:
JOB_MESSAGE_DETAILED: Fusing consumer Get synthetic SDF options into Apply
windows
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.549Z:
JOB_MESSAGE_DETAILED: Fusing consumer Collect start time metrics into Apply
windows
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.577Z:
JOB_MESSAGE_DETAILED: Fusing consumer Assign timestamps into Create/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.611Z:
JOB_MESSAGE_DETAILED: Fusing consumer Apply windows into Assign timestamps
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.639Z:
JOB_MESSAGE_DETAILED: Fusing consumer Generate input into Get synthetic SDF
options
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.663Z:
JOB_MESSAGE_DETAILED: Fusing consumer Collect end time metrics into
ParDo(MappingSideInputTestDoFn)/ParDo(MappingSideInputTestDoFn)
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.700Z:
JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.741Z:
JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.769Z:
JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.790Z:
JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:57.915Z:
JOB_MESSAGE_DEBUG: Executing wait step start4
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:58.004Z:
JOB_MESSAGE_BASIC: Executing operation Create/Read+Assign timestamps+Apply
windows+Get synthetic SDF options+Collect start time metrics+Generate input
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:58.067Z:
JOB_MESSAGE_DEBUG: Starting **** pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:47:58.102Z:
JOB_MESSAGE_BASIC: Starting 10 ****s in us-central1-c...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2021-06-23_06_47_50-13166606027550662442 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:48:25.613Z:
JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric
descriptors, so new user metrics of the form custom.googleapis.com/* will not
be created. However, all user metrics are also available in the metric
dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics,
you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:48:56.501Z:
JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of ****s to 10 based on
the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:49:18.386Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:49:18.423Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:55:14.913Z:
JOB_MESSAGE_BASIC: Finished operation Create/Read+Assign timestamps+Apply
windows+Get synthetic SDF options+Collect start time metrics+Generate input
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:55:14.965Z:
JOB_MESSAGE_DEBUG: Value "Collect start time metrics.out" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:55:15.042Z:
JOB_MESSAGE_DEBUG: Value "Generate input.out" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:55:15.109Z:
JOB_MESSAGE_BASIC: Executing operation
ParDo(MappingSideInputTestDoFn)/_UnpickledSideInput(Generate input.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:55:15.163Z:
JOB_MESSAGE_BASIC: Finished operation
ParDo(MappingSideInputTestDoFn)/_UnpickledSideInput(Generate input.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:55:15.278Z:
JOB_MESSAGE_DEBUG: Value
"ParDo(MappingSideInputTestDoFn)/_UnpickledSideInput(Generate
input.out.0).output" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2021-06-23T13:55:15.328Z:
JOB_MESSAGE_BASIC: Executing operation
ParDo(MappingSideInputTestDoFn)/ParDo(MappingSideInputTestDoFn)+Collect end
time metrics
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-15' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
at com.sun.proxy.$Proxy145.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1211)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1203)
at hudson.Launcher$ProcStarter.join(Launcher.java:523)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804)
at hudson.model.Build$BuildExecution.build(Build.java:197)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:514)
at hudson.model.Run.execute(Run.java:1907)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: java.io.IOException: Pipe closed after 0 cycles
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:118)
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:101)
at
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:92)
at
hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:73)
at
hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:103)
at
hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-15 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
