See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/284/display/redirect?page=changes>
Changes: [kamil.wasilewski] [BEAM-7661] Create Python coGBK load test job on Flink [kamil.wasilewski] [BEAM-7661] Generate the same number of hot keys from both sources [aaltay] [BEAM-7797] Move upload_graph handling logic before template ------------------------------------------ [...truncated 49.99 KB...] Using cached https://files.pythonhosted.org/packages/3d/73/fe30c2daaaa0713420d0382b16fbb761409f532c56bdcc514bf7b6262bb6/pytz-2019.1-py2.py3-none-any.whl Collecting pyyaml<4.0.0,>=3.12 (from apache-beam==2.15.0.dev0) Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.15.0.dev0) Requirement already satisfied: futures<4.0.0,>=3.2.0 in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from apache-beam==2.15.0.dev0) (3.3.0) Collecting pyvcf<0.7.0,>=0.6.8 (from apache-beam==2.15.0.dev0) Collecting typing<3.7.0,>=3.6.0 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/cc/3e/29f92b7aeda5b078c86d14f550bf85cff809042e3429ace7af6193c3bc9f/typing-3.6.6-py2-none-any.whl Collecting pyarrow<0.15.0,>=0.11.1 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/24/54/3c6225f1ca70351338075af3a3aa3119f2f6c8175989b62eb759cc4a9e5b/pyarrow-0.14.1-cp27-cp27mu-manylinux2010_x86_64.whl Collecting cachetools<4,>=3.1.0 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/2f/a6/30b0a0bef12283e83e58c1d6e7b5aabc7acfc4110df81a4471655d33e704/cachetools-3.1.1-py2.py3-none-any.whl Collecting google-apitools<0.5.29,>=0.5.28 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/07/5e/3e04cb66f5ced9267a854184bb09863d85d199646ea8480fee26b4313a00/google_apitools-0.5.28-py2-none-any.whl Collecting google-cloud-datastore<1.8.0,>=1.7.1 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/d0/aa/29cbcf8cf7d08ce2d55b9dce858f7c632b434cb6451bed17cb4275804217/google_cloud_datastore-1.7.4-py2.py3-none-any.whl Collecting google-cloud-pubsub<0.40.0,>=0.39.0 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/c0/9a/4455b1c1450e9b912855b58ca6eee7a27ff1e9b52e4d98c243d93256f469/google_cloud_pubsub-0.39.1-py2.py3-none-any.whl Collecting google-cloud-bigquery<1.7.0,>=1.6.0 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/b7/1b/2b95f2fefddbbece38110712c225bfb5649206f4056445653bd5ca4dc86d/google_cloud_bigquery-1.6.1-py2.py3-none-any.whl Collecting google-cloud-core<0.30.0,>=0.28.1 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/0c/f2/3c225e7a69cb27d283b68bff867722bd066bc1858611180197f711815ea5/google_cloud_core-0.29.1-py2.py3-none-any.whl Collecting google-cloud-bigtable<0.33.0,>=0.31.1 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/08/77/b468e209dbb0a6f614e6781f06a4894299a4c6167c2c525cc086caa7c075/google_cloud_bigtable-0.32.2-py2.py3-none-any.whl Collecting proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 (from apache-beam==2.15.0.dev0) Collecting googledatastore<7.1,>=7.0.1 (from apache-beam==2.15.0.dev0) Collecting nose>=1.3.7 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl Collecting nose_xunitmp>=0.4.1 (from apache-beam==2.15.0.dev0) Collecting numpy<2,>=1.14.3 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/1f/c7/198496417c9c2f6226616cff7dedf2115a4f4d0276613bab842ec8ac1e23/numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl Collecting pandas<0.24,>=0.23.4 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/b7/e3/f52d484244105fa3d558ce8217a5190cd3d40536076bef66d92d01566325/pandas-0.23.4-cp27-cp27mu-manylinux1_x86_64.whl Collecting parameterized<0.7.0,>=0.6.0 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/3a/49/75f6dadb09e2f8ace3cdffe0c99a04f1b98dff41fbf9e768665d8b469e29/parameterized-0.6.3-py2.py3-none-any.whl Collecting pyhamcrest<2.0,>=1.9 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/9a/d5/d37fd731b7d0e91afcc84577edeccf4638b4f9b82f5ffe2f8b62e2ddc609/PyHamcrest-1.9.0-py2.py3-none-any.whl Collecting tenacity<6.0,>=5.0.2 (from apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/6a/93/dfcf5b1b46ab29196274b78dcba69fab5e54b6dc303a7eed90a79194d277/tenacity-5.0.4-py2.py3-none-any.whl Requirement already satisfied: six>=1.5.2 in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.15.0.dev0) (1.12.0) Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.15.0.dev0) (1.1.6) Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.15.0.dev0) Collecting requests>=2.7.0 (from hdfs<3.0.0,>=2.1.0->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/8b/67/bb6fe2e2c66585acb4dd2b57f50c8db65848f737f63b04cb35f0627bce5e/pbr-5.4.1-py2.py3-none-any.whl Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl Collecting pyasn1>=0.1.7 (from oauth2client<4,>=2.0.1->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl Collecting pyasn1-modules>=0.0.5 (from oauth2client<4,>=2.0.1->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/91/f0/b03e00ce9fddf4827c42df1c3ce10c74eadebfb706231e8d6d1c356a4062/pyasn1_modules-0.2.5-py2.py3-none-any.whl Collecting rsa>=3.1.4 (from oauth2client<4,>=2.0.1->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.15.0.dev0) (41.0.1) Collecting pyparsing>=2.1.4 (from pydot<2,>=1.2.0->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/dd/d9/3ec19e966301a6e25769976999bd7bbe552016f0d32b577dc9d63d2e0c49/pyparsing-2.4.0-py2.py3-none-any.whl Collecting fasteners>=0.14 (from google-apitools<0.5.29,>=0.5.28->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/18/bd/55eb2d6397b9c0e263af9d091ebdb756b15756029b3cededf6461481bc63/fasteners-0.15-py2.py3-none-any.whl Collecting google-api-core[grpc]<2.0.0dev,>=1.6.0 (from google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/5b/3e/48b8ee54f24fd8d5d274bcf642857399f074310032a244353419fc5774b7/google_api_core-1.14.0-py2.py3-none-any.whl Collecting grpc-google-iam-v1<0.12dev,>=0.11.4 (from google-cloud-pubsub<0.40.0,>=0.39.0->apache-beam==2.15.0.dev0) Collecting google-resumable-media>=0.2.1 (from google-cloud-bigquery<1.7.0,>=1.6.0->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/e2/5d/4bc5c28c252a62efe69ed1a1561da92bd5af8eca0cdcdf8e60354fae9b29/google_resumable_media-0.3.2-py2.py3-none-any.whl Collecting googleapis-common-protos<2.0dev,>=1.5.2 (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.15.0.dev0) Collecting python-dateutil>=2.5.0 (from pandas<0.24,>=0.23.4->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl Collecting monotonic>=0.6; python_version == "2.7" (from tenacity<6.0,>=5.0.2->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/69/1b/b853c7a9d4f6a6d00749e94eb6f3a041e342a885b87340b79c1ef73e3a78/certifi-2019.6.16-py2.py3-none-any.whl Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl Collecting idna<2.9,>=2.5 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.15.0.dev0) Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl Installing collected packages: crcmod, dill, fastavro, docopt, urllib3, certifi, chardet, idna, requests, hdfs, httplib2, pbr, funcsigs, mock, pymongo, pyasn1, pyasn1-modules, rsa, oauth2client, pyparsing, pydot, pytz, pyyaml, avro, pyvcf, typing, numpy, pyarrow, cachetools, monotonic, fasteners, google-apitools, googleapis-common-protos, google-auth, google-api-core, google-cloud-core, google-cloud-datastore, grpc-google-iam-v1, google-cloud-pubsub, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable, proto-google-cloud-datastore-v1, googledatastore, nose, nose-xunitmp, python-dateutil, pandas, parameterized, pyhamcrest, tenacity, apache-beam Running setup.py develop for apache-beam Successfully installed apache-beam avro-1.9.0 cachetools-3.1.1 certifi-2019.6.16 chardet-3.0.4 crcmod-1.7 dill-0.2.9 docopt-0.6.2 fastavro-0.21.24 fasteners-0.15 funcsigs-1.0.2 google-api-core-1.14.0 google-apitools-0.5.28 google-auth-1.6.3 google-cloud-bigquery-1.6.1 google-cloud-bigtable-0.32.2 google-cloud-core-0.29.1 google-cloud-datastore-1.7.4 google-cloud-pubsub-0.39.1 google-resumable-media-0.3.2 googleapis-common-protos-1.6.0 googledatastore-7.0.2 grpc-google-iam-v1-0.11.4 hdfs-2.5.8 httplib2-0.12.0 idna-2.8 mock-2.0.0 monotonic-1.5 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.16.4 oauth2client-3.0.0 pandas-0.23.4 parameterized-0.6.3 pbr-5.4.1 proto-google-cloud-datastore-v1-0.90.4 pyarrow-0.14.1 pyasn1-0.4.5 pyasn1-modules-0.2.5 pydot-1.4.1 pyhamcrest-1.9.0 pymongo-3.8.0 pyparsing-2.4.0 python-dateutil-2.8.0 pytz-2019.1 pyvcf-0.6.8 pyyaml-3.13 requests-2.22.0 rsa-4.0 tenacity-5.0.4 typing-3.6.6 urllib3-1.25.3 :sdks:python:installGcpTest (Thread[Execution worker for ':',5,main]) completed. Took 21.499 secs. :sdks:python:integrationTest (Thread[Execution worker for ':',5,main]) started. > Task :sdks:python:integrationTest Caching disabled for task ':sdks:python:integrationTest': Caching has not been enabled for the task Task ':sdks:python:integrationTest' is not up-to-date because: Task has not declared any outputs despite executing actions. Custom actions are attached to task ':sdks:python:integrationTest'. Starting process 'command 'sh''. Working directory: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python> Command: sh -c . <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/build/gradleenv/1922375555/bin/activate> && <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/scripts/run_integration_test.sh> --test_opts "--tests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --attr=IT --nocapture" --pipeline_opts "--project=apache-beam-testing --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it --input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000* --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output --expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710 --num_workers=10 --autoscaling_algorithm=NONE --runner=TestDataflowRunner --sdk_location=build/apache-beam.tar.gz" --suite integrationTest-perf Successfully started process 'command 'sh'' >>> RUNNING integration tests with pipeline options: >>> --project=apache-beam-testing >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000* >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710 --num_workers=10 >>> --autoscaling_algorithm=NONE --runner=TestDataflowRunner >>> --sdk_location=build/apache-beam.tar.gz >>> test options: >>> --tests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it >>> --attr=IT --nocapture running nosetests running egg_info writing requirements to apache_beam.egg-info/requires.txt writing apache_beam.egg-info/PKG-INFO writing top-level names to apache_beam.egg-info/top_level.txt writing dependency_links to apache_beam.egg-info/dependency_links.txt writing entry points to apache_beam.egg-info/entry_points.txt reading manifest file 'apache_beam.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' writing manifest file 'apache_beam.egg-info/SOURCES.txt' STDERR: DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:472: UserWarning: Normalizing '2.15.0.dev' to '2.15.0.dev0' normalized_version, beam_fn_api.proto: warning: Import google/protobuf/descriptor.proto but not used. beam_fn_api.proto: warning: Import google/protobuf/wrappers.proto but not used. DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt RefactoringTool: Skipping optional fixer: idioms root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt RefactoringTool: Skipping optional fixer: ws_comma root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt RefactoringTool: No changes to <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: No changes to <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: No changes to <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: No changes to <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> RefactoringTool: Files that were modified: RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/sdks/python/build/srcs/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: cmd: standard file not found: should have one of README, README.rst, README.txt, README.md DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:472: UserWarning: Normalizing '2.15.0.dev' to '2.15.0.dev0' normalized_version, warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... 2019-07-24 18:51:44,917 1f87f79c MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 841, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 690, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2019-07-24 18:51:44,919 1f87f79c MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2019-07-24 18:51:44,923 1f87f79c MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 984, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 841, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 690, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2019-07-24 18:51:44,929 1f87f79c MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2019-07-24 18:51:44,930 1f87f79c MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2019-07-24 18:51:44,930 1f87f79c MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/runs/1f87f79c/pkb.log> 2019-07-24 18:51:44,931 1f87f79c MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/ws/runs/1f87f79c/completion_statuses.json> Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
