See <https://builds.apache.org/job/beam_PerformanceTests_Analysis/6/display/redirect>
------------------------------------------ GitHub pull request #5180 of commit a37f5e8e376216faaaf481b91e09b15182865efa, no merge conflicts. Setting status of a37f5e8e376216faaaf481b91e09b15182865efa to PENDING with url https://builds.apache.org/job/beam_PerformanceTests_Analysis/6/ and message: 'Build started sha1 is merged.' Using context: Jenkins: Performance Tests Analysis [EnvInject] - Loading node environment variables. Building remotely on beam6 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/5180/*:refs/remotes/origin/pr/5180/* > git rev-parse refs/remotes/origin/pr/5180/merge^{commit} # timeout=10 > git rev-parse refs/remotes/origin/origin/pr/5180/merge^{commit} # timeout=10 Checking out Revision 11975ed957c1b4b23165547c567a5c8955144215 (refs/remotes/origin/pr/5180/merge) > git config core.sparsecheckout # timeout=10 > git checkout -f 11975ed957c1b4b23165547c567a5c8955144215 Commit message: "Merge a37f5e8e376216faaaf481b91e09b15182865efa into 07f2a45c686ef0ae829849a77bd0622be6dd7ec8" First time build. Skipping changelog. Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins2611686208244579334.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins4311147685906551666.sh + rm -rf .env [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins9042333626816366100.sh + virtualenv .env --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python> Installing setuptools, pip, wheel...done. [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins2193950406693621331.sh + .env/bin/pip install --upgrade setuptools pip Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages (39.0.1) Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages (10.0.1) cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed. [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins7979391923458059247.sh + .env/bin/pip install requests google.cloud.bigquery Requirement already satisfied: requests in /home/jenkins/.local/lib/python2.7/site-packages (2.18.1) Collecting google.cloud.bigquery <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings SNIMissingWarning <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecurePlatformWarning Using cached https://files.pythonhosted.org/packages/4d/7e/d47392a7449411b7e4f8c95a32c29f5c9808fa7a7111ab302fec773fa86d/google_cloud_bigquery-1.1.0-py2.py3-none-any.whl Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests) (2.5) Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests) (1.21.1) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests) (3.0.4) Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests) (2017.4.17) Collecting google-cloud-core<0.29dev,>=0.28.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/0f/41/ae2418b4003a14cf21c1c46d61d1b044bf02cf0f8f91598af572b9216515/google_cloud_core-0.28.1-py2.py3-none-any.whl Collecting google-api-core<2.0.0dev,>=1.0.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/e3/39/b082c5bd0095d2baf6638338b66c5b6d2e8e372f605a1a85f33c0abe5533/google_api_core-1.1.1-py2.py3-none-any.whl Collecting google-resumable-media>=0.2.1 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/77/95/2e4020a54366423ddba715f89fb7ca456c8f048b15cada6cd6a54cf10e8c/google_resumable_media-0.3.1-py2.py3-none-any.whl Collecting googleapis-common-protos<2.0dev,>=1.5.3 (from google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) Collecting pytz (from google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/dc/83/15f7833b70d3e067ca91467ca245bae0f6fe56ddc7451aa0dc5606b120f2/pytz-2018.4-py2.py3-none-any.whl Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (1.0.1) Collecting futures>=3.2.0; python_version < "3.2" (from google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl Requirement already satisfied: protobuf>=3.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (3.5.1) Requirement already satisfied: six>=1.10.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (1.11.0) Requirement already satisfied: setuptools>=34.0.0 in ./.env/lib/python2.7/site-packages (from google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (39.0.1) Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (2.0.0) Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (3.4.2) Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (0.0.9) Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.0.0->google.cloud.bigquery) (0.2.3) cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed. google-cloud-pubsub 0.26.0 has requirement google-cloud-core<0.26dev,>=0.25.0, but you'll have google-cloud-core 0.28.1 which is incompatible. Installing collected packages: googleapis-common-protos, pytz, futures, google-api-core, google-cloud-core, google-resumable-media, google.cloud.bigquery Found existing installation: googleapis-common-protos 1.5.2 Not uninstalling googleapis-common-protos at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env> Can't uninstall 'googleapis-common-protos'. No files were found to uninstall. Found existing installation: futures 3.1.1 Not uninstalling futures at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env> Can't uninstall 'futures'. No files were found to uninstall. Found existing installation: google-cloud-core 0.25.0 Not uninstalling google-cloud-core at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env> Can't uninstall 'google-cloud-core'. No files were found to uninstall. Successfully installed futures-3.2.0 google-api-core-1.1.1 google-cloud-core-0.28.1 google-resumable-media-0.3.1 google.cloud.bigquery googleapis-common-protos-1.5.3 pytz-2018.4 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins5608881351585730239.sh + .env/bin/python src/.test-infra/jenkins/verify_performance_test_results.py --bqtable '[beam_performance.textioit_pkb_results, beam_performance.compressed_textioit_pkb_results, beam_performance.avroioit_pkb_results, beam_performance.tfrecordioit_pkb_results, beam_performance.xmlioit_pkb_results, beam_performance.textioit_hdfs_pkb_results, beam_performance.compressed_textioit_hdfs_pkb_results, beam_performance.avroioit_hdfs_pkb_results, beam_performance.xmlioit_hdfs_pkb_results, beam_performance.hadoopinputformatioit_pkb_results, beam_performance.mongodbioit_pkb_results, beam_performance.jdbcioit_pkb_results]' --metric=run_time --mode=report /home/jenkins/.local/lib/python2.7/site-packages/urllib3/util/ssl_.py:335: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings SNIMissingWarning /home/jenkins/.local/lib/python2.7/site-packages/urllib3/util/ssl_.py:133: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecurePlatformWarning Number of records inserted into beam_performance.textioit_pkb_results between 23-04-2018_09-22-20 - 24-04-2018_09-22-20: 3 Number of records inserted into beam_performance.textioit_pkb_results between 17-04-2018_09-22-20 - 23-04-2018_09-22-20: 18 Number of records inserted into beam_performance.compressed_textioit_pkb_results between 23-04-2018_09-22-20 - 24-04-2018_09-22-20: 3 Number of records inserted into beam_performance.compressed_textioit_pkb_results between 17-04-2018_09-22-20 - 23-04-2018_09-22-20: 22 Number of records inserted into beam_performance.avroioit_pkb_results between 23-04-2018_09-22-20 - 24-04-2018_09-22-20: 3 Number of records inserted into beam_performance.avroioit_pkb_results between 17-04-2018_09-22-20 - 23-04-2018_09-22-20: 18 Number of records inserted into beam_performance.tfrecordioit_pkb_results between 23-04-2018_09-22-20 - 24-04-2018_09-22-20: 4 Number of records inserted into beam_performance.tfrecordioit_pkb_results between 17-04-2018_09-22-20 - 23-04-2018_09-22-20: 21 Number of records inserted into beam_performance.xmlioit_pkb_results between 23-04-2018_09-22-20 - 24-04-2018_09-22-20: 4 Number of records inserted into beam_performance.xmlioit_pkb_results between 17-04-2018_09-22-20 - 23-04-2018_09-22-20: 22 Number of records inserted into beam_performance.textioit_hdfs_pkb_results between 23-04-2018_09-22-20 - 24-04-2018_09-22-20: 1 Number of records inserted into beam_performance.textioit_hdfs_pkb_results between 17-04-2018_09-22-20 - 23-04-2018_09-22-20: 20 Traceback (most recent call last): File "src/.test-infra/jenkins/verify_performance_test_results.py", line 240, in <module> create_report(bqtables) File "src/.test-infra/jenkins/verify_performance_test_results.py", line 150, in create_report bq_table_name, metric, average_recent, percentage_change, stdev_recent, stdev_old) ValueError: Unknown format code 'f' for object of type 'str' Build step 'Execute shell' marked build as failure
