See <https://builds.apache.org/job/beam_PerformanceTests_JDBC/704/display/redirect?page=changes>
Changes: [kenn] Make BeamSqlExpression for operators, use it for string operators ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam11 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 33bc9e714396186a882487c1feeb042196210b9a (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 33bc9e714396186a882487c1feeb042196210b9a Commit message: "Merge pull request #5433: [BEAM-4365] Make BeamSqlExpression for operators, use it for string operators" > git rev-list --no-walk c8acf0f7408f7ac3c26c2ecb06ba974c5ebdecd6 # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins6745879158418020509.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"] Fetching cluster endpoint and auth data. DEBUG: Saved kubeconfig to /home/jenkins/.kube/config kubeconfig entry generated for io-datastores. INFO: Display format "default". DEBUG: SDK update checks are disabled. [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins6214506234835273963.sh + cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/config-beam-performancetests-jdbc-704> [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins6427838908665685690.sh + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/config-beam-performancetests-jdbc-704> create namespace beam-performancetests-jdbc-704 namespace "beam-performancetests-jdbc-704" created [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins8140313221111929889.sh ++ kubectl config current-context + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/config-beam-performancetests-jdbc-704> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-jdbc-704 Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified. [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins3760170008705359955.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins8154328975761570633.sh + rm -rf .env [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins9064855107244943231.sh + virtualenv .env --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.env/bin/python2> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.env/bin/python> Installing setuptools, pkg_resources, pip, wheel...done. Running virtualenv with interpreter /usr/bin/python2 [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins8973130272069108210.sh + .env/bin/pip install --upgrade setuptools pip Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages (39.2.0) Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages (10.0.1) [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins8091608103979107708.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git Cloning into 'PerfKitBenchmarker'... [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins6012401628844036394.sh + .env/bin/pip install -r PerfKitBenchmarker/requirements.txt Collecting absl-py (from -r PerfKitBenchmarker/requirements.txt (line 14)) Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15)) (2.10) Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16)) (39.2.0) Collecting colorlog[windows]==2.6.0 (from -r PerfKitBenchmarker/requirements.txt (line 17)) Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl Collecting blinker>=1.3 (from -r PerfKitBenchmarker/requirements.txt (line 18)) Collecting futures>=3.0.3 (from -r PerfKitBenchmarker/requirements.txt (line 19)) Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20)) (3.12) Collecting pint>=0.7 (from -r PerfKitBenchmarker/requirements.txt (line 21)) Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22)) Using cached https://files.pythonhosted.org/packages/eb/be/737f3df5806192ac4096e549e48c8c76cfaa2fb880a1c62a7bb085adaa9b/numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23)) (3.2.3.post2) Collecting contextlib2>=0.5.1 (from -r PerfKitBenchmarker/requirements.txt (line 24)) Using cached https://files.pythonhosted.org/packages/a2/71/8273a7eeed0aff6a854237ab5453bc9aa67deb49df4832801c21f0ff3782/contextlib2-0.5.5-py2.py3-none-any.whl Collecting pywinrm (from -r PerfKitBenchmarker/requirements.txt (line 25)) Using cached https://files.pythonhosted.org/packages/0d/12/13a3117bbd2230043aa32dcfa2198c33269665eaa1a8fa26174ce49b338f/pywinrm-0.3.0-py2.py3-none-any.whl Collecting timeout-decorator (from -r PerfKitBenchmarker/requirements.txt (line 26)) Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14)) (1.11.0) Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15)) (1.0) Collecting colorama; extra == "windows" (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17)) Using cached https://files.pythonhosted.org/packages/db/c8/7dcf9dbcb22429512708fe3a547f8b6101c0d02137acbd892505aee57adf/colorama-0.3.9-py2.py3-none-any.whl Collecting requests-ntlm>=0.3.0 (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached https://files.pythonhosted.org/packages/03/4b/8b9a1afde8072c4d5710d9fa91433d504325821b038e00237dc8d6d833dc/requests_ntlm-1.1.0-py2.py3-none-any.whl Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (2.18.4) Collecting xmltodict (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached https://files.pythonhosted.org/packages/42/a9/7e99652c6bc619d19d58cdd8c47560730eb5825d43a7e25db2e1d776ceb7/xmltodict-0.11.0-py2.py3-none-any.whl Requirement already satisfied: cryptography>=1.3 in /usr/local/lib/python2.7/dist-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (2.2.2) Collecting ntlm-auth>=1.0.2 (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) Using cached https://files.pythonhosted.org/packages/8e/5b/4047779fb456b0de503c4acb7b166becf2567efb772abb53998440791d3c/ntlm_auth-1.2.0-py2.py3-none-any.whl Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (2018.4.16) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (3.0.4) Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (2.6) Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (1.22) Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (1.11.5) Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (1.1.6) Requirement already satisfied: asn1crypto>=0.21.0 in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (0.24.0) Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (1.0.22) Requirement already satisfied: pycparser in /usr/local/lib/python2.7/dist-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25)) (2.18) Installing collected packages: absl-py, colorama, colorlog, blinker, futures, pint, numpy, contextlib2, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator Successfully installed absl-py-0.2.2 blinker-1.4 colorama-0.3.9 colorlog-2.6.0 contextlib2-0.5.5 futures-3.2.0 ntlm-auth-1.2.0 numpy-1.13.3 pint-0.8.1 pywinrm-0.3.0 requests-ntlm-1.1.0 timeout-decorator-0.4.0 xmltodict-0.11.0 [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins6563254603839295489.sh + .env/bin/pip install -e 'src/sdks/python/[gcp,test]' Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/python> Complete output from command python setup.py egg_info: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.6.0.dev' to '2.6.0.dev0' normalized_version, running egg_info gen_protos.py:49: UserWarning: Installing grpcio-tools is recommended for development. warnings.warn('Installing grpcio-tools is recommended for development.') WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/python/.eggs/grpcio-wheels> Collecting grpcio-tools<2,>=1.3.5 Using cached https://files.pythonhosted.org/packages/5f/aa/4df5b2810825bce6f1263c0e0fc2f07c7bdb1c4d9383a137f1fd64cd9962/grpcio_tools-1.12.1-cp27-cp27mu-manylinux1_x86_64.whl Collecting grpcio>=1.12.1 (from grpcio-tools<2,>=1.3.5) Could not find a version that satisfies the requirement grpcio>=1.12.1 (from grpcio-tools<2,>=1.3.5) (from versions: ) No matching distribution found for grpcio>=1.12.1 (from grpcio-tools<2,>=1.3.5) Process Process-1: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap self.run() File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run self._target(*self._args, **self._kwargs) File "gen_protos.py", line 141, in _install_grpcio_tools_and_generate_proto_files '--upgrade', GRPC_TOOLS]) File "/usr/lib/python2.7/subprocess.py", line 541, in check_call raise CalledProcessError(retcode, cmd) CalledProcessError: Command '['<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.env/bin/python2',> '-m', 'pip', 'install', '--target', '<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/python/.eggs/grpcio-wheels',> '--build', '<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/python/.eggs/grpcio-wheels-build',> '--upgrade', 'grpcio-tools>=1.3.5,<2']' returned non-zero exit status 1 Traceback (most recent call last): File "<string>", line 1, in <module> File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/python/setup.py";,> line 209, in <module> 'test': generate_protos_first(test), File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.env/local/lib/python2.7/site-packages/setuptools/__init__.py";,> line 129, in setup return distutils.core.setup(**attrs) File "/usr/lib/python2.7/distutils/core.py", line 151, in setup dist.run_commands() File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands self.run_command(cmd) File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command cmd_obj.run() File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/python/setup.py";,> line 143, in run gen_protos.generate_proto_files() File "gen_protos.py", line 95, in generate_proto_files raise ValueError("Proto generation failed (see log for details).") ValueError: Proto generation failed (see log for details). ---------------------------------------- Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/python/> Build step 'Execute shell' marked build as failure
