See <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/618/display/redirect?page=changes>
Changes: [yifanzou] [BEAM-5269] Integration tests for BigQueryIORead [yifanzou] fix on the spotless check [echauchot] [BEAM-3193] Add SparkCoGroupByKeyStreaming validates runner to test ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam10 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision a27ff2e45c9d0de8d84d22b0f59da187c138bb68 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f a27ff2e45c9d0de8d84d22b0f59da187c138bb68 Commit message: "Merge pull request #6320 from yifanzou/BEAM-5269/Migrate_BigQueryIORead_tests" > git rev-list --no-walk 4bd3386c5b0d925d03667a46d7fb85657aae36af # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8931395470728739577.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"] Fetching cluster endpoint and auth data. DEBUG: Saved kubeconfig to /home/jenkins/.kube/config kubeconfig entry generated for io-datastores. INFO: Display format "default". DEBUG: SDK update checks are disabled. [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6895067650951308324.sh + cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/config-beam-performancetests-xmlioit-hdfs-618> [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6890864064286948137.sh + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/config-beam-performancetests-xmlioit-hdfs-618> create namespace beam-performancetests-xmlioit-hdfs-618 namespace "beam-performancetests-xmlioit-hdfs-618" created [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3879587097836549920.sh ++ kubectl config current-context + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/config-beam-performancetests-xmlioit-hdfs-618> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-xmlioit-hdfs-618 Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified. [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4357676448690926389.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker> [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3905387939399035570.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env> [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins725661598153442370.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.perfkit_env> [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8440817211136962005.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env> --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/bin/python2> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/bin/python> Installing setuptools, pkg_resources, pip, wheel...done. Running virtualenv with interpreter /usr/bin/python2 [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5464933597523844041.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.perfkit_env/bin/python2> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.perfkit_env/bin/python> Installing setuptools, pkg_resources, pip, wheel...done. Running virtualenv with interpreter /usr/bin/python2 [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9061897394899925482.sh + <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5 Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0) Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0) Collecting grpcio-tools==1.3.5 Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0) Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0) Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0) Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6) Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0) Installing collected packages: grpcio-tools Successfully installed grpcio-tools-1.3.5 [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4997419262908486527.sh + <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0) Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0) [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1992968946286413244.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker> Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker'...> [beam_PerformanceTests_XmlIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins808453556610542395.sh + <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src/sdks/python/[gcp,test]'> Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src/sdks/python> Exception: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/basecommand.py";,> line 141, in main status = self.run(options, args) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/commands/install.py";,> line 299, in run resolver.resolve(requirement_set) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/resolve.py";,> line 102, in resolve self._resolve_one(requirement_set, req) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/resolve.py";,> line 256, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/resolve.py";,> line 193, in _get_abstract_dist_for req, self.require_hashes, self.use_user_site, self.finder, File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py";,> line 329, in prepare_editable_requirement req.check_if_exists(use_user_site) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/req/req_install.py";,> line 494, in check_if_exists self.req.name File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 468, in get_distribution dist = get_provider(dist) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 344, in get_provider return working_set.find(moduleOrReq) or require(str(moduleOrReq))[0] File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 888, in require needed = self.resolve(parse_requirements(requirements)) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 779, in resolve raise VersionConflict(dist, req).with_context(dependent_req) ContextualVersionConflict: (fastavro 0.19.7 (/home/jenkins/.local/lib/python2.7/site-packages), Requirement.parse('fastavro==0.21.4'), set(['apache-beam'])) Build step 'Execute shell' marked build as failure
