See <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/619/display/redirect?page=changes>
Changes: [yifanzou] [BEAM-5269] Integration tests for BigQueryIORead [yifanzou] fix on the spotless check [echauchot] [BEAM-3193] Add SparkCoGroupByKeyStreaming validates runner to test ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision a27ff2e45c9d0de8d84d22b0f59da187c138bb68 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f a27ff2e45c9d0de8d84d22b0f59da187c138bb68 Commit message: "Merge pull request #6320 from yifanzou/BEAM-5269/Migrate_BigQueryIORead_tests" > git rev-list --no-walk 4bd3386c5b0d925d03667a46d7fb85657aae36af # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6516627138676508355.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"] Fetching cluster endpoint and auth data. DEBUG: Saved kubeconfig to /home/jenkins/.kube/config kubeconfig entry generated for io-datastores. INFO: Display format "default". DEBUG: SDK update checks are disabled. [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1310783194761926579.sh + cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-619> [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8419459590841113138.sh + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-619> create namespace beam-performancetests-compressed-textioit-hdfs-619 namespace "beam-performancetests-compressed-textioit-hdfs-619" created [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7242741659407772355.sh ++ kubectl config current-context + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/config-beam-performancetests-compressed-textioit-hdfs-619> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-compressed-textioit-hdfs-619 Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified. [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins609807717551940366.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker> [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins407891787832111482.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env> [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6349927048916048408.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.perfkit_env> [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins716979121106369597.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env> --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/bin/python2> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/bin/python> Installing setuptools, pkg_resources, pip, wheel...done. Running virtualenv with interpreter /usr/bin/python2 [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1309911549717272461.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.perfkit_env/bin/python2> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.perfkit_env/bin/python> Installing setuptools, pkg_resources, pip, wheel...done. Running virtualenv with interpreter /usr/bin/python2 [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2033300178228621556.sh + <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5 Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0) Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0) Collecting grpcio-tools==1.3.5 Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0) Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0) Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0) Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6) Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0) Installing collected packages: grpcio-tools Successfully installed grpcio-tools-1.3.5 [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2024517227144370870.sh + <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0) Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0) [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7230360423177784156.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker> Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/PerfKitBenchmarker'...> [beam_PerformanceTests_Compressed_TextIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8437764565606272540.sh + <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/sdks/python/[gcp,test]'> Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/src/sdks/python> Exception: Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/basecommand.py";,> line 141, in main status = self.run(options, args) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/commands/install.py";,> line 299, in run resolver.resolve(requirement_set) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/resolve.py";,> line 102, in resolve self._resolve_one(requirement_set, req) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/resolve.py";,> line 256, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/resolve.py";,> line 193, in _get_abstract_dist_for req, self.require_hashes, self.use_user_site, self.finder, File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py";,> line 329, in prepare_editable_requirement req.check_if_exists(use_user_site) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_internal/req/req_install.py";,> line 494, in check_if_exists self.req.name File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 468, in get_distribution dist = get_provider(dist) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 344, in get_provider return working_set.find(moduleOrReq) or require(str(moduleOrReq))[0] File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 888, in require needed = self.resolve(parse_requirements(requirements)) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/pip/_vendor/pkg_resources/__init__.py";,> line 779, in resolve raise VersionConflict(dist, req).with_context(dependent_req) ContextualVersionConflict: (fastavro 0.19.7 (/home/jenkins/.local/lib/python2.7/site-packages), Requirement.parse('fastavro==0.21.4'), set(['apache-beam'])) Build step 'Execute shell' marked build as failure
