See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/9/display/redirect?page=changes>
Changes: [Moritz Mack] Keep Spark version in a single place only (BeamModulePlugin) [Andrew Pilloud] Publish Python nexmark metrics to influxdb [noreply] Issue#23599 Updated dataframe notebook [noreply] Added a missing line break. [Andrew Pilloud] Exclude nexmark from codecov, it has no tests [Robert Bradshaw] Remove numpy C API dep from public declarations. [Andrew Pilloud] Migrate nexmark to common config for cron jobs [Kiley Sok] beam-perf [Kiley Sok] fix [noreply] [GitHub Actions] - Run RC Validations Workflow (#23531) [noreply] Add workflow to update milestone on issue close (#23629) [noreply] add website page about data processing for ML (#23552) [noreply] [Go SDK] Dataframe API wrapper (#23450) [noreply] [Go SDK]: Adds Automated Python Expansion Service (#23582) [noreply] Include CombineFn's in __all__ (#23685) [noreply] Bump google.golang.org/grpc from 1.50.0 to 1.50.1 in /sdks (#23654) [noreply] [Playground][Frontend] Tags filter for Examples Catalog (#22074) [noreply] [Go SDK] Extract output coders in expandCrossLanguage (#23641) [noreply] Python 3.10 support (#23587) [noreply] Fixes #22192: Avoids nullpointer error. Preserves previous behavior. [noreply] Deflaking tests for BQ row insertions. These tests were flaky due to [noreply] Add java 11 home to jenkins test (#23708) [noreply] enable automatic expansion service (#23699) [noreply] add expansion service option (#23712) [noreply] Downgrade container cryptography version to avoid yanked version [noreply] Update portable runner test timeout (#23696) [noreply] Merge pull request #23510: Vortex multiplexing streams [noreply] Io jms fix ack message checkpoint (#22932) [noreply] [Playground] Examples CD (#23664) [noreply] Update release instructions in Python 3.10 (#23702) [noreply] Move Tensorflow Documentation (#23729) [noreply] Bump golang.org/x/text from 0.3.7 to 0.4.0 in /sdks (#23686) [noreply] Unit Content markdown styles (#23592) (#23662) [noreply] Add reopen issue command (#23733) [noreply] Add example of real time Anomaly Detection using RunInference (#23497) [noreply] Support TIMESTAMP type in BigQueryIO with BEAM_ROW output type, and in [Kenneth Knowles] Verify that secondary key coder is deterministic in SortValues [Chamikara Madhusanka Jayalath] Updating Python dependencies for the 2.43.0 release [noreply] Add PytorchBatchConverter (#23296) [noreply] Pin version to grpcio in build-requirements.txt (#23735) [noreply] Bump up python container versions. (#23716) [noreply] Reduce log flood in Python PostCommit flink task (#23635) [noreply] Speed up check on website links (#23737) [thiagotnunes] tests: fixes SpannerIO unavailable retry test [noreply] Remove yeandy from reviewers (#23753) [noreply] Revert bigdataoss version upgrade (#23727) [Chamikara Madhusanka Jayalath] Moving to 2.44.0-SNAPSHOT on master branch. [noreply] Update the timeout in ValidatesContainer suite. (#23732) [riteshghorse] fix lints [noreply] Update google cloud vision >= 2.0.0 (#23755) [noreply] Update GcsIO initialization to support converting input parameters to [noreply] Adds instructions for running the Multi-language Java quickstart from [Moritz Mack] Remove obsolete sparkRunner task from hadoop-format: not triggered, no [noreply] Remove Spark2 from Java testing projects (addresses #23728) (#23749) [noreply] bugfix/wrong-notebook-linl (#23777) [noreply] [CdapIO] Integration CdapIO with SparkReceiverIO (#22584) [noreply] Avoid Circular imports related to bigquery_schema_tools (#23731) [noreply] Use Flink 1.13 for load tests (#23767) [Kenneth Knowles] Re-enable PubsubTableProviderIT.testSQLSelectsArrayAttributes [noreply] Remove obsolete native text io translation. (#23549) [noreply] Eliminate nullness errors from GenerateSequence (#23744) [noreply] Updated ipywidgets [noreply] Add logos to case-studies "Also Used By" (#23781) [noreply] Avoid pickling unstable reference to moved proto classes. (#23739) [Robert Bradshaw] Unskip test_generated_class_pickle for cloudpickle. [Kenneth Knowles] Enable checkerframework by default [noreply] Allow local packages in requirements.txt dependency list. (#23684) [noreply] Revert "Update BQIO to a single scheduled executor service reduce [noreply] Updates Python test expansion service to use Cloud Pickle (#23786) [noreply] Merge pull request #23795: Revert 23234: issue #23794 [noreply] Merge pull request #23556: Forward failed storage-api row inserts to the [yathu] Bump dataflow java fn container version to beam-master-20221022 [noreply] Remove unnecessary dependencies from jpms test (#23775) [noreply] Use Spark 3 job-server as default Spark job-server for PortableRunner [noreply] Support usage of custom profileName with AWS ProfileCredentialsProvider [noreply] Migrate examples and maven-archetypes (including Java Quickstart) to [Moritz Mack] Update remaining pointers to Spark runner to Spark 3 module (addresses [noreply] Ignoring BigQuery partitions with empty files (#23710) [noreply] Benchmarking RunInference Example (#23554) [Kiley Sok] Increate timeout for test pipelines [noreply] Bump Dataflow python containers to 20221021 (#23807) [noreply] Allow MoreFutures.allAsList/allAsListWithExceptions to have the passed [noreply] granting ruslan shamunov triage rights (#23806) [noreply] Bump google.golang.org/api from 0.99.0 to 0.100.0 in /sdks (#23718) [noreply] Initial DaskRunner for Beam (#22421) [noreply] [Website] update PULL_REQUEST_TEMPLATE.md (#23576) [noreply] [Website] change width of the additional case studies cards (#23824) [chamikaramj] Adds a dependency to Python Multi-language library to the GCP Bom [noreply] Support keyed executors in Samza Runner to process bundles for stateful [Moritz Mack] Remove obsolete code from Spark 3 runner. [noreply] Fixing Get Started header link (#23490) [noreply] Bump cloud.google.com/go/bigquery from 1.42.0 to 1.43.0 in /sdks ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-4 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 6e395412ed4fc23f84b20a27bfd7396495c8477a (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6e395412ed4fc23f84b20a27bfd7396495c8477a # timeout=10 Commit message: "Bump cloud.google.com/go/bigquery from 1.42.0 to 1.43.0 in /sdks (#23820)" > git rev-list --no-walk fe41855c322e31dee2077d8cf3b95ad2fba85870 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SETUPTOOLS_USE_DISTUTILS=stdlib SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_SparkReceiver_IO] $ /bin/bash -xe /tmp/jenkins8107933820754869393.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a Fetching cluster endpoint and auth data. CRITICAL: ACTION REQUIRED: gke-gcloud-auth-plugin, which is needed for continued use of kubectl, was not found or is not executable. Install gke-gcloud-auth-plugin for use with kubectl by following https://cloud.google.com/blog/products/containers-kubernetes/kubectl-auth-changes-in-gke kubeconfig entry generated for io-datastores. [beam_PerformanceTests_SparkReceiver_IO] $ /bin/bash -xe /tmp/jenkins2034865232753888432.sh + cp /home/jenkins/.kube/config <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> [EnvInject] - Variables injected successfully. [beam_PerformanceTests_SparkReceiver_IO] $ /bin/bash -xe /tmp/jenkins1673360309119181014.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-performancetests-sparkreceiver-io-9 + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> + KUBERNETES_NAMESPACE=default + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> --namespace=default' + createNamespace beam-performancetests-sparkreceiver-io-9 + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> create namespace beam-performancetests-sparkreceiver-io-9' ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> create namespace beam-performancetests-sparkreceiver-io-9 namespace/beam-performancetests-sparkreceiver-io-9 created [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBERNETES_NAMESPACE=beam-performancetests-sparkreceiver-io-9 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_SparkReceiver_IO] $ /bin/bash -xe /tmp/jenkins1831701282338587607.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/.test-infra/kubernetes/rabbit/rabbitmq.yaml> + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> + KUBERNETES_NAMESPACE=beam-performancetests-sparkreceiver-io-9 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> --namespace=beam-performancetests-sparkreceiver-io-9' + apply <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/.test-infra/kubernetes/rabbit/rabbitmq.yaml> + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> --namespace=beam-performancetests-sparkreceiver-io-9 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/.test-infra/kubernetes/rabbit/rabbitmq.yaml'> ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/config-beam-performancetests-sparkreceiver-io-9> --namespace=beam-performancetests-sparkreceiver-io-9 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/.test-infra/kubernetes/rabbit/rabbitmq.yaml> error: the path "<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/.test-infra/kubernetes/rabbit/rabbitmq.yaml";> does not exist Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
