See <https://ci-beam.apache.org/job/beam_Metrics_Report/83/display/redirect?page=changes>
Changes: [brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn [vachan] Update display data to include BQ information. [Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo [bulat.safiullin] [BEAM-14164] [Website] change styles [hengfeng] feat: remove the metadata table after the pipeline finishes [thiagotnunes] test: add test for metadata table dropping [noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188) [noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184) [noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to [noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections [noreply] Only reset transform.label if it is correctly assigned (#17192) [noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth [Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic. [brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn [chamikaramj] Convert URLs to local jars when constructing filesToStage [thiagotnunes] test: disable SpannerIO.readChangeStream test [noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy [noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test [egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0 [egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x [Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on [noreply] [BEAM-13314]Revise recommendations to manage Python pipeline [noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for [noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test [noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test [noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212) [noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports [noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173) [noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang [noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test [Kiley Sok] ignore test [noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on [noreply] [BEAM-10976] Bundle finalization: E2E support (#17045) [Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field [noreply] [BEAM-14179] Fix possibly null value [noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227) [noreply] Add a portable job server that proxies the Dataflow backend. (#17189) [noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc [benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner [Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable [Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service. [Robert Bradshaw] Skip failing test for now. [Kyle Weaver] [BEAM-14225] load balance jenkins jobs [noreply] [BEAM-13951] Update release guide with pointers on updating [Kiley Sok] Update python container version [noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause [benjamin.gonzalez] [BEAM-8970] Add period to end of sentence [noreply] delint go sdk (#17247) [Heejong Lee] add test [noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by [noreply] [BEAM-14192] Update legacy container version (#17210) [noreply] Fix mishandling of API with BQIO (#17211) [noreply] [BEAM-14221] Update documentation with Flink on Dataproc features [Kyle Weaver] Add self-descriptive message for expected errors. [Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field" [noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101) [noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions [noreply] [BEAM-10529] nullable xlang coder (#16923) [noreply] Fix go fmt break in core/typex/special.go (#17266) [noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256) [noreply] Pr-bot Don't count all reviews as approvals (#17269) [noreply] Fix postcommits (#17263) [noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264) [noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do [noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229) [noreply] [BEAM-13519] Solve race issues when the server responds with an error ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 0262ee53c6018d929a8a40fdf66735cc7e934951 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 0262ee53c6018d929a8a40fdf66735cc7e934951 # timeout=10 Commit message: "[BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#17240)" > git rev-list --no-walk 34e876d0bd6953927c89fb3f1ded5f453dded55c # timeout=10 No emails were triggered. No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PinfluxDb=beam_test_metrics -PinfluxHost=10.128.0.96 -PinfluxPort=8086 :beam-test-jenkins:generateMetricsReport Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build > Task :beam-test-jenkins:setupVirtualenv Collecting pip Using cached pip-22.0.4-py3-none-any.whl (2.1 MB) Installing collected packages: pip Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Successfully installed pip-22.0.4 Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/build/gradleenv/-1871197473/lib/python3.8/site-packages> (from -r <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/sdks/python/build-requirements.txt> (line 20)) (44.0.0) Collecting setuptools Using cached setuptools-62.0.0-py3-none-any.whl (1.1 MB) Collecting wheel>=0.36.0 Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.14.0-py2.py3-none-any.whl (8.8 MB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting packaging>=14 Using cached packaging-21.3-py3-none-any.whl (40 kB) Collecting filelock>=3.0.0 Using cached filelock-3.6.0-py3-none-any.whl (10.0 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting six>=1.14.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting grpcio>=1.37.0 Using cached grpcio-1.44.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.3 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.20.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting pyparsing!=3.0.5,>=2.0.2 Using cached pyparsing-3.0.7-py3-none-any.whl (98 kB) Collecting platformdirs<3,>=2 Using cached platformdirs-2.5.1-py3-none-any.whl (14 kB) Installing collected packages: distlib, wheel, toml, six, setuptools, pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging, mypy-protobuf, grpcio, tox, grpcio-tools Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed distlib-0.3.1 filelock-3.6.0 grpcio-1.44.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.1 pluggy-1.0.0 protobuf-3.20.0 py-1.11.0 pyparsing-3.0.7 setuptools-62.0.0 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.14.0 wheel-0.37.1 > Task :beam-test-jenkins:generateMetricsReport py38-test create: <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-test> py38-test installdeps: -rrequirements.txt py38-test installed: certifi==2021.10.8,charset-normalizer==2.0.12,idna==3.3,influxdb==5.3.0,Jinja2==2.11.3,MarkupSafe==2.1.1,msgpack==0.6.1,prettytable==0.7.2,python-dateutil==2.8.2,pytz==2022.1,requests==2.27.1,six==1.16.0,urllib3==1.26.9 py38-test run-test-pre: PYTHONHASHSEED='3272509510' py38-test run-test-pre: commands[0] | python --version Python 3.8.10 py38-test run-test-pre: commands[1] | pip --version pip 22.0.4 from <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-test/lib/python3.8/site-packages/pip> (python 3.8) py38-test run-test-pre: commands[2] | pip check No broken requirements found. py38-test run-test: commands[0] | python -m unittest dashboards_parser.py ... ---------------------------------------------------------------------- Ran 3 tests in 0.001s OK ___________________________________ summary ____________________________________ py38-test: commands succeeded congratulations :) py38-generate-report create: <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report> py38-generate-report installdeps: -rrequirements.txt py38-generate-report installed: certifi==2021.10.8,charset-normalizer==2.0.12,idna==3.3,influxdb==5.3.0,Jinja2==2.11.3,MarkupSafe==2.1.1,msgpack==0.6.1,prettytable==0.7.2,python-dateutil==2.8.2,pytz==2022.1,requests==2.27.1,six==1.16.0,urllib3==1.26.9 py38-generate-report run-test-pre: PYTHONHASHSEED='3666268355' py38-generate-report run-test-pre: commands[0] | python --version Python 3.8.10 py38-generate-report run-test-pre: commands[1] | pip --version pip 22.0.4 from <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/pip> (python 3.8) py38-generate-report run-test-pre: commands[2] | pip check No broken requirements found. py38-generate-report run-test: commands[0] | python report_generator.py --influx-db=beam_test_metrics --influx-host=10.128.0.96 --influx-port=8086 --output-file=<https://ci-beam.apache.org/job/beam_Metrics_Report/83/artifact/src/.test-infra/jenkins/metrics_report/beam-metrics_report.html> Traceback (most recent call last): File "report_generator.py", line 23, in <module> import jinja2 File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/__init__.py";,> line 12, in <module> from .environment import Environment File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/environment.py";,> line 25, in <module> from .defaults import BLOCK_END_STRING File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/defaults.py";,> line 3, in <module> from .filters import FILTERS as DEFAULT_FILTERS # noqa: F401 File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/filters.py";,> line 13, in <module> from markupsafe import soft_unicode ImportError: cannot import name 'soft_unicode' from 'markupsafe' (<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/markupsafe/__init__.py)> ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/bin/python> report_generator.py --influx-db=beam_test_metrics --influx-host=10.128.0.96 --influx-port=8086 --output-file=<https://ci-beam.apache.org/job/beam_Metrics_Report/83/artifact/src/.test-infra/jenkins/metrics_report/beam-metrics_report.html> (exited with code 1) ___________________________________ summary ____________________________________ ERROR: py38-generate-report: commands failed > Task :beam-test-jenkins:generateMetricsReport FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/build.gradle'> line: 44 * What went wrong: Execution failed for task ':beam-test-jenkins:generateMetricsReport'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 24s 12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/5quknl4ctyu26 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
