See <https://ci-beam.apache.org/job/beam_Metrics_Report/77/display/redirect?page=changes>
Changes: [rogelio.hernandez] [BEAM-13051] Pylint misplaced-bare-raise warning enabled [Jeff Tapper] Update Java LTS roadmap info on website for Java 17 [Kyle Weaver] [BEAM-12712] Spark: Exclude looping timer tests. [Kyle Weaver] [BEAM-13919] Annotate PerKeyOrderingTest with UsesStatefulParDo. [Pablo Estrada] Simplify README for new users [noreply] Update 2.36.0 blog post to mention ARM64 support [stranniknm] [BEAM-13785] playground - enable scio sdk [noreply] Minor: Disable checker framework in nightly snapshot (#16829) [artur.khanin] Updated example link [noreply] [BEAM-13860] Make `DoFn.infer_output_type` return element type (#16788) [noreply] [BEAM-13894] Unit test utilities in the ptest package (#16830) [Kenneth Knowles] Add test for processing time continuation trigger [Kyle Weaver] [BEAM-13106] Support Flink 1.14. [Kyle Weaver] [BEAM-13106] Reuse executor instead of shutting it down mid-test. [Kyle Weaver] [BEAM-13106] Prevent infinite wait in Flink savepoint test. [noreply] [BEAM-13922] [Coverage] Make boot.go more testable and add tests [noreply] Exclude SpannerChangeStream IT from Dataflow V1 postcommit (#16851) [noreply] [BEAM-13930] Address StateSpec consistency issue between Runner and Fn [Ismaël Mejía] [BEAM-13202] Fix typos on tests names for VarianceFnTest [mattcasters] [BEAM-13854] Document casting trick for Avro value serializer in KafkaIO [Kenneth Knowles] Disable AfterSynchronizedProcessingTime test on Dataflow [Ismaël Mejía] [BEAM-13202] Add Coder to CountIfFn.Accum [Ismaël Mejía] [BEAM-13202] Reuse Count transform code since CountIf is a specific case [noreply] Merge pull request #16838 from [BEAM-13931] - make sure large rows cause [Kenneth Knowles] Add test category UsesProcessingTimeTimers [Kenneth Knowles] Label tests that need UsesProcessingTimeTimers [Kenneth Knowles] Exclude UsesProcessingTimeTimers from SamzaRunner tests [noreply] Seznam Case Study (#16825) [noreply] [Website] Apache Hop Case Study (#16824) [noreply] [BEAM-13694] Force hadoop-hdfs-client in hadoopVersion tests for hdfs [noreply] [Website] Ricardo - added case study feedback (#16807) [noreply] Merge pull request #16735 from [BEAM-13827] - fix medium file size [Kyle Weaver] [BEAM-13106] A couple additional fixes to FlinkSavepointTest. [noreply] Merge pull request #16753 from [BEAM-13837] [Playground] show graph on [mmack] [adhoc] Migrate KinesisIOIT to use ITEnvironment for Localstack based IT [rogelio.hernandez] [BEAM-13051] Added descriptions to Kinesis and PortableRunner exceptions [noreply] [BEAM-13955] Fix pylint breakage from #16836 (#16867) [relax] Fix TableRow conversion for the case of fields named "f" [noreply] Bump dataflow.fnapi_container_version (#16874) [mmack] [BEAM-13563] Introducing common AWS ClientBuilderFactory to unify [laraschmidt] Fix final allowskew error to properly handle a large allowedSkew [noreply] Case studies page improvements (#16702) [noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on [noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774) [thiagotnunes] fix: fix bug when retrieving either string or json [noreply] [adhoc] Avoid using SerializablePipelineOptions for testing to minimize [noreply] [BEAM-13812] Integrate DataprocClusterManager into Interactive [noreply] [BEAM-12572] Fix failing python examples tests in Dataflow runner [noreply] Remove build status from PR (#16902) ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-7 (beam) in workspace <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 1c579f9524a35bcf9a3a7b758359c8f7aeabf5fe (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 1c579f9524a35bcf9a3a7b758359c8f7aeabf5fe # timeout=10 Commit message: "Remove build status from PR (#16902)" > git rev-list --no-walk 84353a7c973d3acaaa56d81c265dce7193a56be5 # timeout=10 No emails were triggered. No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PinfluxDb=beam_test_metrics -PinfluxHost=10.128.0.96 -PinfluxPort=8086 :beam-test-jenkins:generateMetricsReport Starting a Gradle Daemon, 2 busy Daemons could not be reused, use --status for details Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build > Task :beam-test-jenkins:setupVirtualenv Collecting pip Using cached pip-22.0.3-py3-none-any.whl (2.1 MB) Installing collected packages: pip Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Successfully installed pip-22.0.3 Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/build/gradleenv/-1871197473/lib/python3.8/site-packages> (from -r <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/sdks/python/build-requirements.txt> (line 20)) (44.0.0) Collecting setuptools Using cached setuptools-60.9.3-py3-none-any.whl (1.1 MB) Collecting wheel>=0.36.0 Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.13.1-py2.py3-none-any.whl (8.6 MB) Collecting filelock>=3.0.0 Using cached filelock-3.6.0-py3-none-any.whl (10.0 kB) Collecting six>=1.14.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting packaging>=14 Using cached packaging-21.3-py3-none-any.whl (40 kB) Collecting grpcio>=1.37.0 Using cached grpcio-1.44.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.3 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.19.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB) Collecting pyparsing!=3.0.5,>=2.0.2 Using cached pyparsing-3.0.7-py3-none-any.whl (98 kB) Collecting platformdirs<3,>=2 Using cached platformdirs-2.5.1-py3-none-any.whl (14 kB) Installing collected packages: distlib, wheel, toml, six, setuptools, pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging, mypy-protobuf, grpcio, tox, grpcio-tools Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed distlib-0.3.1 filelock-3.6.0 grpcio-1.44.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.1 pluggy-1.0.0 protobuf-3.19.4 py-1.11.0 pyparsing-3.0.7 setuptools-60.9.3 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.13.1 wheel-0.37.1 > Task :beam-test-jenkins:generateMetricsReport py38-test create: <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-test> py38-test installdeps: -rrequirements.txt py38-test installed: certifi==2021.10.8,charset-normalizer==2.0.12,idna==3.3,influxdb==5.3.0,Jinja2==2.11.3,MarkupSafe==2.1.0,msgpack==0.6.1,prettytable==0.7.2,python-dateutil==2.8.2,pytz==2021.3,requests==2.27.1,six==1.16.0,urllib3==1.26.8 py38-test run-test-pre: PYTHONHASHSEED='2883493726' py38-test run-test-pre: commands[0] | python --version Python 3.8.10 py38-test run-test-pre: commands[1] | pip --version pip 22.0.3 from <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-test/lib/python3.8/site-packages/pip> (python 3.8) py38-test run-test-pre: commands[2] | pip check No broken requirements found. py38-test run-test: commands[0] | python -m unittest dashboards_parser.py ... ---------------------------------------------------------------------- Ran 3 tests in 0.001s OK ___________________________________ summary ____________________________________ py38-test: commands succeeded congratulations :) py38-generate-report create: <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report> py38-generate-report installdeps: -rrequirements.txt py38-generate-report installed: certifi==2021.10.8,charset-normalizer==2.0.12,idna==3.3,influxdb==5.3.0,Jinja2==2.11.3,MarkupSafe==2.1.0,msgpack==0.6.1,prettytable==0.7.2,python-dateutil==2.8.2,pytz==2021.3,requests==2.27.1,six==1.16.0,urllib3==1.26.8 py38-generate-report run-test-pre: PYTHONHASHSEED='3754339354' py38-generate-report run-test-pre: commands[0] | python --version Python 3.8.10 py38-generate-report run-test-pre: commands[1] | pip --version pip 22.0.3 from <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/pip> (python 3.8) py38-generate-report run-test-pre: commands[2] | pip check No broken requirements found. py38-generate-report run-test: commands[0] | python report_generator.py --influx-db=beam_test_metrics --influx-host=10.128.0.96 --influx-port=8086 --output-file=<https://ci-beam.apache.org/job/beam_Metrics_Report/77/artifact/src/.test-infra/jenkins/metrics_report/beam-metrics_report.html> Traceback (most recent call last): File "report_generator.py", line 23, in <module> import jinja2 File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/__init__.py";,> line 12, in <module> from .environment import Environment File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/environment.py";,> line 25, in <module> from .defaults import BLOCK_END_STRING File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/defaults.py";,> line 3, in <module> from .filters import FILTERS as DEFAULT_FILTERS # noqa: F401 File "<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/jinja2/filters.py";,> line 13, in <module> from markupsafe import soft_unicode ImportError: cannot import name 'soft_unicode' from 'markupsafe' (<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/lib/python3.8/site-packages/markupsafe/__init__.py)> ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/metrics_report/.tox/py38-generate-report/bin/python> report_generator.py --influx-db=beam_test_metrics --influx-host=10.128.0.96 --influx-port=8086 --output-file=<https://ci-beam.apache.org/job/beam_Metrics_Report/77/artifact/src/.test-infra/jenkins/metrics_report/beam-metrics_report.html> (exited with code 1) ___________________________________ summary ____________________________________ ERROR: py38-generate-report: commands failed > Task :beam-test-jenkins:generateMetricsReport FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_Metrics_Report/ws/src/.test-infra/jenkins/build.gradle'> line: 44 * What went wrong: Execution failed for task ':beam-test-jenkins:generateMetricsReport'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 1m 26s 12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/s7mspnh4evdte Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
