See <https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/814/display/redirect?page=changes>
Changes: [Brian Hulette] Extract utilities in dataframe.schemas [Brian Hulette] Add pandas_type_compatibility with pandas BatchConverter implementations [Brian Hulette] Use Batched DoFns at DataFrame API boundaries [Brian Hulette] Move dtype conversion to pandas_type_compatibility [Brian Hulette] Always register pandas BatchConverters [Brian Hulette] Fix interactive runner tests [Brian Hulette] Use pandas_type_compatibility BatchConverters for dataframe.schemas [Brian Hulette] Skip test cases broken in pandas 1.1.x [Brian Hulette] Address review comments [Brian Hulette] yapf, typo in test [noreply] Add ability to remove/clear map and set state (#22938) [Brian Hulette] Add test to reproduce https://github.com/apache/beam/issues/22854 [Brian Hulette] Exercise row coder with nested optional struct [Brian Hulette] Make RowTypeConstraint callable [Brian Hulette] Add test to exercise RowTypeConstraint.__call__ [noreply] Fix gpu to cpu conversion with warning logs (#22795) [noreply] Add Go stateful DoFns to CHANGES.md and fix linting violations (#22958) [noreply] 22805: Upgrade Jackson version from 2.13.0 to 2.13.3 (#22806) [noreply] Run cred rotation every month (#22977) [noreply] [BEAM-12164] Synchronize access queue in ThroughputEstimator and [noreply] Add some explanatory comments to the wordcount registration (#22989) [noreply] Move Go examples under the cookbook directory to generic registration [noreply] Improve BQ test utils to support JSON in a more simple manner (#22942) [noreply] [fixes #22980] Migrate BeamFnLoggingClient to the new execution state ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 2df47e7657ca2a9c3fd7b3c3fb578913d4ec4ec1 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 2df47e7657ca2a9c3fd7b3c3fb578913d4ec4ec1 # timeout=10 Commit message: "[fixes #22980] Migrate BeamFnLoggingClient to the new execution state sampler. (#22981)" > git rev-list --no-walk d615b624e9ff211e857d026d541c4d56fd18e2d3 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SETUPTOOLS_USE_DISTUTILS=stdlib SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_PubsubIOIT_Python_Streaming] $ /bin/bash -xe /tmp/jenkins9070524098383077627.sh + echo '*** PubsubIO Write Performance Test Python 2GB ***' *** PubsubIO Write Performance Test Python 2GB *** [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/gradlew> -PloadTest.mainClass=apache_beam.io.gcp.pubsub_io_perf_test -Prunner=TestDataflowRunner '-PloadTest.args=--job_name=performance-tests-psio-python-2gb0901150439 --project=apache-beam-testing --region=us-central1 --temp_location=gs://temp-storage-for-perf-tests/loadtests --publish_to_big_query=true --metrics_dataset=beam_performance --metrics_table=psio_io_2GB_results --influx_measurement=python_psio_2GB_results --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --input_options='{"num_records": 2097152,"key_size": 1,"value_size": 1024}' --num_****s=5 --autoscaling_algorithm=NONE --pubsub_namespace_prefix=pubsub_io_performance_ --wait_until_finish_duration=600000 --runner=TestDataflowRunner' -PwithDataflowWorkerJar=true -PpythonVersion=3.7 --continue --max-****s=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :sdks:python:apache_beam:testing:load_tests:run Starting a Gradle Daemon, 2 busy and 1 stopped Daemons could not be reused, use --status for details Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 49 * What went wrong: A problem occurred evaluating project ':sdks:python:apache_beam:testing:load_tests'. > Could not get unknown property 'shadowJar' for project > ':runners:google-cloud-dataflow-java:****' of type org.gradle.api.Project. * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 35s 10 actionable tasks: 4 executed, 4 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/ibpi4e46kwurs Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
