See
<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/4614/display/redirect?page=changes>
Changes:
[david.prieto.rivera] Missing contribution
[noreply] Merge pull request #15848 from [BEAM-13835] An any-type implementation
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define
simple generators.
[Valentyn Tymofieiev] Add a container for Python 3.9.
[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner
[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites
unchanged for now.
[Valentyn Tymofieiev] Add py3.9 Github actions suites.
[Valentyn Tymofieiev] Py39 Doc updates.
[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid
branching.
[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.
[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable
default
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define
simple generators.
[Valentyn Tymofieiev] Mark Python 3.9 as supported version.
[noreply] [release-2.36.0][website] Fix github release notes script, header for
[noreply] Use shell to run python for setupVirtualenv (#16796)
[Daniel Oliveira] [BEAM-13830] Properly shut down Debezium expansion service in
IT script.
[noreply] Merge pull request #16659 from [BEAM-13774][Playground] Add user to
[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.
[noreply] [BEAM-13776][Playground] (#16731)
------------------------------------------
[...truncated 1.42 MB...]
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Split_8"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_PairWithOne_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Split_8"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_PairWithOne_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_PairWithOne_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Split_8"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "YA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_5"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "YA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "Gw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "EP8EDlQ=",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AZMKkwqTCg==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_2/SplitAndSize0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "JboFEBk=",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_5"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "I88EDhc=",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }]'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b'}'
INFO:apache_beam.utils.subprocess_server:b'Feb 10, 2022 12:37:44 AM
org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopping Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'Feb 10, 2022 12:37:44 AM
org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'Feb 10, 2022 12:37:44 AM
org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Shutting down BLOB cache'
INFO:apache_beam.utils.subprocess_server:b'Feb 10, 2022 12:37:44 AM
org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Shutting down BLOB cache'
INFO:apache_beam.utils.subprocess_server:b'Feb 10, 2022 12:37:44 AM
org.apache.flink.runtime.blob.BlobServer close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped BLOB server at
0.0.0.0:45343'
INFO:apache_beam.utils.subprocess_server:b'Feb 10, 2022 12:37:44 AM
org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped Akka RPC service.'
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:portable:py36:preCommitPy36
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 12m 33s
145 actionable tasks: 111 executed, 22 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/a27eirkycujjy
[Gradle] - Launching build.
[src] $
<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/gradlew>
--continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g
-Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses
:sdks:python:test-suites:portable:py39:preCommitPy38
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
FAILURE: Build failed with an exception.
* What went wrong:
Task 'preCommitPy38' not found in project
':sdks:python:test-suites:portable:py39'. Some candidates are: 'preCommitPy39'.
* Try:
> Run gradlew tasks to get a list of available tasks.
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1s
10 actionable tasks: 10 up-to-date
Publishing build scan...
https://gradle.com/s/ldidk7keogysk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
