See
<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/4748/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner
[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)
[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,
[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.
[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource
(#17100)
------------------------------------------
[...truncated 2.84 MB...]
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_13"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AtQCqgGqAQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_14"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:data_channel:read_index:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_2/SplitAndSize0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Split_8"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_PairWithOne_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Split_8"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_PairWithOne_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Split_8"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2/SplitAndSize0:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_PairWithOne_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_PairWithOne_9"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Split_8"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "YA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_5"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/ProcessSizedElementsAndRestrictions0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "YA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "Gw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_5:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "FKQGDlQ=",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AYsJiwmLCQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_2/SplitAndSize0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "IMYEEBk=",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_5"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "Ir4EDhQ=",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }]'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b'}'
INFO:apache_beam.utils.subprocess_server:b'Mar 17, 2022 6:46:03 PM
org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopping Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'Mar 17, 2022 6:46:03 PM
org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopping Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'Mar 17, 2022 6:46:03 PM
org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped Akka RPC service.'
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.utils.subprocess_server:b'Mar 17, 2022 6:46:03 PM
org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Shutting down BLOB cache'
INFO:apache_beam.utils.subprocess_server:b'Mar 17, 2022 6:46:03 PM
org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Shutting down BLOB cache'
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 8m 47s
140 actionable tasks: 14 executed, 126 up-to-date
Publishing build scan...
https://gradle.com/s/iorrkewytxr2s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
