See
<https://ci-beam.apache.org/job/beam_PostCommit_Python38/1015/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Use beam, rather than typing, list type hint.
[noreply] [BEAM-11934] Add runner determined sharding option for unbounded data
to
[Kenneth Knowles] Exclude unsupported TestStream tests from SamzaRunner
[Kenneth Knowles] Exclude unsupported TestStream tests from FlinkRunner
[Kenneth Knowles] TestStream tests should be ValidatesRunner
[noreply] [BEAM-11935] Updates Dataflow SDK Harness map to set Environment ID
------------------------------------------
[...truncated 27.62 MB...]
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AcwTzBPMEw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"external_10Write to Spanner/SpannerIO.Write/Write mutations to Cloud
Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map/ParMultiDo(Anonymous).output"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AcwTzBPMEw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"external_10Write to Spanner/SpannerIO.Write/Write mutations to Cloud
Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Generate_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Map to row_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Map to row_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Map to row_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Generate_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_1:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_1:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_1:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/write/ref_PCollection_PCollection_1:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Generate_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_2"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Generate_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:data_channel:read_index:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"fn/read/ref_PCollection_PCollection_2:0"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "Ag==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_1"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PTRANSFORM":
"ref_AppliedPTransform_Map to row_4"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:element_count:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:sum_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "Ag==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "Ah4PDw==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_3"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AQ0NDQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_2"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }, {'
INFO:apache_beam.utils.subprocess_server:b' "urn":
"beam:metric:sampled_byte_size:v1",'
INFO:apache_beam.utils.subprocess_server:b' "type":
"beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "AjAYGA==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION":
"ref_PCollection_PCollection_1"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }]'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b'}'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.filecache.FileCache shutdown'
INFO:apache_beam.utils.subprocess_server:b'INFO: removed file cache directory
/tmp/flink-dist-cache-ca75e513-be0e-4887-86da-8a39c27bc33a'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped TaskExecutor
akka://flink/user/rpc/taskmanager_0.'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopping Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopping Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Shutting down BLOB cache'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Shutting down BLOB cache'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.blob.BlobServer close'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped BLOB server at
0.0.0.0:36403'
INFO:apache_beam.utils.subprocess_server:b'Mar 25, 2021 7:05:39 AM
org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7'
INFO:apache_beam.utils.subprocess_server:b'INFO: Stopped Akka RPC service.'
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
DEBUG:urllib3.connectionpool:http://localhost:None "DELETE
/v1.39/containers/cbf549aaebaf225d903f90923caa42ea2e1ff9154eda499a8d84270fab92fc86?v=True&link=False&force=True
HTTP/1.1" 204 0
----------------------------------------------------------------------
XML: nosetests-postCommitIT-flink-py38.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 17 tests in 1052.176s
OK (SKIP=5)
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
DEBUG:urllib3.connectionpool:http://localhost:None "DELETE
/v1.39/containers/5353bb1120017d3b105be6e000cc8d987b2c34fa5ba5e36c3f3e31981c9f07d0?v=True&link=False&force=True
HTTP/1.1" 404 98
DEBUG:urllib3.connectionpool:http://localhost:None "DELETE
/v1.39/containers/ff4437c855634f4ce7d051676bbb208f40b22f049355f08cb5e7241c98df0237?v=True&link=False&force=True
HTTP/1.1" 404 98
DEBUG:urllib3.connectionpool:http://localhost:None "DELETE
/v1.39/containers/e825d7e4a207f9f28cb15ef114b26d6e0810428f076168d774dfcb950dc10226?v=True&link=False&force=True
HTTP/1.1" 404 98
> Task :sdks:python:test-suites:portable:py38:postCommitPy38
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:worker:shadowJar'.
> Failed to store cache entry for task
> ':runners:google-cloud-dataflow-java:worker:shadowJar'
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 29s
205 actionable tasks: 184 executed, 17 from cache, 4 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/otn4u3raert5e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
