See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8628/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11934] Remove Dataflow override of streaming WriteFiles with
------------------------------------------
[...truncated 605.62 KB...]
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c3"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload:
"\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210717-061335"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2021/07/17 06:48:24 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626504499979920758/model
2021/07/17 06:48:24 {
"environment": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-job-7-1626504499979917288"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value":
"use_unified_worker,use_portable_job_submission,shuffle_mode=appliance"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210717-061335"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626504499979920758/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"hooks": "{}"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.32.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626504499979920758/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626504499979920758/dataflow-worker.jar",
"name": "dataflow-worker.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210717-061335"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210717-061335"
}
]
},
"name": "go-job-7-1626504499979917288",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/07/17 06:48:25 Submitted job: 2021-07-16_23_48_24-3949897998978412972
2021/07/17 06:48:25 Console:
https://console.cloud.google.com/dataflow/jobs/2021-07-16_23_48_24-3949897998978412972?project=apache-beam-testing
2021/07/17 06:48:25 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-07-16_23_48_24-3949897998978412972
2021/07/17 06:48:25 Job state: JOB_STATE_PENDING ...
2021/07/17 06:48:55 Job still running ...
2021/07/17 06:49:25 Job still running ...
2021/07/17 06:49:55 Job still running ...
2021/07/17 06:50:25 Job still running ...
2021/07/17 06:50:55 Job still running ...
2021/07/17 06:51:25 Job still running ...
2021/07/17 06:51:55 Job still running ...
2021/07/17 06:52:25 Job still running ...
2021/07/17 06:52:55 Job still running ...
2021/07/17 06:53:25 Job still running ...
2021/07/17 06:53:55 Job still running ...
2021/07/17 06:54:25 Job still running ...
2021/07/17 06:54:56 Job still running ...
2021/07/17 06:55:26 Job still running ...
2021/07/17 06:55:56 Job succeeded!
--- PASS: TestEmitParDoAfterGBK (456.12s)
PASS
ok github.com/apache/beam/sdks/go/test/regression 2447.469s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210717-061335
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9669838264449d3c018912a6f4c857c9a2609d18a7af8e4c9f98001f8b6c27b5
Deleted: sha256:6793ccc16293eb47dacaefa5b560ed57598118b3888cf0f19ad3dbb42c47ec3f
Deleted: sha256:5f13172bc53d488cfed75d15f61495ea1361aca0e98e6664e1c9d97cfa3f924f
Deleted: sha256:8eea170b6b08748e57000bb1aaef06fb5fe927d47108a7c5f76b24e092edd562
Deleted: sha256:81303420a65b77bd297705db5f630bf37db01bcfc597087999a133b79a683326
Deleted: sha256:118810e2f1d4a76b789f0ab592b23ca3a0a180efc26d35590d558b3b8306e552
Deleted: sha256:9724ec5dec2e42fa6621c89a75c9521159ff0d704c917f16a5fdd2dc78b180b5
Deleted: sha256:d408bdc780d230f47053c3ea756c1837782d7ac479dfac9ed62635b17094d6ea
Deleted: sha256:71952a76153afe4a47d5d1b6f9903dbcff08cb2639f22f3847e623560a9d8e4c
Deleted: sha256:bc9554205c7b8c0d2c8b69202747a398114c511f00caa3a1c4a7bc1233c7de11
Deleted: sha256:087c0cd4a06a351b01631598ba8b61267af633aea08f9eef49b167ae9a9c07c7
Deleted: sha256:6e4c4844a8a4c17303ad5d0d3cc8a4a1edf67a5f0f151d2c153db577097c64ca
Deleted: sha256:b099c16b7e5c22d61d4aa249aad63172f979d7e7c8b9d530a2c77ff9055025ff
Deleted: sha256:fc5dcb6eaf2ac759230aeeb127cc13098c2bb0b48d98447325a499fedecc8a9b
Deleted: sha256:3700cbc1b0c59808411197cf0ed357c197925d69100e9ff9ead380a53dcc2d6b
Deleted: sha256:83cd3f928d3e00dbb2932fd1398829d4e4a65ce2e2610e0b551d5fe6beee7486
Deleted: sha256:c22df0c89db0efb56536f2566ce5647df9ee824223ccebbcdd5c4beaa6929a7c
Deleted: sha256:5d2b3e5c8c25f20ae7f1f6be2304f72a1e6d261eace4b96436e81260320974e4
Deleted: sha256:7a4951775d157843b47250a2a5cc7b561d2abe0b29ae6f19737a04635302eacf
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9669838264449d3c018912a6f4c857c9a2609d18a7af8e4c9f98001f8b6c27b5
Associated tags:
- 20210717-061335
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210717-061335
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210717-061335].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9669838264449d3c018912a6f4c857c9a2609d18a7af8e4c9f98001f8b6c27b5].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 9m 40s
94 actionable tasks: 66 executed, 28 from cache
Publishing build scan...
https://gradle.com/s/d2zqsvbtq2r4q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
