See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8723/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15298 from [BEAM-12729] Suppress Avro Runtime
[noreply] Refactor _RemoveDuplicates to use counter state (#15242)
------------------------------------------
[...truncated 615.19 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c3"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload:
"\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210810-003225"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2021/08/10 01:06:06 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628557558494464932/model
2021/08/10 01:06:06 {
"environment": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-job-7-1628557558494457197"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value":
"use_unified_worker,use_portable_job_submission,shuffle_mode=appliance"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210810-003225"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628557558494464932/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"hooks": "{}"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.33.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628557558494464932/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628557558494464932/dataflow-worker.jar",
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
"name": "dataflow-worker.jar"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210810-003225"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210810-003225"
}
]
},
"name": "go-job-7-1628557558494457197",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/08/10 01:06:07 Submitted job: 2021-08-09_18_06_06-14882143776876775186
2021/08/10 01:06:07 Console:
https://console.cloud.google.com/dataflow/jobs/2021-08-09_18_06_06-14882143776876775186?project=apache-beam-testing
2021/08/10 01:06:07 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-08-09_18_06_06-14882143776876775186
2021/08/10 01:06:07 Job state: JOB_STATE_PENDING ...
2021/08/10 01:06:37 Job still running ...
2021/08/10 01:07:07 Job still running ...
2021/08/10 01:07:37 Job still running ...
2021/08/10 01:08:07 Job still running ...
2021/08/10 01:08:37 Job still running ...
2021/08/10 01:09:07 Job still running ...
2021/08/10 01:09:37 Job still running ...
2021/08/10 01:10:07 Job still running ...
2021/08/10 01:10:37 Job still running ...
2021/08/10 01:11:07 Job still running ...
2021/08/10 01:11:37 Job still running ...
2021/08/10 01:12:07 Job still running ...
2021/08/10 01:12:37 Job still running ...
2021/08/10 01:13:07 Job still running ...
2021/08/10 01:13:37 Job still running ...
2021/08/10 01:14:07 Job still running ...
2021/08/10 01:14:37 Job succeeded!
--- PASS: TestEmitParDoAfterGBK (519.35s)
PASS
ok github.com/apache/beam/sdks/go/test/regression 2449.443s
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210810-003225
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:561e73705025ba8ab89e1145c007f41a7b15b33fe3265ac17568710cc577b53e
Deleted: sha256:fc232b3b648617d45259da1779215557e06f4107c72226adbe2d96c32fae78ad
Deleted: sha256:816d294964aeebd9a3e587f89686338a1a92c813a097309cd8bb0cc71033ff93
Deleted: sha256:f9f0a4868e40b3f0a3ca697f27ab5f2ad30c0732e01c8ec3104481df873cfe67
Deleted: sha256:1a9195869aefee10434e679e83d38479b2985014b2085f0320eb4486b462d0a4
Deleted: sha256:84523a6f56ee11de1b9e27718da387ff7f47e61996b57b1182751228f20148bd
Deleted: sha256:8a758308af895afc112894c1c92e838c9b09d0cc5bf3b849c8c74c57320bf219
Deleted: sha256:f71576a02288379336995333f909a842448c67e6a75d53d688468c3c06d275c6
Deleted: sha256:00b4f2d93314ef6e9018e9a98a46a4a090c9288a31c0d008ea82361baa38f12b
Deleted: sha256:62c32a1e80de8f20ede1d96e74aa23f7952652b871c7ecc2805523a4affaf5a9
Deleted: sha256:99f49584f33356e02ebde6951deb504ea352eced16376d586a8c796b8439db6c
Deleted: sha256:96729d3a775300992b91335d8bc77260c4ad9e92986c299218d55d427d866142
Deleted: sha256:6a196d6ef87c4b6f1e3b6aad0fe132a8ac5e1fab565a8ce2b1d2aae610b52208
Deleted: sha256:248a1a345dddf676d034c53d2bc0af347cc2441ddae2a6df765606b81154a0bb
Deleted: sha256:bf6fee724502c07d71a65b4a7844fb1a2b4672514d5623f0c0b7b90b91c3652b
Deleted: sha256:efce54e952aa3f401174186637d5462bbd7d74b5fc86355efd1a955d882a669f
Deleted: sha256:bd8957a4962759a3b4e1029456822bd1f97b93410ed72d966743945effcd0293
Deleted: sha256:ea7da674bb57c9c5aa9582a5acc3cc7033535d3386c2781ea3554093168d9b2c
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:561e73705025ba8ab89e1145c007f41a7b15b33fe3265ac17568710cc577b53e
Associated tags:
- 20210810-003225
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210810-003225
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210810-003225].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:561e73705025ba8ab89e1145c007f41a7b15b33fe3265ac17568710cc577b53e].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 33m 23s
94 actionable tasks: 76 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/wanlyf3j6giik
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]