See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8709/display/redirect?page=changes>
Changes:
[emilyye] bump FnAPI container
[Ismaël Mejía] [BEAM-12628] Add Avro reflect-based Coder option
------------------------------------------
[...truncated 615.22 KB...]
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c3"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload:
"\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210806-122207"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2021/08/06 12:57:24 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628254639869097757/model
2021/08/06 12:57:24 {
"environment": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-job-7-1628254639869091038"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value":
"use_unified_worker,use_portable_job_submission,shuffle_mode=appliance"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210806-122207"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628254639869097757/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"hooks": "{}"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.33.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628254639869097757/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1628254639869097757/dataflow-worker.jar",
"name": "dataflow-worker.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210806-122207"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210806-122207"
}
]
},
"name": "go-job-7-1628254639869091038",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/08/06 12:57:25 Submitted job: 2021-08-06_05_57_24-1389452435499837855
2021/08/06 12:57:25 Console:
https://console.cloud.google.com/dataflow/jobs/2021-08-06_05_57_24-1389452435499837855?project=apache-beam-testing
2021/08/06 12:57:25 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-08-06_05_57_24-1389452435499837855
2021/08/06 12:57:25 Job state: JOB_STATE_PENDING ...
2021/08/06 12:57:55 Job still running ...
2021/08/06 12:58:25 Job still running ...
2021/08/06 12:58:55 Job still running ...
2021/08/06 12:59:25 Job still running ...
2021/08/06 12:59:55 Job still running ...
2021/08/06 13:00:25 Job still running ...
2021/08/06 13:00:55 Job still running ...
2021/08/06 13:01:25 Job still running ...
2021/08/06 13:01:55 Job still running ...
2021/08/06 13:02:26 Job still running ...
2021/08/06 13:02:56 Job still running ...
2021/08/06 13:03:26 Job still running ...
2021/08/06 13:03:56 Job still running ...
2021/08/06 13:04:26 Job still running ...
2021/08/06 13:04:56 Job still running ...
2021/08/06 13:05:26 Job succeeded!
--- PASS: TestEmitParDoAfterGBK (486.35s)
PASS
ok github.com/apache/beam/sdks/go/test/regression 2533.665s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210806-122207
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6fc8a12017c1cf55b6a88356f9d426d7b9bb1a992c61956d027106fc59e384f7
Deleted: sha256:1c0b2ad74bad15cb5f2a13ac1c0addc05332947120eca31f64025c5f2a29fcb8
Deleted: sha256:7b943bb2647298df66289d0edc7d361359b90c60f95b9985c9f5da1f6e470305
Deleted: sha256:94dc9f4329c59a03c576f07956634222acf7000e0b5b9ac3961947e0b14cc9bb
Deleted: sha256:cec913316f81dc24f9d746c2f8234493ff135e376b880f86abba8d2bde364658
Deleted: sha256:5034a1487c3787f4a5fb7811f4ce36326a52b4f6765d13c37e24f202811f6b76
Deleted: sha256:cc6e25741084e2d6f779825b558c481fbe286152472bd9010d816307e5476c12
Deleted: sha256:0952bfc39d1f68b62df9763061b2495ea26fb71101b94a8af5ef95cb799654ca
Deleted: sha256:b9f8516e8f98e58a2324b57e19a88b34c8c357226b580d7ca42916557d908066
Deleted: sha256:2e3253dc7717bafd6f86e641a28d61280a5e1dec48279f3e79ffe2894fbae9bd
Deleted: sha256:f504efe80a77c01363260375f7c818a0e8bbce642853dd8f8930b3ae93ecc9dd
Deleted: sha256:9e5ba43227327874e99651d67ba79f4ead44bec8ecf72f5bf03600d833f05232
Deleted: sha256:17fc8ae43cde6996bc8b3bfb8bafbc4a2f2f93e73c27947396850f8555c98f59
Deleted: sha256:7d0fbd84869aaca371c1e2faf0cf8548cc2f4d2d8427d7f5e07656981278b215
Deleted: sha256:68155dbca69dae0bf3f42948c2ccb47b8ecf8411198c17ca933b5dc303ff9234
Deleted: sha256:a1ea0ab6214a6f58607b622f7aea829bae5b79250a491005e829e6584c253d27
Deleted: sha256:489bda6643db66f7802f2550c865ccbd3391e49a95462ec541059dd9dbbfd4ae
Deleted: sha256:21b6e44ae0348996e67a5ff2ed3be0a81e569da8244f053455c0fdb17c6250ea
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6fc8a12017c1cf55b6a88356f9d426d7b9bb1a992c61956d027106fc59e384f7
Associated tags:
- 20210806-122207
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210806-122207
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210806-122207].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6fc8a12017c1cf55b6a88356f9d426d7b9bb1a992c61956d027106fc59e384f7].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 22m 48s
94 actionable tasks: 75 executed, 19 from cache
Publishing build scan...
https://gradle.com/s/dhidpe4cb7wou
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
