See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8852/display/redirect?page=changes>
Changes:
[noreply] Port changes from Pub/Sub Lite to beam (#15418)
[heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the
[BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for
[noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494)
[noreply] [BEAM-12802] Add support for prefetch through data layers down through
[noreply] [BEAM-11097] Add implementation of side input cache (#15483)
------------------------------------------
[...truncated 568.67 KB...]
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c3"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload:
"\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210911-002225"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2021/09/11 00:51:40 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631321495964858191/model
2021/09/11 00:51:40 {
"environment": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-job-7-1631321495964853335"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_worker,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210911-002225"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "test.timeout",
"namespace": "go_options",
"type": "STRING",
"value": "1h0m0s"
},
{
"key": "test.v",
"namespace": "go_options",
"type": "STRING",
"value": "true"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631321495964858191/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"hooks": "{}",
"test.timeout": "1h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631321495964858191/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631321495964858191/dataflow-worker.jar",
"name": "dataflow-worker.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210911-002225"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210911-002225"
}
]
},
"name": "go-job-7-1631321495964853335",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/11 00:51:41 Submitted job: 2021-09-10_17_51_40-7366793681819484976
2021/09/11 00:51:41 Console:
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_17_51_40-7366793681819484976?project=apache-beam-testing
2021/09/11 00:51:41 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-10_17_51_40-7366793681819484976
2021/09/11 00:51:41 Job state: JOB_STATE_PENDING ...
--- FAIL: TestEmitParDoAfterGBK (35.89s)
ptest.go:98: Failed to execute job: job
2021-09-10_17_51_40-7366793681819484976 failed
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 1305.805s
cd ../..
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210911-002225
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6419bcfd39e164ae16ae3b154579be6cdf0b8852d88636e4468ea55b42e7ac90
Deleted: sha256:492de403322df3af7cb633634803fc4042f93a8871e673b0847cc04707401c83
Deleted: sha256:4ce9934da87cfeb1a16b0ea3180c900130ed7d0dadbda03de06d590ee7fbded8
Deleted: sha256:17f5a45f238d4f4ede6e35158d27de737d50404e3b72f203d0df42f594f4f3ea
Deleted: sha256:83d3a976234b2c1f7eea20f1284ec0d1765f61a8a1e0ac0157b5525c5d39eaf2
Deleted: sha256:48eb66a88abd9964b53f19a1739461264068ce01d9eeccc940f220be5bd06603
Deleted: sha256:635685bb37d65ae4c0dffd282dcfd146bbdf6eb84ea2c2a747f2901565bdf8d2
Deleted: sha256:eb160a69c0eed031e55960580b87d4aa63c1d487ac7ffd2669aeca77a4bda3e4
Deleted: sha256:8936cd565ea4f0970cff4faf189662698e1588a4862239f3ef344cc2d7ae68ae
Deleted: sha256:54504ab792f5e140935d471a6b17b63d2025d2825e52eac5dabafbffc2250820
Deleted: sha256:2e5fd791a843204620dbbb8ddd5280ac830e7e68bd718b7451d60f443f5b590b
Deleted: sha256:c0dd7fda3b0e5c45a93171db6018501efe17521cdde3cbe825ecb9d9c9ad1415
Deleted: sha256:699afae883346e4ec4163cd4ebb03ae26c6d617fe939860d60e387d13023eec1
Deleted: sha256:52c5c6e3d5e32ec0328a50900721d134b6709e1c8f127027d740fb544188486a
Deleted: sha256:e7b056e00dfda5dadf463abeeb1670d519a2ec753a593569b4c3911da36e2abe
Deleted: sha256:b209b10ed27a7a0acc9621a16bb66301aee7b90443c5119703142186a29de15a
Deleted: sha256:b025debf2a35fa419898cdcc07bcb3abb5088eac727aeefa99184f442f876643
Deleted: sha256:eb403d55b88e490d5ab9bbd39a9059a231463f746059daba9f6716d1387aabcf
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6419bcfd39e164ae16ae3b154579be6cdf0b8852d88636e4468ea55b42e7ac90
Associated tags:
- 20210911-002225
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210911-002225
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210911-002225].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6419bcfd39e164ae16ae3b154579be6cdf0b8852d88636e4468ea55b42e7ac90].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 54m 40s
86 actionable tasks: 68 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/r54enam3geo7c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
