See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8623/display/redirect?page=changes>
Changes:
[rohde.samuel] [BEAM-12388] Add caching to deferred dataframes
[noreply] [BEAM-4152] Finish plumbing for session windowing in Go SDK (#15168)
------------------------------------------
[...truncated 603.61 KB...]
component_coder_ids: "c5"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c3"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload:
"\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210716-001224"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2021/07/16 00:44:18 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626396254013997015/model
2021/07/16 00:44:18 {
"environment": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-job-7-1626396254013992333"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value":
"use_unified_worker,use_portable_job_submission,shuffle_mode=appliance"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210716-001224"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"shuffle_mode=appliance",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626396254013997015/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"hooks": "{}"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.32.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626396254013997015/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1626396254013997015/dataflow-worker.jar",
"name": "dataflow-worker.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210716-001224"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210716-001224"
}
]
},
"name": "go-job-7-1626396254013992333",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/07/16 00:44:19 Submitted job: 2021-07-15_17_44_18-2678568650099585748
2021/07/16 00:44:19 Console:
https://console.cloud.google.com/dataflow/jobs/2021-07-15_17_44_18-2678568650099585748?project=apache-beam-testing
2021/07/16 00:44:19 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-07-15_17_44_18-2678568650099585748
2021/07/16 00:44:19 Job state: JOB_STATE_PENDING ...
2021/07/16 00:44:49 Job still running ...
2021/07/16 00:45:19 Job still running ...
2021/07/16 00:45:49 Job still running ...
2021/07/16 00:46:19 Job still running ...
2021/07/16 00:46:49 Job still running ...
2021/07/16 00:47:19 Job still running ...
2021/07/16 00:47:49 Job still running ...
2021/07/16 00:48:20 Job still running ...
2021/07/16 00:48:51 Job still running ...
2021/07/16 00:49:21 Job still running ...
2021/07/16 00:49:51 Job still running ...
2021/07/16 00:50:21 Job succeeded!
--- PASS: TestEmitParDoAfterGBK (367.16s)
PASS
ok github.com/apache/beam/sdks/go/test/regression 2174.033s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210716-001224
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0d9a8a859616a318d0a746e4763d23f77b5c55bda712302f1f3342a22a0c52f5
Deleted: sha256:e9fa42a02ca77ac501ce611632e8d61bd30747ef30197c112aba861f65ee49dc
Deleted: sha256:c9a7ef51b73b1c14f0abfc4287dfec1cb4e7d0f77394a7cec6c9cfef7e296169
Deleted: sha256:251fc527cc562854035e822e3cb4b32645d14ba710815388d326911a2ea09f4a
Deleted: sha256:7f769671a8714d18c108e74c0bdad6b9649ef91c5153104470fb92092a2550fd
Deleted: sha256:6f001265ca5627612ae6c7e03cfb57927b2dea8510ad2f9f3b09938f566d8742
Deleted: sha256:be66cc4a347599810b002e4f85e11247cd93d5fa17da30335a96f429498e4210
Deleted: sha256:225a7e17fd147a19e30d15675988dff31d059f226ad0e8c1ee5c97431eb0e551
Deleted: sha256:8f08137571ae5ce09df6a0437a9bf36ddc6a5ecfc3b134af83797de278a15103
Deleted: sha256:a579abac2d40f591e70242890de40a75e0eb7d5fc9c2a453c5849e064d5ead35
Deleted: sha256:ccb016d7498be8af9f6cd27085edf403ce947c744851a6da6f1ada5e4c2e16c6
Deleted: sha256:69753fe4bce615c163264d4f89fb3fd6d19a4b79bf7bcc0a7ef67e82e3bdb05d
Deleted: sha256:4660e3e347f8430b085bb2fb2388ebaca3115a3ef545492a2c452551a1d6eab2
Deleted: sha256:f6bf2c7a19d44ec0501d80142db15aff17736e1e841e13184294ef93d6e322ef
Deleted: sha256:7f848858aae879500149cb0d177db4dcfd11ceaef0b13f02ea5fb77d8b4aced1
Deleted: sha256:3ab8c4a3d40f82df381a9fa4d15074c9eb8c9d11a77cec0c9edf84bc08aab55a
Deleted: sha256:9d653d18f2f6ee7fe2eb0a749565af74e362dce6a487eeae5884352b8c36bc32
Deleted: sha256:36acd3322819fc7c095bd7f53bdac12b6645822b1021fe8ccf0e6fb163ba5af7
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0d9a8a859616a318d0a746e4763d23f77b5c55bda712302f1f3342a22a0c52f5
Associated tags:
- 20210716-001224
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210716-001224
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210716-001224].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0d9a8a859616a318d0a746e4763d23f77b5c55bda712302f1f3342a22a0c52f5].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 59m 38s
94 actionable tasks: 64 executed, 30 from cache
Publishing build scan...
https://gradle.com/s/pb2mcsigsvxm6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
