See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8026/display/redirect?page=changes>
Changes:
[tysonjh] [BEAM-11377] Add retries to mvn command.
[zyichi] Explicitly set dataflow runner v2 test shuffle mode to appliance
[noreply] [BEAM-11324] Impose consistent ordering on partitionings used in
[noreply] [BEAM-11659] Extract common payload serialization behavior for Row
------------------------------------------
[...truncated 670.55 KB...]
"kind": "ParallelDo",
"name": "e10",
"properties": {
"user_name": "passert.Hash(out)/beam.addFixedKeyFn",
"output_info": [
{
"user_name": "i0",
"output_name": "i0",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type":
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB",
"pipeline_proto_coder_id": "c1"
}
]
},
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type": "kind:string",
"pipeline_proto_coder_id": "c0"
}
]
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e9",
"output_name": "i0"
},
"serialized_fn": "e10"
}
},
{
"kind": "GroupByKey",
"name": "e11",
"properties": {
"user_name": "passert.Hash(out)/CoGBK",
"output_info": [
{
"user_name": "i0",
"output_name": "i0",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type":
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB",
"pipeline_proto_coder_id": "c1"
}
]
},
{
"@type": "kind:stream",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type": "kind:string",
"pipeline_proto_coder_id": "c0"
}
]
}
],
"is_stream_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e10",
"output_name": "i0"
},
"serialized_fn":
"%0A%27%22%25%0A%02c4%12%1F%0A%1D%0A%1Bbeam:coder:global_window:v1j:%0A%22%0A%20beam:window_fn:global_windows:v1%10%01%1A%02c4%22%02:%00%28%010%018%02H%01Z%02go"
}
},
{
"kind": "ParallelDo",
"name": "e12",
"properties": {
"user_name": "passert.Hash(out)/passert.hashFn",
"output_info": [
{
"user_name": "bogus",
"output_name": "bogus",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e11",
"output_name": "i0"
},
"serialized_fn": "e12"
}
}
],
"type": "JOB_TYPE_BATCH"
}
2021/02/09 06:40:49 Submitted job: 2021-02-08_22_40_47-18157130167250050534
2021/02/09 06:40:49 Console:
https://console.cloud.google.com/dataflow/job/2021-02-08_22_40_47-18157130167250050534?project=apache-beam-testing
2021/02/09 06:40:49 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-02-08_22_40_47-18157130167250050534
2021/02/09 06:40:49 Job state: JOB_STATE_PENDING ...
2021/02/09 06:41:19 Job still running ...
2021/02/09 06:41:49 Job still running ...
2021/02/09 06:42:19 Job still running ...
2021/02/09 06:42:49 Job still running ...
2021/02/09 06:43:19 Job still running ...
2021/02/09 06:43:50 Job succeeded!
--- PASS: TestWordCount (874.47s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 874.491s
2021/02/09 06:29:15 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:110: Test TestXLang_CoGroupBy is currently sickbayed on all
runners
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:144: Test TestXLang_Combine is currently filtered for runner
dataflow
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:144: Test TestXLang_CombineGlobally is currently filtered
for runner dataflow
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:144: Test TestXLang_Flatten is currently filtered for runner
dataflow
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:144: Test TestXLang_GroupBy is currently filtered for runner
dataflow
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:110: Test TestXLang_Multi is currently sickbayed on all
runners
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:110: Test TestXLang_Partition is currently sickbayed on all
runners
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.020s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210209-062751
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6d12909128911a2fa637737ab09a0fff256fc622e62fc5be8b8a1e5cdf542392
Deleted: sha256:bff46b4d9199baef866388ce9de99f441090f30d8641e08ebb8c9fb4279b1e46
Deleted: sha256:c2fc265d21373ec646735ae212860933932d50e31d3840d89e2258cdcfda5fb1
Deleted: sha256:95a70ed31f9889938f56f327a59b089fc9b3709a09d6653885075baa623d3115
Deleted: sha256:d424507e68bf33913274c231680ebdde621eac02c34e0c47421b62c190dde477
Deleted: sha256:55133e16f2c440a615a0cd338c019fe66564cd141e66be4974682d612e334b2c
Deleted: sha256:c95f4983d3d07507511dd8b918c7b7ac9058da556518be7363f43bfbf41bd6b8
Deleted: sha256:9993b77bd79b33cb6995fcbaaaea1f36e776fa57bec3016acc282704d4e0fe05
Deleted: sha256:2e428208e7929adbdf8f5783d89b1f9382562515f9568336cc65e5a293ec4502
Deleted: sha256:5a4fc907c1ac869299509a3f4ae29381be25f1424d52ca635d573fdf434773d6
Deleted: sha256:e1af003c7c5e8167db0201af9eec7e8c19f3d1471e97bed2e8ae42633995e728
Deleted: sha256:a6c9982348f8af8f385f19d94c8c8150d677ea0da64c427b4cb80744957bbf07
Deleted: sha256:508f450fcb7f68734103ee0ed9960cc84a3d0fc795ed02590e02bc68d760e727
Deleted: sha256:af4e781c65871da125d11285b2ccfd8b528a711ce216c245f9b81616839de311
Deleted: sha256:1640c91b4cd057121567ab49d6d3047c31f48620e8b2ab0d5994a390c66e91b4
Deleted: sha256:6c9d6996c90bcf73bd88620f53dd433dc11686fd25fee45dcf1532c4138f3bbc
Deleted: sha256:b935aef8562ac05cefdda8b982694eeb84925f369da7d2f8c4c9528ebf33e34b
Deleted: sha256:f16e9db88b44da2c23a7b05e4fe6152d2df2f64a0c01a8567420faf0890315d0
Deleted: sha256:e7d08cddf791fe3245267654331eb21b805458b3412d368018009355855044a3
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6d12909128911a2fa637737ab09a0fff256fc622e62fc5be8b8a1e5cdf542392
Associated tags:
- 20210209-062751
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210209-062751
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210209-062751].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6d12909128911a2fa637737ab09a0fff256fc622e62fc5be8b8a1e5cdf542392].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 56m 16s
91 actionable tasks: 75 executed, 16 from cache
Publishing build scan...
https://gradle.com/s/bauks3rhvox3q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
