See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8040/display/redirect?page=changes>
Changes:
[nahian97] Changing query to sql to fix doc
[evgeny.belousov] [BEAM-11807] SDK Worker multithreading causes boto3 the
KeyError
------------------------------------------
[...truncated 667.31 KB...]
{
"kind": "ParallelDo",
"name": "e10",
"properties": {
"user_name": "passert.Hash(out)/beam.addFixedKeyFn",
"output_info": [
{
"user_name": "i0",
"output_name": "i0",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type":
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB",
"pipeline_proto_coder_id": "c1"
}
]
},
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type": "kind:string",
"pipeline_proto_coder_id": "c0"
}
]
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e9",
"output_name": "i0"
},
"serialized_fn": "e10"
}
},
{
"kind": "GroupByKey",
"name": "e11",
"properties": {
"user_name": "passert.Hash(out)/CoGBK",
"output_info": [
{
"user_name": "i0",
"output_name": "i0",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type":
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB",
"pipeline_proto_coder_id": "c1"
}
]
},
{
"@type": "kind:stream",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type": "kind:string",
"pipeline_proto_coder_id": "c0"
}
]
}
],
"is_stream_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e10",
"output_name": "i0"
},
"serialized_fn":
"%0A%27%22%25%0A%02c4%12%1F%0A%1D%0A%1Bbeam:coder:global_window:v1j:%0A%22%0A%20beam:window_fn:global_windows:v1%10%01%1A%02c4%22%02:%00%28%010%018%02H%01Z%02go"
}
},
{
"kind": "ParallelDo",
"name": "e12",
"properties": {
"user_name": "passert.Hash(out)/passert.hashFn",
"output_info": [
{
"user_name": "bogus",
"output_name": "bogus",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e11",
"output_name": "i0"
},
"serialized_fn": "e12"
}
}
],
"type": "JOB_TYPE_BATCH"
}
2021/02/12 18:23:51 Submitted job: 2021-02-12_10_23_49-13768177288652730795
2021/02/12 18:23:51 Console:
https://console.cloud.google.com/dataflow/job/2021-02-12_10_23_49-13768177288652730795?project=apache-beam-testing
2021/02/12 18:23:51 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-02-12_10_23_49-13768177288652730795
2021/02/12 18:23:51 Job state: JOB_STATE_PENDING ...
2021/02/12 18:24:21 Job still running ...
2021/02/12 18:24:51 Job still running ...
2021/02/12 18:25:21 Job still running ...
2021/02/12 18:25:52 Job still running ...
2021/02/12 18:26:22 Job succeeded!
--- PASS: TestWordCount (882.99s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 883.020s
2021/02/12 18:11:39 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:110: Test TestXLang_CoGroupBy is currently sickbayed on all
runners
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:144: Test TestXLang_Combine is currently filtered for runner
dataflow
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:144: Test TestXLang_CombineGlobally is currently filtered
for runner dataflow
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:144: Test TestXLang_Flatten is currently filtered for runner
dataflow
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:144: Test TestXLang_GroupBy is currently filtered for runner
dataflow
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:110: Test TestXLang_Multi is currently sickbayed on all
runners
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:110: Test TestXLang_Partition is currently sickbayed on all
runners
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.025s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210212-181007
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e5d12108cefb9e87e6ec49f21d206eb5932a0ac85fd33a49e2a008446632e8fd
Deleted: sha256:114599a9dd25f13e9cdd994dc0de54b3c772180865888d5ba9e73efe9ad94297
Deleted: sha256:ff791f6d335c7d4050fd73bd58fda87b1176a7fbde4063aa98c67c9b0e039267
Deleted: sha256:451eb03c2a3f37e8c0b3ca5efe007e6c8a45fe22670d945ae30f48d343bf1e2f
Deleted: sha256:45b06ef52f4702bcaa329cde817c78a0fb4ebd6f808d3167fd54e8cf6b85c8d4
Deleted: sha256:bb28e109b86e09c51671b1dde1f0f861ba47c21a13278f762717131e0e644999
Deleted: sha256:4fbeb60b353584b1c4db423683b8ce7b93c7a247e878181e99f917d537ebb751
Deleted: sha256:6ccee4bfbf32525feaa0c696631eefe889335b3a854b6f258752b749318e6812
Deleted: sha256:a77086370ba9947fd3850db8edb2e8361d0ec92b30a36215bcac1986de3c6737
Deleted: sha256:0b74ee742753689f84157c615fa6fb5682a01c71635f889c1d5c969c190bac8f
Deleted: sha256:7480cff652fa40f23c00bf26d0d21dbe75698c7a6c8cdf38916981f0737077d0
Deleted: sha256:169effbf82f0e61b7a502c071744756201d2caba70d9cd78e40f638a087d08e4
Deleted: sha256:78072d46e9b73b4886741d34652a0f1205c89d5959a07a664dd2a2f336bb6ff8
Deleted: sha256:7686abe2a5042495137345cb082b71d74986e9e6f9d418f8811a0212a89e6e41
Deleted: sha256:6d31ce71dc2241968d3db941236475b3a42182fb812359b2c60cc5f38e77867c
Deleted: sha256:bfb855a30f596c73b9e2c8ccb35ddff1ce6bab30c153146255134731dabe8f9b
Deleted: sha256:fcc8d3d343f9a90e41e3f57979882f4acecfb090655a8e9a5da103070641b768
Deleted: sha256:4a1ab46751a93ca87dc7102b52b970984010bb93fcdd065b67e5198924def13a
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e5d12108cefb9e87e6ec49f21d206eb5932a0ac85fd33a49e2a008446632e8fd
Associated tags:
- 20210212-181007
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210212-181007
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210212-181007].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e5d12108cefb9e87e6ec49f21d206eb5932a0ac85fd33a49e2a008446632e8fd].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 39m 16s
88 actionable tasks: 60 executed, 28 from cache
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/duagunsf3t3cq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
