See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8025/display/redirect?page=changes>
Changes:
[Robert Bradshaw] [BEAM-11723] Use packed name for PairWithVoid consolidation.
[Robert Bradshaw] Only do pair-with-none packing when combiner packing is
desired.
[Robert Bradshaw] Make eliminate_common_key_with_none private.
[randomstep] [BEAM-11503] bump rockdbjni to 6.15.2
[noreply] [BEAM-11773] Add bhulette as an owner for pandas, pyarrow, numpy
[Boyuan Zhang] Using LoadingCache instead of Map to cache BundleProcessor
[noreply] [BEAM-9547] Produce better errors for some groupby() and set_index()
[yifanmai] Remove translations.eliminate_common_key_with_none from
DataflowRunner
[noreply] [BEAM-11762] Upgrades Tensorflow, numpy, and grpcio dependencies
[noreply] [BEAM-9918] Support Tagged external PTransforms (#13872)
[noreply] [BEAM-11265] make sure sample text file gets copied into archetype
------------------------------------------
[...truncated 668.50 KB...]
"kind": "ParallelDo",
"name": "e10",
"properties": {
"user_name": "passert.Hash(out)/beam.addFixedKeyFn",
"output_info": [
{
"user_name": "i0",
"output_name": "i0",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type":
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB",
"pipeline_proto_coder_id": "c1"
}
]
},
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type": "kind:string",
"pipeline_proto_coder_id": "c0"
}
]
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e9",
"output_name": "i0"
},
"serialized_fn": "e10"
}
},
{
"kind": "GroupByKey",
"name": "e11",
"properties": {
"user_name": "passert.Hash(out)/CoGBK",
"output_info": [
{
"user_name": "i0",
"output_name": "i0",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type":
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB",
"pipeline_proto_coder_id": "c1"
}
]
},
{
"@type": "kind:stream",
"component_encodings": [
{
"@type": "kind:length_prefix",
"component_encodings": [
{
"@type": "kind:string",
"pipeline_proto_coder_id": "c0"
}
]
}
],
"is_stream_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e10",
"output_name": "i0"
},
"serialized_fn":
"%0A%27%22%25%0A%02c4%12%1F%0A%1D%0A%1Bbeam:coder:global_window:v1j:%0A%22%0A%20beam:window_fn:global_windows:v1%10%01%1A%02c4%22%02:%00%28%010%018%02H%01Z%02go"
}
},
{
"kind": "ParallelDo",
"name": "e12",
"properties": {
"user_name": "passert.Hash(out)/passert.hashFn",
"output_info": [
{
"user_name": "bogus",
"output_name": "bogus",
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
}
],
"parallel_input": {
"@type": "OutputReference",
"step_name": "e11",
"output_name": "i0"
},
"serialized_fn": "e12"
}
}
],
"type": "JOB_TYPE_BATCH"
}
2021/02/09 00:24:00 Submitted job: 2021-02-08_16_23_58-9766924856992838365
2021/02/09 00:24:00 Console:
https://console.cloud.google.com/dataflow/job/2021-02-08_16_23_58-9766924856992838365?project=apache-beam-testing
2021/02/09 00:24:00 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-02-08_16_23_58-9766924856992838365
2021/02/09 00:24:00 Job state: JOB_STATE_PENDING ...
2021/02/09 00:24:30 Job still running ...
2021/02/09 00:25:00 Job still running ...
2021/02/09 00:25:30 Job still running ...
2021/02/09 00:26:00 Job still running ...
2021/02/09 00:26:31 Job still running ...
2021/02/09 00:27:01 Job succeeded!
--- PASS: TestWordCount (966.83s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 966.857s
2021/02/09 00:10:54 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:110: Test TestXLang_CoGroupBy is currently sickbayed on all
runners
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:144: Test TestXLang_Combine is currently filtered for runner
dataflow
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:144: Test TestXLang_CombineGlobally is currently filtered
for runner dataflow
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:144: Test TestXLang_Flatten is currently filtered for runner
dataflow
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:144: Test TestXLang_GroupBy is currently filtered for runner
dataflow
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:110: Test TestXLang_Multi is currently sickbayed on all
runners
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:110: Test TestXLang_Partition is currently sickbayed on all
runners
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.023s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210209-000923
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b9f900cf58344fbf58b93539fb5cb20056b7f55383b7becdd9b4fb75ad92d02c
Deleted: sha256:f28dec612e44ddd82e732e25c57ea72d94adf8056fb7a891442cfd88851c0c7a
Deleted: sha256:ca843276c917985177ec4659ae22dc35c506e263133ffeee603408dd7c1a2ff5
Deleted: sha256:bc02ad4b937c78bb2c39dcfb049bc2433a7e0a0d21434239a305183354c50a60
Deleted: sha256:5c93eae8a157e17a4dbf374a2892cca92a27de8f3296944931febb91c6158dea
Deleted: sha256:655072d8f1b870c922751aa652353619dbec8830215d7ecc89adc1ec3b9c524f
Deleted: sha256:2f2ad254cae25f470b558e6835fe039f21a6c0f53298d8a2cb4f62f85064eac6
Deleted: sha256:32ccb62f6cb62abc8f506206f6db76ff62ba1b44e380e3b9cb343c96c5945a04
Deleted: sha256:fbddb63fb3ba5821c6fde7afa129338720c6319311336b33f9023a8e1aeb9e74
Deleted: sha256:7339871718a3307cfd15fe10c50a1e5ecd743d170bf9801888ee16688e3caed7
Deleted: sha256:73e9a8e32efaf2d3f326e3c1640b9682804fdb2c5f09e94ef2893910c057a27a
Deleted: sha256:42d8e3073d2217ab084bda6b8b56b5260a76384732ca9f89e192596bef011d7a
Deleted: sha256:55546909d680a2fac2c40614a3689eb12c012be29d29e70979b3c5e3b8b7502d
Deleted: sha256:0048a0a35e0ca217947dda9381349c70ec0839d3912bab4d6b35059ccfb7304b
Deleted: sha256:b327e8162d446750ebba549ce05c92af61005db1e0bdbb9aa9b5c1944655f8d9
Deleted: sha256:20822dc7ea1874a39fc19bd494954d583c3527d21c616b75ea9f97d7399b141d
Deleted: sha256:b01e19a300e98a26e4c38d30ba53b75ecf3bc9da8f6db53170665623185073e2
Deleted: sha256:fca556d8f982e630485bf2a9ef70d86882ad9904a90a58ed1ad59edcebfc60f9
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b9f900cf58344fbf58b93539fb5cb20056b7f55383b7becdd9b4fb75ad92d02c
Associated tags:
- 20210209-000923
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210209-000923
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210209-000923].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b9f900cf58344fbf58b93539fb5cb20056b7f55383b7becdd9b4fb75ad92d02c].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 37m 28s
91 actionable tasks: 61 executed, 30 from cache
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/cxuds5vw2ffuc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]