See
<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/1932/display/redirect?page=changes>
Changes:
[pabloem] [BEAM-2572] Python SDK S3 Filesystem (#9955)
[github] [BEAM-8974] Wait for log messages to be processed before checking them.
------------------------------------------
[...truncated 438.81 KB...]
>
pcollections: <
key: "n7"
value: <
unique_name: "n7"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
>
>
pcollections: <
key: "n8"
value: <
unique_name: "n8"
coder_id: "c4"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
>
>
pcollections: <
key: "n9"
value: <
unique_name: "n9"
coder_id: "c6"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
>
>
windowing_strategies: <
key: "w0"
value: <
window_fn: <
urn: "beam:windowfn:global_windows:v0.1"
>
merge_status: NON_MERGING
window_coder_id: "c1"
trigger: <
default: <
>
>
accumulation_mode: DISCARDING
output_time: END_OF_WINDOW
closing_behavior: EMIT_IF_NONEMPTY
OnTimeBehavior: FIRE_ALWAYS
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:go:coder:custom:v1"
payload:
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
>
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c3"
component_coder_ids: "c3"
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c3"
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c3"
component_coder_ids: "c5"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014736"
>
>
>
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 01:49:23 Prepared job with id:
go-job-7-1576892963109351813_598098b1-72db-4c9f-b19d-8af213cc2f21 and staging
token:
{"sessionId":"go-job-7-1576892963109351813_598098b1-72db-4c9f-b19d-8af213cc2f21","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 01:49:23 Using specified worker binary:
'./sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 01:49:23 Staged binary artifact with token:
/tmp/beam-artifact-staging/go-job-7-1576892963109351813_598098b1-72db-4c9f-b19d-8af213cc2f21/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.runners.flink.FlinkJobInvoker -
Invoking job
go0job0701576892963109351813-jenkins-1221014923-7f875f43_cdb7f8ed-a585-4909-bbfb-28d54d703c70
with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@5f20fc4d
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation - Starting job
invocation
go0job0701576892963109351813-jenkins-1221014923-7f875f43_cdb7f8ed-a585-4909-bbfb-28d54d703c70
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Translating pipeline to
Flink program.
2019/12/21 01:49:23 Submitted job:
go0job0701576892963109351813-jenkins-1221014923-7f875f43_cdb7f8ed-a585-4909-bbfb-28d54d703c70
2019/12/21 01:49:23 Job state: STOPPED
2019/12/21 01:49:23 Job state: STARTING
2019/12/21 01:49:23 Job state: RUNNING
[flink-runner-job-invoker] ERROR
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation - Error during
job invocation
go0job0701576892963109351813-jenkins-1221014923-7f875f43_cdb7f8ed-a585-4909-bbfb-28d54d703c70.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2,
PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at
org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
at
org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
at
org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
at
org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:110)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:84)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2019/12/21 01:49:23 (): java.lang.IllegalArgumentException: PCollectionNodes
[PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at
org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
at
org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
at
org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
at
org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:110)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:84)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2019/12/21 01:49:23 (): java.lang.IllegalArgumentException: PCollectionNodes
[PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService -
Manifest at
/tmp/beam-artifact-staging/go-job-7-1576892963109351813_598098b1-72db-4c9f-b19d-8af213cc2f21/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/go-job-7-1576892963109351813_598098b1-72db-4c9f-b19d-8af213cc2f21/
2019/12/21 01:49:23 Job state: FAILED
2019/12/21 01:49:23 Test flatten:flatten failed: job
go0job0701576892963109351813-jenkins-1221014923-7f875f43_cdb7f8ed-a585-4909-bbfb-28d54d703c70
failed
2019/12/21 01:49:23 Result: 4 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014736
Untagged:
us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:497fbe8f41a8fdcc0529a23827e1763d86aff218b0d3409f16cf7817d587b2a4
Deleted: sha256:11e5b873507d2c1e4a049a323fa5a91749ab0cf20ba49c2eac462c7707b9b3a6
Deleted: sha256:c3b83ae19650d80cf49b07d0c96f62073fa5f42a84574abc0045e56cf67b0019
Deleted: sha256:2901c5837f8bc2f8bf22b0196a570e343e41023f7280be7faa66380cbb8bd71c
Deleted: sha256:c032ed82413629240c139fc45046bb72d9c94742cfd04b90c94a1f2e7199a58b
Deleted: sha256:9d6a33e9050c4b1c3b9ef7f76a458a515981a25c69839fa245d228ae5bb0206f
Deleted: sha256:f1355269f2525c6f0199090b00a2f730067ecceb7ab60e39945eb12f900ff125
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:497fbe8f41a8fdcc0529a23827e1763d86aff218b0d3409f16cf7817d587b2a4
Associated tags:
- 20191221-014736
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014736
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014736].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:497fbe8f41a8fdcc0529a23827e1763d86aff218b0d3409f16cf7817d587b2a4].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'>
line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 52s
65 actionable tasks: 48 executed, 17 from cache
Publishing build scan...
https://gradle.com/s/eqfyaeimafrik
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
