See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4568/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Fix script location in build_release_candidate.sh
[Kenneth Knowles] Build release candidate from tag
[Kenneth Knowles] Run release scripts from PWD not cloned repo
[Kenneth Knowles] Take build_release_candidate.sh parameters on command line
for easy
[Kenneth Knowles] Use SSH auth URL for pushing beam-site branch
[Robert Bradshaw] Add runner capabilities to Beam model proto.
[Robert Bradshaw] Runner Capabilities, go proto.
[Robert Bradshaw] Plumb runner capabilities to Beam SDKs.
[Boyuan Zhang] [BEAM-12160] Add TODO for fixing warning
[Robert Bradshaw] Avoid sending zero msec counters.
[randomstep] [BEAM-11903] Bump achilles to 6.1.0
[Andrew Pilloud] More tests for time types
[noreply] Merge pull request #14467 from [BEAM-11607] Add word count tasks
[Andrew Pilloud] [BEAM-9379] Output outside of codegen, support rows
[Robert Bradshaw] [BEAM-12170] Handle duplicate metrics due to flatten
unzipping.
[noreply] [BEAM-366] Populate display data in portable job representation
(#14470)
[noreply] [BEAM-12118] Modify QueuingBeamFnDataClient to avoid completion
latency
[noreply] [BEAM-7372] cleanup py2 codepath from apache_beam/testing (#14496)
[Robert Bradshaw] Fix one more usage.
[noreply] [BEAM-7372] cleanup py2 codepath from apache_beam/tool,
[noreply] [BEAM-12074] Add @with_docs_from decorator for generating API docs
------------------------------------------
[...truncated 340.31 KB...]
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:go:coder:custom:v1"
payload:
"Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
>
>
>
coders: <
key: "c10"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/16 00:17:47 Prepared job with id:
go-job-5-1618532267507522287_55fcd8d9-c4b6-4d4d-a787-6c6c78653e5b and staging
token: go-job-5-1618532267507522287_55fcd8d9-c4b6-4d4d-a787-6c6c78653e5b
2021/04/16 00:17:47 Cross-compiling
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go>
as /tmp/worker-5-1618532267512303926
21/04/16 00:17:50 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging
artifacts for go-job-5-1618532267507522287_55fcd8d9-c4b6-4d4d-a787-6c6c78653e5b.
21/04/16 00:17:50 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving
artifacts for
go-job-5-1618532267507522287_55fcd8d9-c4b6-4d4d-a787-6c6c78653e5b.go.
21/04/16 00:17:50 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1
artifacts for
go-job-5-1618532267507522287_55fcd8d9-c4b6-4d4d-a787-6c6c78653e5b.null.
21/04/16 00:17:50 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts
fully staged for
go-job-5-1618532267507522287_55fcd8d9-c4b6-4d4d-a787-6c6c78653e5b.
2021/04/16 00:17:50 Staged binary artifact with token:
21/04/16 00:17:50 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking
job
go0job0501618532267507522287-jenkins-0416001750-fc96d531_b21ec12b-a1fd-4d61-825d-66437a84dda3
21/04/16 00:17:50 INFO org.apache.beam.runners.jobsubmission.JobInvocation:
Starting job invocation
go0job0501618532267507522287-jenkins-0416001750-fc96d531_b21ec12b-a1fd-4d61-825d-66437a84dda3
2021/04/16 00:17:50 Submitted job:
go0job0501618532267507522287-jenkins-0416001750-fc96d531_b21ec12b-a1fd-4d61-825d-66437a84dda3
2021/04/16 00:17:50 Job state: STOPPED
2021/04/16 00:17:50 Job state: STARTING
2021/04/16 00:17:50 Job state: RUNNING
21/04/16 00:17:50 ERROR org.apache.beam.runners.jobsubmission.JobInvocation:
Error during job invocation
go0job0501618532267507522287-jenkins-0416001750-fc96d531_b21ec12b-a1fd-4d61-825d-66437a84dda3.
java.lang.NullPointerException
at
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
at
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2021/04/16 00:17:50 (): java.lang.NullPointerException
at
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
at
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2021/04/16 00:17:50 (): java.lang.NullPointerException
2021/04/16 00:17:50 Job state: FAILED
21/04/16 00:17:50 INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics
for
go0job0501618532267507522287-jenkins-0416001750-fc96d531_b21ec12b-a1fd-4d61-825d-66437a84dda3
21/04/16 00:17:50 INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job
metrics for
go0job0501618532267507522287-jenkins-0416001750-fc96d531_b21ec12b-a1fd-4d61-825d-66437a84dda3
--- FAIL: TestWordCount (17.75s)
wordcount_test.go:87: WordCount("foo") failed: job
go0job0101618532252925411732-jenkins-0416001736-7cd84681_36ee6048-228d-49ff-b278-ce745328390b
failed
wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job
go0job0201618532256318337898-jenkins-0416001739-7e56f998_4bee3f78-eec5-4216-b5fd-b0b4704705aa
failed
wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job
go0job0301618532259642784954-jenkins-0416001743-879bbc3b_56f143ce-7f97-4ebd-bdcc-ed8814dc927a
failed
wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job
go0job0401618532263227421411-jenkins-0416001747-256abcb_2e03f9d0-8332-42ea-a1f3-273a76de912e
failed
wordcount_test.go:87: WordCount("|bar foo bar| |
|foo bar| foo") failed: job
go0job0501618532267507522287-jenkins-0416001750-fc96d531_b21ec12b-a1fd-4d61-825d-66437a84dda3
failed
FAIL
FAIL github.com/apache/beam/sdks/go/test/integration/wordcount 17.776s
2021/04/16 00:17:53 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all
runners
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:139: Test TestXLang_Combine is currently filtered for runner
spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:139: Test TestXLang_CombineGlobally is currently filtered
for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:139: Test TestXLang_Flatten is currently filtered for runner
spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:139: Test TestXLang_GroupBy is currently filtered for runner
spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:105: Test TestXLang_Multi is currently sickbayed on all
runners
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:105: Test TestXLang_Partition is currently sickbayed on all
runners
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.037s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'>
line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 25s
82 actionable tasks: 69 executed, 13 from cache
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/74jas3bstpbpk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
