See 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/2490/display/redirect?page=changes>

Changes:

[noreply] Make go vet and go staticcheck output visible in CI (#24786)

[noreply] [Go SDK] Fix multimap support for the direct runner (#24775)

[noreply] [#24515] Ensure that Go pipelines on Dataflow are not allowed to opt 
out


------------------------------------------
[...truncated 55.92 KB...]
Collecting soupsieve>1.2
  Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 
soupsieve-2.3.2.post1 tenacity-5.1.5
Executing python 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
 
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
        
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
        
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
        
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 235 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 2.357841 seconds with 16 
threads.
Copying licenses from 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
 to 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.19.3 build -o ./build/target/linux_amd64/boot boot.go 
boot_test.go

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task 
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due 
to the following reasons:
  - Gradle detected a problem with the following location: 
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target'.>
 Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this 
output of task ':sdks:java:container:downloadCloudProfilerAgent' without 
declaring an explicit or implicit dependency. This can lead to incorrect 
results being produced, depending on what order the tasks are executed. Please 
refer to 
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.
  - Gradle detected a problem with the following location: 
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target'.>
 Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this 
output of task ':sdks:java:container:pullLicenses' without declaring an 
explicit or implicit dependency. This can lead to incorrect results being 
produced, depending on what order the tasks are executed. Please refer to 
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.

> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.2
go: downloading google.golang.org/grpc v1.50.1
go: downloading google.golang.org/protobuf v1.28.1
go: downloading golang.org/x/sys v0.0.0-20220728004956-3c1f35247d10
go: downloading google.golang.org/genproto v0.0.0-20221010155953-15ba04fc1c0e
go: downloading golang.org/x/net v0.0.0-20221012135044-0b7e1fb9d458
go: added github.com/apache/beam/sdks/v2 v2.43.0
go: added github.com/golang/protobuf v1.5.2
go: added golang.org/x/net v0.0.0-20221012135044-0b7e1fb9d458
go: added golang.org/x/sys v0.0.0-20220728004956-3c1f35247d10
go: added golang.org/x/text v0.4.0
go: added google.golang.org/genproto v0.0.0-20221010155953-15ba04fc1c0e
go: added google.golang.org/grpc v1.50.1
go: added google.golang.org/protobuf v1.28.1
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W1227 21:58:56.313253      34 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W1227 21:59:00.604261      78 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.43.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.43.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/0b7e1fb9:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/3c1f3524:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.4.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/15ba04fc1c0e/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.50.1/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.1/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
0d9f0a06a742: Preparing
a7eaf91f4e31: Preparing
130d46475f1f: Preparing
126d7ebf00c6: Preparing
247a50606739: Preparing
d59a3da4f87c: Preparing
914a472f2b99: Preparing
596bc1786c02: Preparing
6360ce31dbab: Preparing
843f2a59f477: Preparing
0ba8ae809bcd: Preparing
437ba43ba97f: Preparing
235dbc562c94: Preparing
1931a098c079: Preparing
e47df409684a: Preparing
6b5aaff44254: Preparing
53a0b163e995: Preparing
b626401ef603: Preparing
9b55156abf26: Preparing
293d5db30c9f: Preparing
914a472f2b99: Waiting
03127cdb479b: Preparing
9c742cd6c7a5: Preparing
6b5aaff44254: Waiting
596bc1786c02: Waiting
53a0b163e995: Waiting
6360ce31dbab: Waiting
293d5db30c9f: Waiting
03127cdb479b: Waiting
9b55156abf26: Waiting
843f2a59f477: Waiting
0ba8ae809bcd: Waiting
235dbc562c94: Waiting
437ba43ba97f: Waiting
e47df409684a: Waiting
d59a3da4f87c: Waiting
1931a098c079: Waiting
9c742cd6c7a5: Waiting
a7eaf91f4e31: Pushed
126d7ebf00c6: Pushed
130d46475f1f: Pushed
247a50606739: Pushed
0d9f0a06a742: Pushed
596bc1786c02: Pushed
914a472f2b99: Pushed
d59a3da4f87c: Pushed
6360ce31dbab: Pushed
437ba43ba97f: Pushed
0ba8ae809bcd: Pushed
843f2a59f477: Pushed
6b5aaff44254: Layer already exists
53a0b163e995: Layer already exists
b626401ef603: Layer already exists
9b55156abf26: Layer already exists
293d5db30c9f: Layer already exists
03127cdb479b: Layer already exists
9c742cd6c7a5: Layer already exists
e47df409684a: Pushed
1931a098c079: Pushed
235dbc562c94: Pushed
20221227215743: digest: 
sha256:9a5d77a39bd42788083bd8845b76508abdbff7bee605c216e2af39e71dfa45f5 size: 
4934

> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest 
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: 
projects/apache-beam-testing/topics/testpipeline-jenkins-1227215950-72865859
The Pub/Sub subscription has been set up for this example: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1227215950-72865859
*************************Tear Down*************************
The Pub/Sub topic has been deleted: 
projects/apache-beam-testing/topics/testpipeline-jenkins-1227215950-72865859
The Pub/Sub subscription has been deleted: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1227215950-72865859
***********************************************************
***********************************************************

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: 
projects/apache-beam-testing/topics/testpipeline-jenkins-1227215950-8c3c8d99
The Pub/Sub subscription has been set up for this example: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1227215950-8c3c8d99
*************************Tear Down*************************
The Pub/Sub topic has been deleted: 
projects/apache-beam-testing/topics/testpipeline-jenkins-1227215950-8c3c8d99
The Pub/Sub subscription has been deleted: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1227215950-8c3c8d99
***********************************************************
***********************************************************

> Task 
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest

org.apache.beam.sdk.io.gcp.pubsub.PubsubSchemaIT > classMethod FAILED
    java.nio.file.NoSuchFileException at PubsubSchemaIT.java:85

org.apache.beam.sdk.io.gcp.pubsub.PubsubSchemaIT > classMethod FAILED
    io.grpc.StatusRuntimeException at PubsubSchemaIT.java:96

81 tests completed, 2 failed, 2 skipped

> Task 
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
>  FAILED

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221227215743
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9a5d77a39bd42788083bd8845b76508abdbff7bee605c216e2af39e71dfa45f5
Deleted: sha256:77b7ea42ef191cad94a8de7b0a4b2db2f424ccc1c42fee3bc465ef0116dce57b
Deleted: sha256:a1df3fc6fe0f2fb9db490d9d56b3290b8eda8f9d125f683b3d779a47ef477059
Deleted: sha256:f6b27bc80b1b21752def2019667453817764f8622d9fac8c4e290bb3464d1e7e
Deleted: sha256:7fd33b6421adb92ef113091d596be4a09d271cff66c2f1fdda28297761fbf025
Deleted: sha256:e7202810a5a363601318ac00fe51f52c0e3520d05f51b29b77e45181968f17c3
Deleted: sha256:8129b546e683de54aa9dce6d1b7045803ec3473058825275f3e68b7a52904576
Deleted: sha256:6b6f37986a8967b8cb9fc96bea6a70480537417955e8fe188650a9f5a853220c
Deleted: sha256:8cebc9369e1f874eb7aa57717147334f2311f3728d8049988438a9069041925d
Deleted: sha256:f23812efa13ff65836e427759eaed95ae57a61d028f73c2d83a4da53c6ba662e
Deleted: sha256:9837630a8ebd83887db63d72dce6aa52bec1fa20daae2ff8135f0ae4039efa62
Deleted: sha256:72fe0c44e7baa80c857591b564d81c05a1e6132f7ed085cc2008ba633319b8de
Deleted: sha256:35b18c33ea2c3dc9218d64da8b3fa4b0fea25a5ea8dae8ec0d54dfc37783b4be
Deleted: sha256:abf90ac5070dfe690ab23609306b9ab63bfd00a38aadbad4415d7178dd40bce6
Deleted: sha256:dfcd88be4a69e19a5e6091fc0acebeba88279223ccfa57ff8acc2984d205f08a
Deleted: sha256:6c8c74d126817448d832e2aa7fc14c6214561098d706de3b3828df177d7518d8
Deleted: sha256:0e44848239f4fc760563bfe6ab6c900b80d036501b790731c17b14bfcba03f69
Deleted: sha256:88041916755ecb35bdb62d01679d31566908322421f6b1c207732eb1add4d7c2
Deleted: sha256:f645a1b52d98d82f65adf91f047ea37bfcc6f18a07ae6e3404da1fbd5631e133
Deleted: sha256:9625d0c832a89e49f415053ae919e9a83fcbc3402d776d6a151f5f277ed1a301
Deleted: sha256:83a149967f22272fef8db5124377d30d41e701f57e3fb5e64292b05d46a11868
Deleted: sha256:2033b6bb98b654ca1c2115bf2a1e3d2d81238a889e50f1f7a2cae098ab629417
Deleted: sha256:aac6c4c894042dc7f25bacf0d1550ad0b5e3616e8c2374aa848072d0230bf103
Deleted: sha256:92d22291b13ec8c2704e8cbe66dc0042590ffd346ec3af45e681acda5decbb53
Deleted: sha256:65e7f5c80092533a2bb350593831c8fd4da37a4fb552f08f68c35377e9913b2b
Deleted: sha256:750f2f233e292b282b6039dd0cf5b28ab4765e1f816e3b9ccdd64c93607176d3
Deleted: sha256:ea64a0f1ffd24a6dedae45c90c021683552fe30f35e4662192ae64d1f6cd09c9
Deleted: sha256:6ed6b3eacf4b1079e9d74d9c00e3edd404102c7df7b99f31e9e200a8b952a4e8
Deleted: sha256:c45239cbf0d78a0b1907b05a57c0036e374a70edb175e33bff5e2b14569eaab4
Deleted: sha256:7a2f3f240f75e71686213e03f754c3dd21a7abb3fb2051ddc038afe6e0dff1b8
Deleted: sha256:cdff34fae6a7c9fad6271c1c87f8b1efec478f028e6fdbe57966ad4bfca6d986
Deleted: sha256:1c55b6a07cb5b46ea8b5157387d9633dd80ed902a5c7cdf106147dd8762a0911
Deleted: sha256:2d4061f3818dd57bd6fbd7169ef89073d0e23def0a273969fcdbaf15b7bf3ad5
Deleted: sha256:2adcc63736bbfc65ce2c9fbc264739feec141ccc7cfcff029315be7f9d73c956
Deleted: sha256:6dd6f3f9fd0272db8dcd01b9997f883fb91250e11776771f4b7ae7215595b197
WARNING: Successfully resolved tag to sha256, but it is recommended to use 
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221227215743]
- referencing digest: 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9a5d77a39bd42788083bd8845b76508abdbff7bee605c216e2af39e71dfa45f5]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221227215743] 
(referencing 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9a5d77a39bd42788083bd8845b76508abdbff7bee605c216e2af39e71dfa45f5])].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9a5d77a39bd42788083bd8845b76508abdbff7bee605c216e2af39e71dfa45f5
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9a5d77a39bd42788083bd8845b76508abdbff7bee605c216e2af39e71dfa45f5
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9a5d77a39bd42788083bd8845b76508abdbff7bee605c216e2af39e71dfa45f5].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task 
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at: 
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during 
this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 3h 25m 35s
145 actionable tasks: 93 executed, 48 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/avvx63brgjcg2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to