See 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1589/display/redirect?page=changes>

Changes:

[rsl4] [BEAM-13397] Bump numpy to 1.21 for M1 chip

[rsl4] re-generate requirements.txt

[Kyle Weaver] [BEAM-13498] Sickbay portable Flink testProcessElementSkew.

[noreply] Update flink cluster to use a supported dataproc version (1.2 -> 1.5)

[noreply] [BEAM-13499] Add warning about hcatalog to release notes and javadoc

[noreply] [BEAM-13430] Remove propdeps and replace with compileOnly (#16308)

[noreply] Merge pull request #16304 from [BEAM-13491] [Playground] Examples'

[noreply] Merge pull request #16283 from [BEAM-13448] [Playground] track run 
code

[noreply] Merge pull request #16244 from [BEAM-13463] [Playground] add retries 
to

[noreply] Merge pull request #16241 from [BEAM-13440] [Playground] Implement

[noreply] [BEAM-13399] Add integration test for Go SDK expansion service JAR

[noreply] [BEAM-13421] Fix bug with xs called with non-tuple key (#16258)


------------------------------------------
[...truncated 17.15 KB...]
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE

> Task :sdks:java:container:goBuild
System Go installation: /usr/bin/go is go version go1.16.12 linux/amd64; 
Preparing to use /home/jenkins/go/bin/go1.16.12
go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12
/home/jenkins/go/bin/go1.16.12 build -o ./build/target/linux_amd64/boot boot.go

> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:container:java8:copySdkHarnessLauncher
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:arrow:jar
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar
> Task :sdks:java:fn-execution:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:compileJava FROM-CACHE
> Task :sdks:java:extensions:ml:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :runners:direct-java:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:jar
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :runners:google-cloud-dataflow-java:jar
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :sdks:java:container:generateLicenseReport

> Task :sdks:java:container:pullLicenses
Copying already-fetched licenses from 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license>
 to 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
Collecting beautifulsoup4<5.0,>=4.9.0
  Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting pyyaml<6.0.0,>=3.12
  Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
  Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, beautifulsoup4, pyyaml, six, tenacity
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0 
soupsieve-2.3.1 tenacity-5.1.5
WARNING: You are using pip version 20.2.3; however, version 21.3.1 is available.
You should consider upgrading via the 
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python3.8>
 -m pip install --upgrade pip' command.
Executing 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python>
 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
 
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
        
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
        
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
 
INFO:root:Pulling license for 210 dependencies using 16 threads.
INFO:root:pull_licenses_java.py succeed. It took 46.683055 seconds with 16 
threads.
Copying licenses from 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
 to 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container 
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
87e7b41d0c40: Preparing
ff6302e03232: Preparing
7576c6d0f4b2: Preparing
d9b2c4179fc4: Preparing
e95a845c0de9: Preparing
bf6d67a173fe: Preparing
be67857c7768: Preparing
87c7963bd206: Preparing
f9bba4675204: Preparing
7f01f87f1114: Preparing
2d607a5469f4: Preparing
6cd51526d9a0: Preparing
4d327f577a2b: Preparing
a6159ee91199: Preparing
a81f1846a0d2: Preparing
3b441d7cb46b: Preparing
d3710de04cb3: Preparing
91f7336bbfff: Preparing
e2e8c39e0f77: Preparing
2d607a5469f4: Waiting
a81f1846a0d2: Waiting
be67857c7768: Waiting
3b441d7cb46b: Waiting
d3710de04cb3: Waiting
91f7336bbfff: Waiting
e2e8c39e0f77: Waiting
87c7963bd206: Waiting
f9bba4675204: Waiting
7f01f87f1114: Waiting
a6159ee91199: Waiting
4d327f577a2b: Waiting
6cd51526d9a0: Waiting
ff6302e03232: Pushed
7576c6d0f4b2: Pushed
87e7b41d0c40: Pushed
e95a845c0de9: Pushed
d9b2c4179fc4: Pushed
f9bba4675204: Pushed
bf6d67a173fe: Pushed
87c7963bd206: Pushed
4d327f577a2b: Layer already exists
a6159ee91199: Layer already exists
a81f1846a0d2: Layer already exists
3b441d7cb46b: Layer already exists
d3710de04cb3: Layer already exists
91f7336bbfff: Layer already exists
e2e8c39e0f77: Layer already exists
2d607a5469f4: Pushed
6cd51526d9a0: Pushed
be67857c7768: Pushed
7f01f87f1114: Pushed
20211222000056: digest: 
sha256:1ab78c1b010a6c795924e969850262bb1a27c6c1e9e12d0fbb087ede2993fe3b size: 
4311

> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest 
> FAILED

org.apache.beam.examples.complete.TrafficRoutesIT > initializationError FAILED
    java.lang.NoClassDefFoundError at Class.java:-2
        Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382

org.apache.beam.examples.cookbook.BigQueryTornadoesIT > initializationError 
FAILED
    java.lang.NoClassDefFoundError at Class.java:-2
        Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382

org.apache.beam.examples.complete.TrafficMaxLaneFlowIT > initializationError 
FAILED
    java.lang.NoClassDefFoundError at Class.java:-2
        Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382

org.apache.beam.examples.complete.TfIdfIT > initializationError FAILED
    java.lang.NoClassDefFoundError at Class.java:-2
        Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382

org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT 
> initializationError FAILED
    java.lang.NoClassDefFoundError at Class.java:-2
        Caused by: java.lang.ClassNotFoundException at URLClassLoader.java:382

5 tests completed, 5 failed

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222000056
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab78c1b010a6c795924e969850262bb1a27c6c1e9e12d0fbb087ede2993fe3b
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222000056]
- referencing digest: 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab78c1b010a6c795924e969850262bb1a27c6c1e9e12d0fbb087ede2993fe3b]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222000056] 
(referencing 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab78c1b010a6c795924e969850262bb1a27c6c1e9e12d0fbb087ede2993fe3b])].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab78c1b010a6c795924e969850262bb1a27c6c1e9e12d0fbb087ede2993fe3b
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab78c1b010a6c795924e969850262bb1a27c6c1e9e12d0fbb087ede2993fe3b
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab78c1b010a6c795924e969850262bb1a27c6c1e9e12d0fbb087ede2993fe3b].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task 
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at: 
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug 
option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See 
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 56s
81 actionable tasks: 48 executed, 31 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/n4o3ti4h6kako

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to