See <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/1593/display/redirect?page=changes>
Changes: [mmack] [BEAM-13494] Avoid draining Kinesis API limits & CPU when reading from [arietis27] [BEAM-13517] Unable to write nulls to columns with logical types [noreply] Make S3 streaming more efficient (#15931) ------------------------------------------ [...truncated 32.23 KB...] > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:core:shadowTestJar FROM-CACHE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :runners:core-construction-java:compileTestJava FROM-CACHE > Task :runners:core-construction-java:testClasses UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:core-construction-java:testJar > Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava > FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:testJar > Task :runners:core-java:compileTestJava FROM-CACHE > Task :runners:core-java:testClasses UP-TO-DATE > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :runners:core-java:testJar > Task :runners:google-cloud-dataflow-java:jar > Task :runners:direct-java:compileTestJava FROM-CACHE > Task :runners:direct-java:testClasses UP-TO-DATE > Task :runners:direct-java:shadowTestJar FROM-CACHE > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:extensions:protobuf:extractIncludeTestProto > Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE > Task :sdks:java:extensions:protobuf:testClasses > Task :sdks:java:extensions:protobuf:testJar > Task :sdks:java:container:generateLicenseReport > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:io:google-cloud-platform:testJar > Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE > Task :runners:google-cloud-dataflow-java:testJar > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, beautifulsoup4, pyyaml, six, tenacity Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.1 tenacity-5.1.5 WARNING: You are using pip version 20.2.3; however, version 21.3.1 is available. You should consider upgrading via the '<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/virtualenv/bin/python3.8> -m pip install --upgrade pip' command. Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 210 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 9.704068 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] dea74cf25738: Preparing b15e8d89ec66: Preparing 67d2391fbe55: Preparing ab559160076a: Preparing 7f9469379557: Preparing fc08dafea83d: Preparing d7cb02f1107e: Preparing b7004cc46fe7: Preparing 0e37e5305bf5: Preparing 58690fcb84a5: Preparing 6f08de3a170c: Preparing 4adb81c1bcbb: Preparing bff9fe6e429c: Preparing 7c245b2fe4f1: Preparing f9e18e59a565: Preparing 26a504e63be4: Preparing 8bf42db0de72: Preparing 31892cc314cb: Preparing 11936051f93b: Preparing 4adb81c1bcbb: Waiting bff9fe6e429c: Waiting 0e37e5305bf5: Waiting 26a504e63be4: Waiting 7c245b2fe4f1: Waiting d7cb02f1107e: Waiting 11936051f93b: Waiting 8bf42db0de72: Waiting fc08dafea83d: Waiting f9e18e59a565: Waiting b7004cc46fe7: Waiting 31892cc314cb: Waiting 58690fcb84a5: Waiting 6f08de3a170c: Waiting 67d2391fbe55: Pushed b15e8d89ec66: Pushed 7f9469379557: Pushed ab559160076a: Pushed fc08dafea83d: Pushed dea74cf25738: Pushed b7004cc46fe7: Pushed 0e37e5305bf5: Pushed 6f08de3a170c: Pushed bff9fe6e429c: Layer already exists 7c245b2fe4f1: Layer already exists f9e18e59a565: Layer already exists 26a504e63be4: Layer already exists 8bf42db0de72: Layer already exists 31892cc314cb: Layer already exists d7cb02f1107e: Pushed 4adb81c1bcbb: Pushed 11936051f93b: Layer already exists 58690fcb84a5: Pushed 20211222175406: digest: sha256:967003a6ced104c624f7dd12caf25930c9628030298c97a596cfde6fd7c5297f size: 4311 > Task :runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming org.apache.beam.sdk.transforms.ParDoTest$OnWindowExpirationTests > testOnWindowExpirationSimpleUnboundedGlobal FAILED java.lang.RuntimeException at ParDoTest.java:6431 org.apache.beam.sdk.transforms.ParDoTest$OnWindowExpirationTests > testOnWindowExpirationSimpleBoundedGlobal FAILED java.lang.RuntimeException at ParDoTest.java:6431 org.apache.beam.sdk.transforms.ParDoTest$TimestampTests > testOnWindowTimestampSkew FAILED java.lang.RuntimeException at ParDoTest.java:2209 org.apache.beam.sdk.transforms.ParDoTest$TimestampTests > testProcessElementSkew FAILED java.lang.RuntimeException at ParDoTest.java:2146 org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testWindowedCombineGloballyAsSingletonView FAILED java.lang.RuntimeException at CombineTest.java:1399 249 tests completed, 5 failed, 3 skipped > Task :runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222175406 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:967003a6ced104c624f7dd12caf25930c9628030298c97a596cfde6fd7c5297f Deleted: sha256:d1a08ce6d9be6946514d1c7eecc12286a25cd5f62c67547689a52feb874ccbdd Deleted: sha256:7270e8378e2d414a33b40563368d0c01c17f8c50661771d39c8c1545280ea109 Deleted: sha256:088fc0e43de474babd61c6a062c9d110fab7c51f784bfa78139540bb117d9cec Deleted: sha256:2e7d009598237f3c70cd6df18441164de9f4957cb42fa8005d23f0ced9d25668 Deleted: sha256:0ec2edf82fe8f676aa321a1249cf7b3fcb0b2b8cece530f7c93b7b95a83ac904 Deleted: sha256:e6f2a33f34a89b4651a6a74cb2b766756b39bb4f95cc6dc082255419f5fa877d Deleted: sha256:be2457ec3f6cc509b0162ba39fd27d1888a9235a61c1cb137241975d7493fb47 Deleted: sha256:d021347169294198dec4fcf99f570234f7aeef1ccf8475e2c7f66aa6606fe273 Deleted: sha256:64884dd335d1c5989c491ca29f5013538e59b1698196ee5221b28c93ad4faef6 Deleted: sha256:605dbcd272819f98e69f90fb77d95572cc3bc1535233e853017ec8e6b70908cd Deleted: sha256:a7d582b1304e9f4e046b25816a7164d20f513a6e57e94270a1f925615a5b864d Deleted: sha256:10ac0d730bfe02179f7da4509a42a22799f6bfe3854cfbe47d0d77f73b98e71d Deleted: sha256:d0ea3584051b6450d248a13884235967cde403581c1f55604cd551b6cad2bb35 Deleted: sha256:79d516f93c694d1ed6b1d089f8269c7720f739258d0088b3f94b87e77ef3ffe8 Deleted: sha256:93c2dcd69ca817b199617cd919b4c9e115f53ec9285fac16e7c2b2e245160ce3 Deleted: sha256:125adb64b79eba1458fe1450fb7c231e5fc829d51d11513c677956bc12357fec Deleted: sha256:5da229d3f8ef85bca63ecbd4059f5a851175acd60753d3d64ee4be9a100f2def Deleted: sha256:01a425bd3a3b3ff7608a397b55afa4b5fe41c5bf194789a1b90042f610344967 Deleted: sha256:bd4c22c0d75dd37b9d322c9b96bd4846c07a86cd74e6f837dd7bd9ac2dbd5b81 Deleted: sha256:06d9d338fbfad14a46119e2e26ac846d009dcf77bd48eb2320d2d47c8b7f2ef9 Deleted: sha256:9fe2c1730cfc8fdfd6ff280a11b7a55f3f202b6be3edc83dbf1d004b2f3dfb9b Deleted: sha256:079e4aa6684fcbe5a7f9e20b7f1e7e5d21ca359745d36a252a0317bfc677c908 Deleted: sha256:882d214e4dfe7d216f80d2babcecf338f00c35fb2e76eb95f51341b74f4c328d Deleted: sha256:9839db6edc2ae895772d08285917175dea608837ccaad496c24dadc3e46721f1 Deleted: sha256:ea9d6d22853ff9e3f6492d271c5730c830661dc1d24dca62a4c66dd56e58497a Deleted: sha256:4160dac56de420e909fcac99446f712df0ebdcf13116139895a398cbbf267870 Deleted: sha256:fb493f58b566f0d7bb9c7e6db3a1df54be10273a5fcb53dc829381e8a9d3b532 Deleted: sha256:dfbc1f2d81ffe72961ee608b6e54088b3b3b1992ff6fcd55e693c1be2def249f Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222175406] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:967003a6ced104c624f7dd12caf25930c9628030298c97a596cfde6fd7c5297f] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222175406] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:967003a6ced104c624f7dd12caf25930c9628030298c97a596cfde6fd7c5297f])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:967003a6ced104c624f7dd12caf25930c9628030298c97a596cfde6fd7c5297f Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:967003a6ced104c624f7dd12caf25930c9628030298c97a596cfde6fd7c5297f Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:967003a6ced104c624f7dd12caf25930c9628030298c97a596cfde6fd7c5297f]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesRunnerV2TestStreaming'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerV2TestStreaming/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6h 43m 35s 103 actionable tasks: 59 executed, 42 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/owkpjrwjphsou Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
