See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1753/display/redirect?page=changes>
Changes: [daria.malkova] Support SCIO SDK via sbt projects [samuelw] [BEAM-11648] Share thread pool across RetryManager instances. [Pablo Estrada] Exclude per-key order tests on Twister2 runner [Heejong Lee] Fix Java SDK container image name for load-tests and nexmark [noreply] [BEAM-6744] Support implicitly setting project id in Go Dataflow runner [noreply] Merge pull request #16493 from [BEAM-13632][Playground] Save catalog [noreply] Exclude jul-to-slf4j from Spark runner in quickstart POM templates [noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned [noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666) [noreply] [BEAM-13777] Accept cache capacity as input parameter instead of default [noreply] [BEAM-13051][A] Enable pylint warnings [noreply] [BEAM-13779] Fix pr labeling (#16665) [noreply] Merge pull request #16581 from [BEAM-12164]: Add [noreply] Fix labeler trigger (#16674) [noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency [noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710), [noreply] [BEAM-13740] Correctly install go before running tests (#16673) [noreply] [BEAM-12830] Update local Docker env Go version. (#16670) [noreply] [BEAM-13051][B] Enable pylint warnings ------------------------------------------ [...truncated 696 B...] Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 8f8577ab759c8c13f821a65011d7ff02eea81782 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 8f8577ab759c8c13f821a65011d7ff02eea81782 # timeout=10 Commit message: "[BEAM-13051][B] Enable pylint warnings (import-error/invalid-unary-operand-type) (#16522)" > git rev-list --no-walk 71decd82ba429fc06020ec54dc7efac7db3c7353 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/gradlew> --continue --max-workers=6 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest Starting a Gradle Daemon, 3 busy Daemons could not be reused, use --status for details Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build > Configure project :sdks:go:test System Go installation: /snap/bin/go is go version go1.16.13 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Configure project :sdks:java:container System Go installation: /snap/bin/go is go version go1.16.13 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Configure project :sdks:go System Go installation: /snap/bin/go is go version go1.16.13 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Task :sdks:java:core:createCheckerFrameworkManifest > Task :model:job-management:createCheckerFrameworkManifest > Task :model:fn-execution:createCheckerFrameworkManifest > Task :model:pipeline:createCheckerFrameworkManifest > Task :runners:core-construction-java:createCheckerFrameworkManifest > Task :examples:java:createCheckerFrameworkManifest > Task :sdks:java:core:generateAvroProtocol NO-SOURCE > Task :runners:core-construction-java:processResources NO-SOURCE > Task :sdks:java:core:generateAvroJava NO-SOURCE > Task :sdks:java:fn-execution:createCheckerFrameworkManifest > Task :sdks:java:fn-execution:processResources NO-SOURCE > Task :runners:core-java:createCheckerFrameworkManifest > Task :runners:core-java:processResources NO-SOURCE > Task > :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest > Task :runners:java-fn-execution:createCheckerFrameworkManifest > Task :model:fn-execution:extractProto > Task :model:job-management:extractProto > Task :sdks:java:extensions:google-cloud-platform-core:processResources > NO-SOURCE > Task :runners:java-fn-execution:processResources NO-SOURCE > Task :sdks:java:harness:createCheckerFrameworkManifest > Task :sdks:java:harness:processResources NO-SOURCE > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :sdks:java:expansion-service:createCheckerFrameworkManifest > Task :model:job-management:processResources > Task :model:fn-execution:processResources > Task :sdks:java:extensions:ml:createCheckerFrameworkManifest > Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest > Task :sdks:java:expansion-service:processResources NO-SOURCE > Task :sdks:java:extensions:arrow:processResources NO-SOURCE > Task :sdks:java:extensions:ml:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest > Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest > Task :examples:java:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:extractProto > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE > Task :sdks:java:io:kafka:createCheckerFrameworkManifest > Task :sdks:java:io:kafka:processResources NO-SOURCE > Task :runners:local-java:createCheckerFrameworkManifest > Task :runners:local-java:processResources NO-SOURCE > Task :runners:direct-java:createCheckerFrameworkManifest > Task :examples:java:processTestResources > Task :runners:direct-java:processResources NO-SOURCE > Task :sdks:go:goPrepare UP-TO-DATE > Task :sdks:java:core:processResources > Task :runners:google-cloud-dataflow-java:createCheckerFrameworkManifest > Task :sdks:java:container:java8:copyLicenses > Task :sdks:java:container:java8:dockerClean UP-TO-DATE > Task :runners:google-cloud-dataflow-java:processResources > Task :release:go-licenses:java:copyLicenses > Task :release:go-licenses:java:dockerClean UP-TO-DATE > Task :release:go-licenses:java:dockerPrepare > Task :sdks:java:container:downloadCloudProfilerAgent > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :sdks:java:container:goBuild /home/jenkins/go/bin/go1.16.12 build -o ./build/target/linux_amd64/boot boot.go > Task :sdks:java:container:java8:copySdkHarnessLauncher Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons: - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.3.2/userguide/validation_problems.html#implicit_dependency for more details about this problem. > Task :release:go-licenses:java:docker > Task :sdks:java:container:generateLicenseReport > Task :model:pipeline:generateProto > Task :release:go-licenses:java:docker Sending build context to Docker daemon 5.12kB Step 1/6 : FROM golang:1.16-bullseye ---> 6c29725f0797 Step 2/6 : RUN go get github.com/google/go-licenses ---> Using cache ---> 5cdf031b58ed Step 3/6 : COPY get-licenses.sh /opt/apache/beam/ ---> Using cache ---> f09a3d983499 Step 4/6 : ARG sdk_location ---> Using cache ---> cb0b7e2de514 Step 5/6 : ENV sdk_location=$sdk_location ---> Using cache ---> 3fbf16811e50 Step 6/6 : ENTRYPOINT /opt/apache/beam/get-licenses.sh ---> Using cache ---> faa458d2c6a9 Successfully built faa458d2c6a9 Successfully tagged golicenses-java:latest > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> > Task :model:pipeline:generateProto FAILED > Task :model:pipeline:processResources > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/java/container > Task :sdks:java:container:pullLicenses Collecting pip Using cached pip-22.0.2-py3-none-any.whl (2.1 MB) Collecting setuptools Using cached setuptools-60.6.0-py3-none-any.whl (953 kB) Collecting wheel Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Installing collected packages: pip, setuptools, wheel Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed pip-22.0.2 setuptools-60.6.0 wheel-0.37.1 Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 217 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 6.713429 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':model:pipeline:generateProto'. > Failed to load cache entry for task ':model:pipeline:generateProto' * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 5m 43s 57 actionable tasks: 48 executed, 5 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/7dygoo4ssfjwg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
