See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/5168/display/redirect?page=changes>
Changes: [chamikaramj] Automatically enable Runner v2 for pipelines that use cross-language [Kenneth Knowles] Adjust Jenkins configuration to allow more memory per JVM [noreply] copyedited README for RunInference examples (#21855) [noreply] Document and test overriding batch type inference (#21844) [noreply] Update references to Jira to GH for the Python SDK (#21831) [noreply] add highlights to changes (#21865) ------------------------------------------ [...truncated 16.10 KB...] > Task :sdks:java:build-tools:createCheckerFrameworkManifest > Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest > Task :runners:flink:1.15:copySourceOverrides > Task :sdks:java:io:kafka:processResources NO-SOURCE > Task :sdks:java:extensions:join-library:processResources NO-SOURCE > Task :sdks:java:extensions:arrow:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest > Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest > Task :sdks:java:io:mongodb:createCheckerFrameworkManifest > Task :sdks:java:io:hadoop-common:createCheckerFrameworkManifest > Task :sdks:java:io:hadoop-common:processResources NO-SOURCE > Task :runners:flink:1.15:createCheckerFrameworkManifest > Task :sdks:java:io:parquet:createCheckerFrameworkManifest > Task :sdks:java:io:mongodb:processResources NO-SOURCE > Task :runners:flink:1.15:copyResourcesOverrides NO-SOURCE > Task :sdks:java:io:parquet:processResources NO-SOURCE > Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE > Task :sdks:java:io:amazon-web-services2:createCheckerFrameworkManifest > Task :runners:flink:1.15:processResources > Task :sdks:java:io:amazon-web-services2:processResources NO-SOURCE > Task :sdks:python:container:goPrepare UP-TO-DATE > Task :sdks:java:extensions:sql:udf:createCheckerFrameworkManifest > Task > :sdks:java:extensions:sql:expansion-service:createCheckerFrameworkManifest > Task :sdks:java:extensions:protobuf:extractProto > Task :sdks:java:extensions:sql:zetasql:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:expansion-service:processResources NO-SOURCE > Task :release:go-licenses:py:copyLicenses > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task :sdks:java:extensions:sql:zetasql:processResources NO-SOURCE > Task :release:go-licenses:py:dockerClean UP-TO-DATE > Task :sdks:python:container:py37:copyLicenseScripts > Task :release:go-licenses:py:dockerPrepare > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :sdks:python:container:py37:copyLicenses > Task :sdks:python:container:py37:dockerClean UP-TO-DATE > Task :sdks:java:core:processResources > Task :sdks:java:extensions:sql:udf:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:udf:processResources NO-SOURCE > Task :sdks:java:extensions:sql:udf:classes UP-TO-DATE > Task :sdks:java:build-tools:compileJava FROM-CACHE > Task :sdks:java:build-tools:processResources > Task :sdks:java:build-tools:classes > Task :sdks:java:extensions:sql:udf:jar > Task :sdks:java:build-tools:jar > Task :release:go-licenses:py:docker Sending build context to Docker daemon 5.12kB Step 1/6 : FROM golang:1.16-bullseye ---> 972d8c0bc0fc Step 2/6 : RUN go get github.com/google/[email protected] ---> Using cache ---> 22dad81af94e Step 3/6 : COPY get-licenses.sh /opt/apache/beam/ ---> Using cache ---> 601ed7e06f57 Step 4/6 : ARG sdk_location ---> Using cache ---> d724cb844b55 Step 5/6 : ENV sdk_location=$sdk_location ---> Using cache ---> 47f72af92eeb Step 6/6 : ENTRYPOINT /opt/apache/beam/get-licenses.sh ---> Using cache ---> d62ab6aae918 Successfully built d62ab6aae918 Successfully tagged golicenses-python:latest > Task :sdks:python:container:goBuild /home/jenkins/go/bin/go1.18.1 build -o ./build/target/launcher/linux_amd64/boot boot.go piputil.go > Task :model:pipeline:extractIncludeProto > Task :release:go-licenses:py:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/python/container > Task :model:pipeline:extractProto > Task :model:pipeline:generateProto FROM-CACHE > Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore > Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :model:pipeline:jar > Task :model:pipeline:shadowJar FROM-CACHE > Task :sdks:java:extensions:sql:generateFmppSources > Task :model:fn-execution:extractIncludeProto > Task :model:job-management:extractIncludeProto > Task :model:fn-execution:generateProto FROM-CACHE > Task :model:job-management:generateProto FROM-CACHE > Task :sdks:python:container:py37:copyLauncherDependencies > Task :sdks:java:extensions:sql:compileJavacc Java Compiler Compiler Version 4.0 (Parser Generator) (type "javacc" with no arguments for help) Reading from file <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/java/extensions/sql/build/generated/fmpp/javacc/Parser.jj> . . . Note: UNICODE_INPUT option is specified. Please make sure you create the parser/lexer using a Reader with the correct character encoding. Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :sdks:python:setupVirtualenv Collecting pip Using cached pip-22.1.2-py3-none-any.whl (2.1 MB) Installing collected packages: pip Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 > Task :sdks:java:extensions:sql:compileJavacc File "TokenMgrError.java" does not exist. Will create one. File "ParseException.java" does not exist. Will create one. File "Token.java" does not exist. Will create one. File "SimpleCharStream.java" does not exist. Will create one. Parser generated with 0 errors and 1 warnings. > Task :sdks:java:extensions:sql:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:processResources > Task :sdks:python:setupVirtualenv Successfully installed pip-22.1.2 Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from -r <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/build-requirements.txt> (line 20)) (44.0.0) Collecting setuptools Using cached setuptools-62.4.0-py3-none-any.whl (1.2 MB) Collecting wheel>=0.36.0 Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting six>=1.14.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.14.1-py2.py3-none-any.whl (8.8 MB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting filelock>=3.0.0 Using cached filelock-3.7.1-py3-none-any.whl (10 kB) Collecting packaging>=14 Using cached packaging-21.3-py3-none-any.whl (40 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting grpcio>=1.37.0 Using cached grpcio-1.46.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.4 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.20.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting pyparsing!=3.0.5,>=2.0.2 Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB) Collecting platformdirs<3,>=2 Using cached platformdirs-2.5.2-py3-none-any.whl (14 kB) Installing collected packages: distlib, wheel, toml, six, setuptools, pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging, mypy-protobuf, grpcio, tox, grpcio-tools Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 > Task :model:fn-execution:shadowJar > Task :model:job-management:shadowJar > Task :sdks:python:setupVirtualenv Successfully installed distlib-0.3.1 filelock-3.7.1 grpcio-1.46.3 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.2 pluggy-1.0.0 protobuf-3.20.1 py-1.11.0 pyparsing-3.0.9 setuptools-62.4.0 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.14.1 wheel-0.37.1 > Task :sdks:python:sdist org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:531: UserWarning: Normalizing '2.40.0.dev' to '2.40.0.dev0' warnings.warn(tmpl.format(**locals())) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py37:copyDockerfileDependencies > Task :model:job-management:shadowJar FAILED > Task :model:fn-execution:shadowJar FROM-CACHE > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py37:copyGolangLicenses > Task :sdks:python:container:py37:dockerPrepare > Task :sdks:python:container:py37:docker FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':model:job-management:shadowJar'. > Failed to load cache entry for task ':model:job-management:shadowJar' * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 21m 6s 90 actionable tasks: 71 executed, 15 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/orpuxny6bk7eq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
