See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/2844/display/redirect?page=changes>
Changes: [noreply] Open Allow and test pyarrow 8.x and 9.x (#22997) [noreply] (BQ Python) Pass project field from options or parameter when writing [noreply] Update python-machine-learning.md (#23209) [noreply] Pin the version of cloudpickle to 2.1.x (#23120) [noreply] Add streaming test for Write API sink (#21903) [noreply] [Go SDK] Proto changes for timer param (#23216) [noreply] Bump github.com/testcontainers/testcontainers-go in /sdks (#23201) [noreply] Update to objsize to 0.5.2 which is under BSD-3 license (fixes #23096) ------------------------------------------ [...truncated 58.10 KB...] Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting six>=1.14.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE > Task :sdks:java:extensions:sql:expansion-service:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :release:go-licenses:java:dockerRun go: added github.com/apache/beam/sdks/v2 v2.41.0 go: added github.com/golang/protobuf v1.5.2 go: added golang.org/x/net v0.0.0-20220624214902-1bab6f366d9e go: added golang.org/x/sys v0.0.0-20220624220833-87e55d714810 go: added golang.org/x/text v0.3.7 go: added google.golang.org/genproto v0.0.0-20220714211235-042d03aeabc9 go: added google.golang.org/grpc v1.48.0 go: added google.golang.org/protobuf v1.28.0 + go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses W0913 22:03:01.048039 26 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s + go-licenses csv github.com/apache/beam/sdks/v2/java/container + tee /output/licenses/list.csv > Task :sdks:python:setupVirtualenv Collecting grpcio>=1.37.0 Using cached grpcio-1.48.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Downloading protobuf-3.20.2-py2.py3-none-any.whl (162 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.1/162.1 kB 5.9 MB/s eta 0:00:00 Collecting pyparsing!=3.0.5,>=2.0.2 Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB) Collecting platformdirs<3,>=2 Using cached platformdirs-2.5.2-py3-none-any.whl (14 kB) Installing collected packages: distlib, wheel, toml, six, setuptools, pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging, mypy-protobuf, grpcio, tox, grpcio-tools Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed distlib-0.3.1 filelock-3.8.0 grpcio-1.48.1 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.2 pluggy-1.0.0 protobuf-3.20.2 py-1.11.0 pyparsing-3.0.9 setuptools-65.3.0 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.37.1 > Task :sdks:python:test-suites:portable:py39:setupVirtualenv Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB) Collecting filelock>=3.0.0 Using cached filelock-3.8.0-py3-none-any.whl (10 kB) Collecting packaging>=14 Using cached packaging-21.3-py3-none-any.whl (40 kB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting grpcio>=1.37.0 Using cached grpcio-1.48.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.20.2-py2.py3-none-any.whl (162 kB) Collecting pyparsing!=3.0.5,>=2.0.2 Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB) Collecting platformdirs<3,>=2.4 Using cached platformdirs-2.5.2-py3-none-any.whl (14 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB) Installing collected packages: distlib, wheel, toml, six, setuptools, pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging, mypy-protobuf, grpcio, tox, grpcio-tools Attempting uninstall: setuptools Found existing installation: setuptools 58.1.0 Uninstalling setuptools-58.1.0: Successfully uninstalled setuptools-58.1.0 Successfully installed distlib-0.3.1 filelock-3.8.0 grpcio-1.48.1 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.2 pluggy-1.0.0 protobuf-3.20.2 py-1.11.0 pyparsing-3.0.9 setuptools-65.3.0 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.37.1 > Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE > Task :sdks:java:container:pullLicenses Collecting pip Using cached pip-22.2.2-py3-none-any.whl (2.0 MB) Collecting setuptools Using cached setuptools-65.3.0-py3-none-any.whl (1.2 MB) Collecting wheel Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Installing collected packages: pip, setuptools, wheel Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed pip-22.2.2 setuptools-65.3.0 wheel-0.37.1 Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB) Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4 Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5 Executing python <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses> INFO:root:Pulling license for 254 dependencies using 16 threads. > Task :sdks:python:sdist org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi setup.py:142: UserWarning: Could not import gen_protos, skipping proto generation. warnings.warn("Could not import gen_protos, skipping proto generation.") <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:530: UserWarning: Normalizing '2.43.0.dev' to '2.43.0.dev0' warnings.warn(tmpl.format(**locals())) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :release:go-licenses:java:dockerRun W0913 22:03:06.183660 174 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0 github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0 google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE > Task :sdks:java:container:pullLicenses INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5 INFO:root:pull_licenses_java.py succeed. It took 12.243825 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:goPrepare UP-TO-DATE > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:container:goBuild /home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go > Task :sdks:java:container:java8:copySdkHarnessLauncher Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons: - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem. - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem. > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[31mERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log> [0m================================== log start =================================== Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'error' error: subprocess-exited-with-error × python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [10 lines of output] Traceback (most recent call last): File "<string>", line 2, in <module> File "<pip-setuptools-caller>", line 34, in <module> File "/tmp/pip-req-build-rs3j7i5f/setup.py", line 169, in <module> generate_protos_first() File "/tmp/pip-req-build-rs3j7i5f/setup.py", line 139, in generate_protos_first gen_protos.generate_proto_files() File "/tmp/pip-req-build-rs3j7i5f/gen_protos.py", line 476, in generate_proto_files raise RuntimeError(error_msg) RuntimeError: Not in apache git tree, unable to find proto definitions. [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. =================================== log end ==================================== ___________________________________ summary ____________________________________ [31mERROR: flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1) [0m > Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK > FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1m 17s 147 actionable tasks: 98 executed, 45 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/wuubean5ryuvu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
