See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/106/display/redirect?page=changes>
Changes: [noreply] Add max/min batch size to tf model handlers (#26651) ------------------------------------------ [...truncated 2.72 MB...] #18 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/ #18 DONE 0.0s #19 [beam 15/16] COPY target/NOTICE /opt/apache/beam/ #19 DONE 0.0s #20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/ #20 DONE 0.2s #21 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #21 DONE 0.1s #22 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #22 DONE 0.1s #23 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #23 DONE 0.1s #24 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #24 1.049 Collecting pip-licenses<5 #24 1.113 Downloading pip_licenses-4.3.1-py3-none-any.whl (19 kB) #24 1.123 Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0) #24 1.124 Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (8.2.2) #24 1.193 Collecting prettytable>=2.3.0 (from pip-licenses<5) #24 1.211 Downloading prettytable-3.7.0-py3-none-any.whl (27 kB) #24 1.273 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5) #24 1.289 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #24 2.479 Installing collected packages: wcwidth, prettytable, pip-licenses #24 2.651 Successfully installed pip-licenses-4.3.1 prettytable-3.7.0 wcwidth-0.2.6 #24 2.652 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #24 11.57 Skip pulling license for bs4 #24 11.57 Traceback (most recent call last): #24 11.57 File "/tmp/license_scripts/pull_licenses_py.py", line 190, in <module> #24 11.57 raise RuntimeError( #24 11.57 RuntimeError: Could not retrieve licences for packages ['keras'] in Python3.9 environment. #24 11.57 These licenses were not able to be pulled automatically. Please search code source of the dependencies on the internet and add urls to RAW license file at sdks/python/container/license_scripts/dep_urls_py.yaml for each missing license and rerun the test. If no such urls can be found, you need to manually add LICENSE and NOTICE (if available) files at sdks/python/container/license_scripts/manual_licenses/{dep}/ and add entries to sdks/python/container/license_scripts/dep_urls_py.yaml. #24 ERROR: executor failed running [/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi]: exit code: 1 ------ > [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip > install 'pip-licenses<5' pyyaml tenacity && python > /tmp/license_scripts/pull_licenses_py.py ; fi: #24 1.289 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #24 2.479 Installing collected packages: wcwidth, prettytable, pip-licenses #24 2.651 Successfully installed pip-licenses-4.3.1 prettytable-3.7.0 wcwidth-0.2.6 #24 2.652 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #24 11.57 Skip pulling license for bs4 #24 11.57 Traceback (most recent call last): #24 11.57 File "/tmp/license_scripts/pull_licenses_py.py", line 190, in <module> #24 11.57 raise RuntimeError( #24 11.57 RuntimeError: Could not retrieve licences for packages ['keras'] in Python3.9 environment. #24 11.57 These licenses were not able to be pulled automatically. Please search code source of the dependencies on the internet and add urls to RAW license file at sdks/python/container/license_scripts/dep_urls_py.yaml for each missing license and rerun the test. If no such urls can be found, you need to manually add LICENSE and NOTICE (if available) files at sdks/python/container/license_scripts/manual_licenses/{dep}/ and add entries to sdks/python/container/license_scripts/dep_urls_py.yaml. ------ ERROR: failed to solve: executor failed running [/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi]: exit code: 1 > Task :sdks:python:container:py39:docker FAILED > Task :sdks:python:test-suites:dataflow:py37:validatesContainer ============================= test session starts ============================== platform linux -- Python 3.7.12, pytest-7.3.1, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python> configfile: pytest.ini plugins: xdist-3.2.1, hypothesis-6.75.2, timeout-2.1.0, requests-mock-1.10.0 timeout: 1800.0s timeout method: signal timeout func_only: False gw0 I [gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] gw0 [5] scheduling tests via LoadScheduling apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it [gw0] [ 20%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build [gw0] [ 40%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker [gw0] [ 60%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_use_sibling_sdk_workers [gw0] [ 80%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_use_sibling_sdk_workers apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it [gw0] [100%] SKIPPED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it =============================== warnings summary =============================== ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:121 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning) ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2870: 36 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2870: 26 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2349 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py>:2349: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(parent) ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/google/rpc/__init__.py:20 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages pkg_resources.declare_namespace(__name__) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/pytest-beam_python3.7_sdk.xml> - =========== 4 passed, 10 skipped, 80 warnings in 1744.25s (0:29:04) ============ echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" >>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20230511-142613571208162 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:d91a6e6c2a4a812374b989cfad74ce015e5e6264f0a1fe8ddcb9aff991d46c6f Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:3b6c5ada-511f-4e08-9c1b-d9a29b8a55f5 Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:16382363493cae4f2d8183b418afaead0b728b6c273e40c2c80c3775214cd7a0 Deleted: sha256:3f257686b53ab61f49ac72b13e13fd7a33b3b4aeba1fc8503872192387149b37 Deleted: sha256:d221d3a1702d6ab54ef0b536a34c80660477e79c8828222cff659c2ad96f68f0 Deleted: sha256:3c885a1c62f49b2dfae06f9da010d4438da0fb782199c911b9a9903576711834 Deleted: sha256:707c0c63d1d0069fcbd985e238ed11c4a7eeb17016d9788d42a2ad70ae5a6bc2 Deleted: sha256:281048e5244f365d790b8d9771f5031049801486be00defc95f29eaa30b7731b Deleted: sha256:4718ea577ac2ee5c6807317dd49836c46308213d53972495c7a5d70039b242e7 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:d91a6e6c2a4a812374b989cfad74ce015e5e6264f0a1fe8ddcb9aff991d46c6f Associated tags: - 20230511-142613571208162 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20230511-142613571208162 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20230511-142613571208162]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:d91a6e6c2a4a812374b989cfad74ce015e5e6264f0a1fe8ddcb9aff991d46c6f]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:16382363493cae4f2d8183b418afaead0b728b6c273e40c2c80c3775214cd7a0 Associated tags: - 3b6c5ada-511f-4e08-9c1b-d9a29b8a55f5 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:3b6c5ada-511f-4e08-9c1b-d9a29b8a55f5]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:16382363493cae4f2d8183b418afaead0b728b6c273e40c2c80c3775214cd7a0]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:99646d9546b7096f7ebe366bfdafc1a2ff571087f8bb2fa99f23de54d1bd2851 Associated tags: - 66e5eede-5952-48be-a4b6-1f4334f1877d Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:66e5eede-5952-48be-a4b6-1f4334f1877d]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:99646d9546b7096f7ebe366bfdafc1a2ff571087f8bb2fa99f23de54d1bd2851]. Removed the container FAILURE: Build completed with 4 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py310:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py311:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py38:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 4: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py39:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 43m 1s 74 actionable tasks: 62 executed, 4 from cache, 8 up-to-date Build scan background action failed. java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590) at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557) at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230) at java.lang.reflect.WeakCache.get(WeakCache.java:127) at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419) at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719) at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66) at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61) at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Publishing build scan... https://ge.apache.org/s/gjhhbo77ktrgo Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
