See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/556/display/redirect?page=changes>
Changes: [egalpin] Drops usage of setWindowingStrategyInternal in favour of direct use of [egalpin] Gives unique names to ES IO Write windowing [Pablo Estrada] Update Python base image requirements [Kenneth Knowles] Revert "convert windmill min timestamp to beam min timestamp" [noreply] Fix a few small config issues (#21909) [dannymccormick] Update py to python label [noreply] Daily p0/p1/flaky reports for issues (#21725) ------------------------------------------ [...truncated 420.31 KB...] more-itertools==8.13.0 nltk==3.7 nose==1.3.7 numpy==1.21.6 oauth2client==4.1.3 oauthlib==3.2.0 opt-einsum==3.3.0 orjson==3.7.2 overrides==6.1.0 packaging==21.3 pandas==1.3.5 parameterized==0.7.5 pbr==5.9.0 pip==22.0.4 pluggy==0.13.1 proto-plus==1.20.6 protobuf==3.19.4 psycopg2-binary==2.9.3 py==1.11.0 pyarrow==7.0.0 pyasn1==0.4.8 pyasn1-modules==0.2.8 pycparser==2.21 pydot==1.4.2 PyHamcrest==1.10.1 pymongo==3.12.3 PyMySQL==1.0.2 pyparsing==3.0.9 pytest==4.6.11 pytest-forked==1.4.0 pytest-timeout==1.4.2 pytest-xdist==1.34.0 python-dateutil==2.8.2 python-snappy==0.6.1 pytz==2022.1 PyYAML==6.0 regex==2022.6.2 requests==2.28.0 requests-mock==1.9.3 requests-oauthlib==1.3.1 rsa==4.8 scikit-learn==1.0.2 scipy==1.7.3 setuptools==57.5.0 six==1.16.0 soupsieve==2.3.2.post1 SQLAlchemy==1.4.37 tenacity==5.1.5 tensorboard==2.9.1 tensorboard-data-server==0.6.1 tensorboard-plugin-wit==1.8.1 tensorflow==2.9.1 tensorflow-estimator==2.9.0 tensorflow-io-gcs-filesystem==0.26.0 termcolor==1.1.0 testcontainers==3.6.0 threadpoolctl==3.1.0 tqdm==4.64.0 typing-utils==0.1.0 typing_extensions==4.2.0 uritemplate==4.1.1 urllib3==1.26.9 wcwidth==0.2.5 websocket-client==1.3.2 Werkzeug==2.1.2 wheel==0.37.1 wrapt==1.14.1 zipp==3.8.0 Removing intermediate container a6d1df80c553 ---> f3985d2c54fc Step 16/31 : COPY target/LICENSE /opt/apache/beam/ ---> 1d81da17ad57 Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/ ---> 56c415abf89a Step 18/31 : COPY target/NOTICE /opt/apache/beam/ ---> 218c108c2e73 Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 90e2724e9a76 Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 719cbb8ac0ed Removing intermediate container 719cbb8ac0ed ---> bff6dae873ce Step 21/31 : FROM beam as third_party_licenses ---> bff6dae873ce Step 22/31 : ARG pull_licenses ---> Running in 32e3eeb1c1a0 Removing intermediate container 32e3eeb1c1a0 ---> ffa8018a300f Step 23/31 : COPY target/license_scripts /tmp/license_scripts/ ---> 3ae1d71069ba Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 44efd5615e30 Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in cbb1358af4a5 Removing intermediate container cbb1358af4a5 ---> 89a90f09d11e Step 26/31 : COPY target/license_scripts /tmp/license_scripts/ ---> e25c3ca99886 Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in e6f619271188 Collecting pip-licenses<4.0.0 Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=a5ae93bea2595b78dfd2fbfb0c7b62dd21df3903e1f7cfd63d5616f41391a82e Stored in directory: /root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.4 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mWARNING: You are using pip version 22.0.4; however, version 22.1.2 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0m[91mINFO:root:Successfully pulled licenses for 134 dependencies [0mSkip pulling license for bs4 Removing intermediate container e6f619271188 ---> 0520096ed950 Step 28/31 : FROM beam ---> bff6dae873ce Step 29/31 : ARG pull_licenses ---> Running in fb1999af6328 Removing intermediate container fb1999af6328 ---> a421e0687924 Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 911221b139b2 Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 7776cfa76569 Removing intermediate container 7776cfa76569 ---> ee6011b4cde3 Successfully built ee6011b4cde3 Successfully tagged apache/beam_python3.7_sdk:2.41.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 3fc8a131ae8e: Preparing efab9c752a1d: Preparing 56f93dad8a7e: Preparing cf089a7df250: Preparing 9da5d099c717: Preparing 156164a7db2c: Preparing 2199833c3e3f: Preparing db46a5cdddce: Preparing 3c93a2bc7b41: Preparing b1584fb5d6da: Preparing f359d313142e: Preparing 1de76303f21e: Preparing 798b04a88ee7: Preparing 2ab26f35e168: Preparing 95ed4b29ac29: Preparing de535afa770b: Preparing 9846ae2df640: Preparing fe48e1733f4f: Preparing 13b045a1dfd2: Preparing 2fbabeba902e: Preparing ee509ed6e976: Preparing 9177197c67d0: Preparing 7dbadf2b9bd8: Preparing 798b04a88ee7: Waiting e7597c345c2e: Preparing db46a5cdddce: Waiting 2fbabeba902e: Waiting ee509ed6e976: Waiting 3c93a2bc7b41: Waiting 95ed4b29ac29: Waiting b1584fb5d6da: Waiting 9177197c67d0: Waiting 9846ae2df640: Waiting de535afa770b: Waiting 7dbadf2b9bd8: Waiting f359d313142e: Waiting e7597c345c2e: Waiting fe48e1733f4f: Waiting 1de76303f21e: Waiting 156164a7db2c: Waiting 2199833c3e3f: Waiting 13b045a1dfd2: Waiting 56f93dad8a7e: Pushed 3fc8a131ae8e: Pushed cf089a7df250: Pushed 9da5d099c717: Pushed efab9c752a1d: Pushed 156164a7db2c: Pushed 2199833c3e3f: Pushed 3c93a2bc7b41: Pushed b1584fb5d6da: Pushed f359d313142e: Pushed 2ab26f35e168: Pushed de535afa770b: Layer already exists 9846ae2df640: Layer already exists fe48e1733f4f: Layer already exists 95ed4b29ac29: Pushed 13b045a1dfd2: Layer already exists 2fbabeba902e: Layer already exists ee509ed6e976: Layer already exists 9177197c67d0: Layer already exists 7dbadf2b9bd8: Layer already exists e7597c345c2e: Layer already exists db46a5cdddce: Pushed 1de76303f21e: Pushed 798b04a88ee7: Pushed 20220616165704: digest: sha256:f699e919f1ce357a4efd102ebd078cf99f79978117ed3bf626316072fd5b2f1b size: 5361 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:core:shadowJar'. > Failed to load cache entry for task ':sdks:java:core:shadowJar' * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 14m 26s 96 actionable tasks: 72 executed, 18 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/5svthl35kx4ss Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
