See <https://ci-beam.apache.org/job/beam_PreCommit_PythonDocker_Cron/757/display/redirect?page=changes>
Changes: [piotr.szuberski] Update proton-j 0.13.1 -> 0.16.0, update activemq 5.13.1 -> 5.14.5 [Ismaël Mejía] Enable UsesStrictTimerOrdering ValidatesRunner tests on Spark Classic [Robert Bradshaw] [BEAM-10988] Partition dataframes according to size estimates. [Robert Bradshaw] [BEAM-10988] Batch dataframes across partitions on the same worker. [piotr.szuberski] [BEAM-5589 BEAM-5590 BEAM-5591] Update Solr dependencies from 5.5.4 to [noreply] [BEAM-9196] Update testcontainers to 1.15.0-rc2 (#13031) [Kenneth Knowles] Add gradle target for ValidatesRunner against Dataflow forcing streaming [Kenneth Knowles] Add Jenkins job for ValidatesRunner against Dataflow forcing streaming ------------------------------------------ [...truncated 1.51 MB...] mmh3==2.5.1 mock==2.0.0 monotonic==1.5 mypy-extensions==0.4.3 nose==1.3.7 numpy==1.17.3 oauth2client==4.1.3 oauthlib==3.1.0 opt-einsum==3.3.0 pandas==0.25.2 pbr==5.5.0 pip==20.2.3 proto-plus==1.10.1 protobuf==3.12.2 protorpc==0.12.0 PTable==0.9.2 pyarrow==0.16.0 pyasn1==0.4.8 pyasn1-modules==0.2.8 pycparser==2.20 pydot==1.4.1 PyHamcrest==1.10.1 pymongo==3.9.0 pyparsing==2.4.7 python-dateutil==2.8.1 python-gflags==3.0.6 pytz==2019.3 PyYAML==5.3.1 requests==2.24.0 requests-oauthlib==1.3.0 rsa==4.6 scipy==1.4.1 setuptools==50.3.0 six==1.15.0 tenacity==6.2.0 tensorboard==2.3.0 tensorboard-plugin-wit==1.7.0 tensorflow==2.3.0 tensorflow-estimator==2.3.0 termcolor==1.1.0 typing-extensions==3.7.4.3 typing-inspect==0.6.0 urllib3==1.25.10 Werkzeug==1.0.1 wheel==0.35.1 wrapt==1.12.1 zipp==3.3.0 Removing intermediate container d40c66e259e6 ---> e31a05c374ad Step 19/23 : RUN pip check ---> Running in c6eb9468610c No broken requirements found. > Task :sdks:python:container:py36:docker Removing intermediate container 39711f5d51ab ---> e50871194ad5 Step 12/23 : COPY target/license_scripts /tmp/license_scripts/ ---> 87cbd55a4597 Step 13/23 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 38a4aae97f2b Step 14/23 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in be27ee7581ab Removing intermediate container be27ee7581ab ---> 48dd1264555d Step 15/23 : COPY target/license_scripts /tmp/license_scripts/ ---> dc18aa6c1acf Step 16/23 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 8555df7ca7b7 Collecting pip-licenses<3.0.0 Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22907 sha256=59a34b463600b5e47f5ce69bf1fb96b118db1c660457560f73be2e4597ffc933 Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 Ignoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment [91mINFO:root:Successfully pulled licenses for 90 dependencies [0mFound existing installation: pip-licenses 2.3.0 Uninstalling pip-licenses-2.3.0: Successfully uninstalled pip-licenses-2.3.0 Removing intermediate container 8555df7ca7b7 ---> 4d5c2a3adaa8 Step 17/23 : RUN rm -rf /tmp/license_scripts ---> Running in adb4e090c4fb Removing intermediate container adb4e090c4fb ---> 0b023cae5a99 Step 18/23 : RUN pip freeze --all ---> Running in 342b0ab33853 absl-py==0.10.0 apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz astunparse==1.6.3 avro-python3==1.8.2 cachetools==4.1.1 certifi==2020.6.20 cffi==1.14.3 chardet==3.0.4 crcmod==1.7 Cython==0.29.13 dataclasses==0.7 dill==0.3.1.1 docopt==0.6.2 fastavro==1.0.0.post1 fasteners==0.15 future==0.18.2 gast==0.3.3 google-api-core==1.22.0 google-apitools==0.5.31 google-auth==1.22.1 google-auth-oauthlib==0.4.1 google-cloud-bigquery==1.26.1 google-cloud-bigtable==1.0.0 google-cloud-build==2.0.0 google-cloud-core==1.4.1 google-cloud-datastore==1.7.4 google-cloud-dlp==1.0.0 google-cloud-language==1.3.0 google-cloud-pubsub==1.0.2 google-cloud-spanner==1.19.0 google-cloud-videointelligence==1.16.0 google-cloud-vision==1.0.0 google-crc32c==1.0.0 google-pasta==0.2.0 google-resumable-media==1.1.0 googleapis-common-protos==1.52.0 grpc-google-iam-v1==0.12.3 grpcio==1.29.0 grpcio-gcp==0.2.2 guppy3==3.0.9 h5py==2.10.0 hdfs==2.5.8 httplib2==0.12.0 idna==2.10 importlib-metadata==2.0.0 Keras-Preprocessing==1.1.2 libcst==0.3.12 Markdown==3.3 mmh3==2.5.1 mock==2.0.0 monotonic==1.5 mypy-extensions==0.4.3 nose==1.3.7 numpy==1.17.3 oauth2client==4.1.3 oauthlib==3.1.0 opt-einsum==3.3.0 pandas==0.25.2 pbr==5.5.0 pip==20.2.3 proto-plus==1.10.1 protobuf==3.12.2 protorpc==0.12.0 PTable==0.9.2 pyarrow==0.16.0 pyasn1==0.4.8 pyasn1-modules==0.2.8 pycparser==2.20 pydot==1.4.1 PyHamcrest==1.10.1 pymongo==3.9.0 pyparsing==2.4.7 python-dateutil==2.8.1 python-gflags==3.0.6 pytz==2019.3 PyYAML==5.3.1 requests==2.24.0 requests-oauthlib==1.3.0 rsa==4.6 scipy==1.4.1 setuptools==50.3.0 six==1.15.0 tenacity==6.2.0 tensorboard==2.3.0 tensorboard-plugin-wit==1.7.0 tensorflow==2.3.0 tensorflow-estimator==2.3.0 termcolor==1.1.0 typing-extensions==3.7.4.3 typing-inspect==0.6.0 urllib3==1.25.10 Werkzeug==1.0.1 wheel==0.35.1 wrapt==1.12.1 zipp==3.3.0 Removing intermediate container 342b0ab33853 ---> 4c8ffb805a49 Step 19/23 : RUN pip check ---> Running in 8dc61c6e315b No broken requirements found. Removing intermediate container 8dc61c6e315b ---> 2851cfd4f14c Step 20/23 : COPY target/LICENSE /opt/apache/beam/ ---> df0128535693 Step 21/23 : COPY target/NOTICE /opt/apache/beam/ ---> 00ce77ccb5c0 Step 22/23 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 6554a1a45009 Step 23/23 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 681f3b0ded9c Removing intermediate container 681f3b0ded9c ---> 13f2a77a59b9 Successfully built 13f2a77a59b9 Successfully tagged apache/beam_python3.6_sdk:2.26.0.dev :sdks:python:container:py36:docker (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 7 mins 44.633 secs. > Task :sdks:python:container:py37:docker Removing intermediate container c6eb9468610c ---> bb1095a21044 Step 20/23 : COPY target/LICENSE /opt/apache/beam/ ---> 8b46d054f550 Step 21/23 : COPY target/NOTICE /opt/apache/beam/ ---> 045458fbee32 Step 22/23 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 13682600306a Step 23/23 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 67766982c755 Removing intermediate container 67766982c755 ---> 68db677af477 Successfully built 68db677af477 Successfully tagged apache/beam_python3.7_sdk:2.26.0.dev :sdks:python:container:py37:docker (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 7 mins 44.729 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py38:docker'. > Process 'command 'docker'' finished with non-zero exit value 2 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 15m 23s 42 actionable tasks: 38 executed, 4 up-to-date Publishing build scan... https://gradle.com/s/6do327ds4gmlc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
