See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1885/display/redirect?page=changes>
Changes: [noreply] Support configuration of maxCapacityPerShard when reading from Kinesis ------------------------------------------ [...truncated 1.11 MB...] #16 1.081 Markdown==3.4.3 #16 1.081 MarkupSafe==2.1.2 #16 1.081 ml-dtypes==0.0.4 #16 1.081 mmh3==3.1.0 #16 1.081 mock==5.0.1 #16 1.081 nltk==3.8.1 #16 1.081 nose==1.3.7 #16 1.081 numpy==1.23.5 #16 1.081 oauth2client==4.1.3 #16 1.081 oauthlib==3.2.2 #16 1.081 objsize==0.6.1 #16 1.081 opt-einsum==3.3.0 #16 1.081 orjson==3.8.9 #16 1.081 overrides==6.5.0 #16 1.081 packaging==23.0 #16 1.081 pandas==1.5.3 #16 1.081 parameterized==0.8.1 #16 1.081 pip==23.1.2 #16 1.081 pluggy==1.0.0 #16 1.081 proto-plus==1.22.2 #16 1.081 protobuf==4.22.1 #16 1.081 psycopg2-binary==2.9.6 #16 1.081 pyarrow==11.0.0 #16 1.081 pyasn1==0.4.8 #16 1.081 pyasn1-modules==0.2.8 #16 1.081 pycparser==2.21 #16 1.081 pydot==1.4.2 #16 1.081 PyHamcrest==1.10.1 #16 1.081 pymongo==4.3.3 #16 1.081 PyMySQL==1.0.3 #16 1.081 pyparsing==3.0.9 #16 1.081 pytest==7.2.2 #16 1.081 pytest-timeout==2.1.0 #16 1.081 pytest-xdist==3.2.1 #16 1.081 python-dateutil==2.8.2 #16 1.081 pytz==2023.3 #16 1.081 PyYAML==6.0 #16 1.081 regex==2023.3.23 #16 1.081 requests==2.28.2 #16 1.081 requests-mock==1.10.0 #16 1.081 requests-oauthlib==1.3.1 #16 1.081 rsa==4.9 #16 1.081 scikit-learn==1.2.2 #16 1.081 scipy==1.10.1 #16 1.081 setuptools==67.7.2 #16 1.081 six==1.16.0 #16 1.081 sortedcontainers==2.4.0 #16 1.081 soupsieve==2.4 #16 1.081 SQLAlchemy==1.4.47 #16 1.081 sqlparse==0.4.4 #16 1.081 tenacity==8.2.2 #16 1.081 tensorboard==2.12.1 #16 1.081 tensorboard-data-server==0.7.0 #16 1.081 tensorboard-plugin-wit==1.8.1 #16 1.081 tensorflow==2.12.0 #16 1.081 tensorflow-estimator==2.12.0 #16 1.081 tensorflow-io-gcs-filesystem==0.32.0 #16 1.081 termcolor==2.2.0 #16 1.081 testcontainers==3.7.1 #16 1.081 threadpoolctl==3.1.0 #16 1.081 tqdm==4.65.0 #16 1.081 typing_extensions==4.5.0 #16 1.081 urllib3==1.26.15 #16 1.081 websocket-client==1.5.1 #16 1.081 Werkzeug==2.2.3 #16 1.081 wheel==0.40.0 #16 1.081 wrapt==1.14.1 #16 1.081 zstandard==0.20.0 #16 DONE 1.2s #17 [beam 13/16] COPY target/LICENSE /opt/apache/beam/ #17 DONE 0.0s #18 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/ #18 DONE 0.1s #19 [beam 15/16] COPY target/NOTICE /opt/apache/beam/ #19 DONE 0.0s #20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/ #20 DONE 0.2s #21 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #21 DONE 0.1s #22 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #22 DONE 0.1s #23 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #23 DONE 0.1s #24 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #24 1.004 Collecting pip-licenses<5 #24 1.074 Downloading pip_licenses-4.3.1-py3-none-any.whl (19 kB) #24 1.086 Requirement already satisfied: pyyaml in /usr/local/lib/python3.11/site-packages (6.0) #24 1.087 Requirement already satisfied: tenacity in /usr/local/lib/python3.11/site-packages (8.2.2) #24 1.137 Collecting prettytable>=2.3.0 (from pip-licenses<5) #24 1.153 Downloading prettytable-3.7.0-py3-none-any.whl (27 kB) #24 1.208 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5) #24 1.222 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #24 2.269 Installing collected packages: wcwidth, prettytable, pip-licenses #24 2.409 Successfully installed pip-licenses-4.3.1 prettytable-3.7.0 wcwidth-0.2.6 #24 2.410 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #24 15.94 INFO:root:Successfully pulled licenses for 127 dependencies #24 15.94 Skip pulling license for bs4 #24 DONE 16.1s #25 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #25 DONE 0.1s #26 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #26 DONE 0.4s #27 exporting to image #27 exporting layers #27 exporting layers 15.5s done #27 writing image sha256:a4ba735e7f38fbd6b67b888f65fec6c1c82e19a9f63fa1fac0de7e3b2e201d45 0.0s done #27 naming to docker.io/apache/beam_python3.11_sdk:2.48.0.dev done #27 DONE 15.5s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] b441575958e4: Preparing 16f9ae6f9f9d: Preparing 9cc39e846ac3: Preparing 3aeb408a4253: Preparing 428fd02a1cc1: Preparing 08dc9b33d624: Preparing 859252b90a6a: Preparing b65d6c11d73d: Preparing 347425621e7c: Preparing c558670baec6: Preparing c55c140969a0: Preparing 680ccad0c4ee: Preparing 72dd5b58a520: Preparing ff412e121428: Preparing ab5c78fab3c1: Preparing d9586658132f: Preparing 33f6ad6f72e3: Preparing 889828f94722: Preparing b0f747a5176b: Preparing b65d6c11d73d: Waiting 859252b90a6a: Waiting 7dac77253a2b: Preparing 347425621e7c: Waiting 0007505dc811: Preparing f43725f97b9f: Preparing 9c42af2c6418: Preparing d96e248f10e6: Preparing c558670baec6: Waiting 08dc9b33d624: Waiting d925e0fae4e6: Preparing c55c140969a0: Waiting 33f6ad6f72e3: Waiting b0f747a5176b: Waiting 7dac77253a2b: Waiting 680ccad0c4ee: Waiting 889828f94722: Waiting 0007505dc811: Waiting d9586658132f: Waiting 72dd5b58a520: Waiting ff412e121428: Waiting f43725f97b9f: Waiting d96e248f10e6: Waiting 9c42af2c6418: Waiting d925e0fae4e6: Waiting 3aeb408a4253: Pushed 428fd02a1cc1: Pushed 16f9ae6f9f9d: Pushed b441575958e4: Pushed 9cc39e846ac3: Pushed 08dc9b33d624: Pushed 859252b90a6a: Pushed b65d6c11d73d: Pushed c558670baec6: Pushed 680ccad0c4ee: Pushed c55c140969a0: Pushed d9586658132f: Pushed 33f6ad6f72e3: Pushed 889828f94722: Layer already exists b0f747a5176b: Layer already exists 7dac77253a2b: Layer already exists 0007505dc811: Layer already exists f43725f97b9f: Layer already exists ff412e121428: Pushed 9c42af2c6418: Layer already exists d925e0fae4e6: Layer already exists d96e248f10e6: Layer already exists 347425621e7c: Pushed 72dd5b58a520: Pushed ab5c78fab3c1: Pushed errors: blob unknown: Manifest "sha256:b4d333f939835b4552dd0c13cdac9b458aa638ba6bfb2dd262389c38c3a2e23e" blob "sha256:24685c45a0666ce4c4fd2549486e75dddb514a707f696efffb172135bc73a1a4" unknown to registry. blob unknown: Manifest "sha256:b4d333f939835b4552dd0c13cdac9b458aa638ba6bfb2dd262389c38c3a2e23e" blob "sha256:6ba57ec00f34b6d56ddaa10db393ec13c400f04ca2e42f6253880e71d5c2bdb5" unknown to registry. blob unknown: Manifest "sha256:b4d333f939835b4552dd0c13cdac9b458aa638ba6bfb2dd262389c38c3a2e23e" blob "sha256:71bcc9787aa73b1ba974e185b1a5e3c8f87acf7bdd2728045367944faca54cd8" unknown to registry. > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 40193 Launching Python expansion service @ 40583 > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 568278. Stopping expansion service pid: 568279. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 331 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 12m 1s 143 actionable tasks: 22 executed, 121 up-to-date Publishing build scan... https://ge.apache.org/s/4b2p62b22xdsg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
