See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/2311/display/redirect?page=changes>
Changes: [noreply] Migrate "beam_PreCommit_SQL" Jenkins job to Github Actions (#28336) ------------------------------------------ [...truncated 711.72 KB...] #9 390.7 removing build/bdist.linux-x86_64/wheel #9 390.8 Building wheel for apache-beam (setup.py): finished with status 'done' #9 390.9 Created wheel for apache-beam: filename=apache_beam-2.51.0.dev0-cp311-cp311-linux_x86_64.whl size=15790475 sha256=b1c0257b66e109de2e0e6292afa228eb9f0393d400dece1f1b0fa25887a9bfd9 #9 390.9 Stored in directory: /root/.cache/pip/wheels/1c/f9/b2/4b1eddc5b0ebe3a955a58e43440c937f3642f0b65c975a1cf4 #9 390.9 Successfully built apache-beam #9 390.9 Installing collected packages: apache-beam #9 393.9 Successfully installed apache-beam-2.51.0.dev0 #9 393.9 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #9 395.8 No broken requirements found. #9 396.5 absl-py==1.4.0 #9 396.5 apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz#sha256=15034acd8cc81ddd6dbe09063d4ebc6142faf7dee77e7072257589fa98283ca1 #9 396.5 astunparse==1.6.3 #9 396.5 attrs==23.1.0 #9 396.5 beautifulsoup4==4.12.2 #9 396.5 bs4==0.0.1 #9 396.5 cachetools==5.3.1 #9 396.5 certifi==2023.7.22 #9 396.5 cffi==1.15.1 #9 396.5 charset-normalizer==3.2.0 #9 396.5 click==8.1.6 #9 396.5 cloudpickle==2.2.1 #9 396.5 crcmod==1.7 #9 396.5 cryptography==41.0.3 #9 396.5 Cython==0.29.36 #9 396.5 deprecation==2.1.0 #9 396.5 dill==0.3.1.1 #9 396.5 dnspython==2.4.2 #9 396.5 docker==6.1.3 #9 396.5 docopt==0.6.2 #9 396.5 execnet==2.0.2 #9 396.5 fastavro==1.8.2 #9 396.5 fasteners==0.18 #9 396.5 flatbuffers==23.5.26 #9 396.5 freezegun==1.2.2 #9 396.5 future==0.18.3 #9 396.5 gast==0.4.0 #9 396.5 google-api-core==2.11.1 #9 396.5 google-apitools==0.5.31 #9 396.5 google-auth==2.22.0 #9 396.5 google-auth-httplib2==0.1.0 #9 396.5 google-auth-oauthlib==1.0.0 #9 396.5 google-cloud-aiplatform==1.29.0 #9 396.5 google-cloud-bigquery==3.11.4 #9 396.5 google-cloud-bigquery-storage==2.22.0 #9 396.5 google-cloud-bigtable==2.21.0 #9 396.5 google-cloud-core==2.3.3 #9 396.5 google-cloud-datastore==2.17.0 #9 396.5 google-cloud-dlp==3.12.2 #9 396.5 google-cloud-language==2.10.1 #9 396.5 google-cloud-pubsub==2.18.2 #9 396.5 google-cloud-pubsublite==1.8.3 #9 396.5 google-cloud-recommendations-ai==0.10.4 #9 396.5 google-cloud-resource-manager==1.10.3 #9 396.5 google-cloud-spanner==3.40.0 #9 396.5 google-cloud-storage==2.10.0 #9 396.5 google-cloud-videointelligence==2.11.3 #9 396.5 google-cloud-vision==3.4.4 #9 396.5 google-crc32c==1.5.0 #9 396.5 google-pasta==0.2.0 #9 396.5 google-resumable-media==2.5.0 #9 396.5 googleapis-common-protos==1.60.0 #9 396.5 greenlet==2.0.2 #9 396.5 grpc-google-iam-v1==0.12.6 #9 396.5 grpcio==1.56.2 #9 396.5 grpcio-status==1.56.2 #9 396.5 guppy3==3.1.3 #9 396.5 h5py==3.9.0 #9 396.5 hdfs==2.7.2 #9 396.5 httplib2==0.22.0 #9 396.5 hypothesis==6.82.3 #9 396.5 idna==3.4 #9 396.5 iniconfig==2.0.0 #9 396.5 joblib==1.3.2 #9 396.5 keras==2.13.1 #9 396.5 libclang==16.0.6 #9 396.5 Markdown==3.4.4 #9 396.5 MarkupSafe==2.1.3 #9 396.5 mmh3==4.0.1 #9 396.5 mock==5.1.0 #9 396.5 nltk==3.8.1 #9 396.5 nose==1.3.7 #9 396.5 numpy==1.24.3 #9 396.5 oauth2client==4.1.3 #9 396.5 oauthlib==3.2.2 #9 396.5 objsize==0.6.1 #9 396.5 opt-einsum==3.3.0 #9 396.5 orjson==3.9.4 #9 396.5 overrides==6.5.0 #9 396.5 packaging==23.1 #9 396.5 pandas==1.5.3 #9 396.5 parameterized==0.9.0 #9 396.5 pip==23.2.1 #9 396.5 pluggy==1.2.0 #9 396.5 proto-plus==1.22.3 #9 396.5 protobuf==4.23.4 #9 396.5 psycopg2-binary==2.9.7 #9 396.5 pyarrow==11.0.0 #9 396.5 pyasn1==0.5.0 #9 396.5 pyasn1-modules==0.3.0 #9 396.5 pycparser==2.21 #9 396.5 pydot==1.4.2 #9 396.5 PyHamcrest==2.0.4 #9 396.5 pymongo==4.4.1 #9 396.5 PyMySQL==1.1.0 #9 396.5 pyparsing==3.1.1 #9 396.5 pytest==7.4.0 #9 396.5 pytest-timeout==2.1.0 #9 396.5 pytest-xdist==3.3.1 #9 396.5 python-dateutil==2.8.2 #9 396.5 pytz==2023.3 #9 396.5 PyYAML==6.0.1 #9 396.5 regex==2023.8.8 #9 396.5 requests==2.31.0 #9 396.5 requests-mock==1.11.0 #9 396.5 requests-oauthlib==1.3.1 #9 396.5 rsa==4.9 #9 396.5 scikit-learn==1.3.0 #9 396.5 scipy==1.11.1 #9 396.5 setuptools==68.1.2 #9 396.5 Shapely==1.8.5.post1 #9 396.5 six==1.16.0 #9 396.5 sortedcontainers==2.4.0 #9 396.5 soupsieve==2.4.1 #9 396.5 SQLAlchemy==1.4.49 #9 396.5 sqlparse==0.4.4 #9 396.5 tenacity==8.2.2 #9 396.5 tensorboard==2.13.0 #9 396.5 tensorboard-data-server==0.7.1 #9 396.5 tensorflow==2.13.0 #9 396.5 tensorflow-estimator==2.13.0 #9 396.5 tensorflow-io-gcs-filesystem==0.33.0 #9 396.5 termcolor==2.3.0 #9 396.5 testcontainers==3.7.1 #9 396.5 threadpoolctl==3.2.0 #9 396.5 tqdm==4.66.0 #9 396.5 typing_extensions==4.5.0 #9 396.5 urllib3==1.26.16 #9 396.5 websocket-client==1.6.1 #9 396.5 Werkzeug==2.3.6 #9 396.5 wheel==0.41.2 #9 396.5 wrapt==1.15.0 #9 396.5 zstandard==0.21.0 #9 DONE 429.9s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 10.9s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 1.3s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.7s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 1.072 Collecting pip-licenses<5 #13 1.073 Obtaining dependency information for pip-licenses<5 from https://files.pythonhosted.org/packages/25/53/a2c514b9133bed6e7e1bc703f6c89f5bf22f93c92da2ac006afcdf036066/pip_licenses-4.3.2-py3-none-any.whl.metadata #13 1.125 Downloading pip_licenses-4.3.2-py3-none-any.whl.metadata (31 kB) #13 1.142 Requirement already satisfied: pyyaml in /usr/local/lib/python3.11/site-packages (6.0.1) #13 1.144 Requirement already satisfied: tenacity in /usr/local/lib/python3.11/site-packages (8.2.2) #13 1.194 Collecting prettytable>=2.3.0 (from pip-licenses<5) #13 1.195 Obtaining dependency information for prettytable>=2.3.0 from https://files.pythonhosted.org/packages/25/1e/4c284713b092ec384fad4399452f43f6446ad9aabc9c0b3c3c0920cc53b6/prettytable-3.8.0-py3-none-any.whl.metadata #13 1.210 Downloading prettytable-3.8.0-py3-none-any.whl.metadata (26 kB) #13 1.267 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5) #13 1.281 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #13 1.312 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB) #13 1.337 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB) #13 2.437 Installing collected packages: wcwidth, prettytable, pip-licenses #13 2.565 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6 #13 2.566 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 9.875 INFO:root:Successfully pulled licenses for 129 dependencies #13 9.875 Skip pulling license for bs4 #13 DONE 21.7s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.2s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 0.3s #16 exporting to image #16 exporting layers #16 exporting layers 22.8s done #16 writing image sha256:0cc4167abfb84766e2905531cf57ee437497345e5574c37b6ba140d11993ff5b done #16 naming to docker.io/apache/beam_python3.11_sdk:2.51.0.dev #16 naming to docker.io/apache/beam_python3.11_sdk:2.51.0.dev done #16 DONE 22.8s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230906191459] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfbc71265afe446c2e6092659487f24975e1a15eefc0940fabb10187e10d1d32] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230906191459] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfbc71265afe446c2e6092659487f24975e1a15eefc0940fabb10187e10d1d32])]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230906191459] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:68778f55f0c9523ac6a52404f35bdfd707b18753a8d2fb97089cf6e02f27eb5f] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230906191459] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:68778f55f0c9523ac6a52404f35bdfd707b18753a8d2fb97089cf6e02f27eb5f])]. > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 13m 52s 179 actionable tasks: 119 executed, 54 from cache, 6 up-to-date Publishing build scan... https://ge.apache.org/s/p37ah5cvkpnje Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
