See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/826/display/redirect>
Changes:
------------------------------------------
[...truncated 466.51 KB...]
Created wheel for apache-beam:
filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9872885
sha256=e5e501b2534492f256f607cf6567ca93db5bf849845ad5f02082e85e8a923b12
Stored in directory:
/root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect,
google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory
/usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory
/usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory
/usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3
google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3
typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0mRemoving intermediate container 8eafa035cbb1
---> 9c7c2684846a
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> 8b29b4f5d94b
Step 16/27 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 9fd89b967db2
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 548ba84a630a
Removing intermediate container 548ba84a630a
---> a889e00e7d82
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> a600975da26e
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install
'pip-licenses<3.0.0;python_version>="3.5"' && pip install
'pip-licenses==1.18.0;python_version<="2.7"' && python
/tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses
&& rm -rf /root/.cache/pip ; else rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 3aee8cb535db
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924
sha256=914edc2704233ee0331689257b416c0e724c533fa8c11e8fb1d1553b491d6824
Stored in directory:
/root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your
environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mFound existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container 3aee8cb535db
---> 8d4215b92d48
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in e8c19ace4c35
Removing intermediate container e8c19ace4c35
---> 83b4f799abb7
Step 21/27 : RUN pip freeze --all
---> Running in 4418bab5d9fe
absl-py==0.14.1
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.26.1
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.0
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.5
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.8
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.6.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container 4418bab5d9fe
---> b897cbf42010
Step 22/27 : RUN pip check
---> Running in 59e818b18fd1
No broken requirements found.
Removing intermediate container 59e818b18fd1
---> b7ee0565f37e
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> 5de1b3c0e447
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> 5adfbebc4a00
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 95e59c6634ba
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 292038419e6b
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 0c7b935ba600
Removing intermediate container 0c7b935ba600
---> a28ccc1e3faf
Successfully built a28ccc1e3faf
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 19, 2021 6:15:39 AM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO: Registering external transforms:
[beam:external:java:kafkaio:externalwithmetadata:v1,
beam:external:java:kafkaio:typedwithoutmetadata:v1,
beam:external:java:kafka:write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
> FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task
> :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'>
line: 198
* What went wrong:
Execution failed for task
':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29m 58s
216 actionable tasks: 164 executed, 45 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/f6tgvehq5h352
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
