See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/828/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-13042] Prevent unexpected blocking in
[ilya.kozyrev] Implement initial server with grpcweb wrapper
[noreply] [BEAM-13068] Add a SQL API in Beam Go SDK (#15746)
------------------------------------------
[...truncated 470.70 KB...]
Created wheel for apache-beam:
filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9872801
sha256=9d356e8ae860ee4866be7d17bdcfa08bd5ad2174fce336fcc724ac84abd3bf04
Stored in directory:
/root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect,
google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory
/usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory
/usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory
/usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3
google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3
typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0mRemoving intermediate container 8eb8116a9545
---> 38978b997d01
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> d098d3ef6070
Step 16/27 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 19b8bd69d2e8
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 30dfaa69bac6
Removing intermediate container 30dfaa69bac6
---> 494fd238225d
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 032a29fbcb29
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install
'pip-licenses<3.0.0;python_version>="3.5"' && pip install
'pip-licenses==1.18.0;python_version<="2.7"' && python
/tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses
&& rm -rf /root/.cache/pip ; else rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in fb90fed07986
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924
sha256=b073ccd8c0bb93b289141c4a6b2ec2e330ba9d83bc25dd94c7297a85b24cc55b
Stored in directory:
/root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your
environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3 is
available.
You should consider upgrading via the '/usr/local/bin/python -m pip install
--upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mSkip pulling license for bs4
Found existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container fb90fed07986
---> 4a321ab1179d
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in 470eacd84abf
Removing intermediate container 470eacd84abf
---> 0833041f627b
Step 21/27 : RUN pip freeze --all
---> Running in c5de65c6c63d
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.27.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.0
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.5
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.8
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.6.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container c5de65c6c63d
---> bee2a4abbb27
Step 22/27 : RUN pip check
---> Running in c45bea674526
No broken requirements found.
Removing intermediate container c45bea674526
---> c784f3216819
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> 5f661064ddda
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> abd2cfc9b200
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> d8a451c6957e
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 1f95ed1eb624
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 72e7fe8cd711
Removing intermediate container 72e7fe8cd711
---> f2c3b5aab1f1
Successfully built f2c3b5aab1f1
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 19, 2021 6:14:57 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO: Registering external transforms:
[beam:external:java:kafkaio:externalwithmetadata:v1,
beam:external:java:kafkaio:typedwithoutmetadata:v1,
beam:external:java:kafka:write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
> FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task
> :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'>
line: 198
* What went wrong:
Execution failed for task
':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 37m 54s
216 actionable tasks: 158 executed, 51 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/uehogmavy5aj4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
