See
<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/137/display/redirect?page=changes>
Changes:
[robertwb] Update go beam runner generated protos.
[kcweaver] [BEAM-9225] Fix Flink uberjar job termination bug.
[kcweaver] Reuse get_state method.
[robertwb] [BEAM-9339] Declare capabilities for Go SDK.
[lcwik] [BEAM-5605] Eagerly close the BoundedReader once we have read everything
[lcwik] fixup! Fix SpotBugs failure
[kcweaver] [BEAM-9022] publish Spark job server Docker image
------------------------------------------
[...truncated 93.57 KB...]
Collecting google-cloud-bigquery==1.17.0
Downloading google_cloud_bigquery-1.17.0-py2.py3-none-any.whl (140 kB)
Collecting proto-google-cloud-datastore-v1==0.90.4
Downloading proto-google-cloud-datastore-v1-0.90.4.tar.gz (20 kB)
Collecting google-cloud-bigtable==0.32.1
Downloading google_cloud_bigtable-0.32.1-py2.py3-none-any.whl (156 kB)
Collecting google-cloud-core==1.0.2
Downloading google_cloud_core-1.0.2-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-datastore==1.7.4
Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting cython==0.29.10
Downloading Cython-0.29.10-cp27-cp27mu-manylinux1_x86_64.whl (2.0 MB)
Collecting python-snappy==0.5.4
Downloading python-snappy-0.5.4.tar.gz (21 kB)
Collecting numpy==1.16.4
Downloading numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting scipy==1.2.2
Downloading scipy-1.2.2-cp27-cp27mu-manylinux1_x86_64.whl (24.8 MB)
Collecting pandas==0.24.2
Downloading pandas-0.24.2-cp27-cp27mu-manylinux1_x86_64.whl (10.1 MB)
Collecting protorpc==0.12.0
Downloading protorpc-0.12.0-py2-none-any.whl (134 kB)
Collecting python-gflags==3.0.6
Downloading python-gflags-3.0.6.tar.gz (49 kB)
Collecting tensorflow==2.1.0
Downloading tensorflow-2.1.0-cp27-cp27mu-manylinux2010_x86_64.whl (421.8 MB)
Collecting pymongo==3.8.0
Downloading pymongo-3.8.0-cp27-cp27mu-manylinux1_x86_64.whl (410 kB)
Collecting tenacity>=5.0.2
Downloading tenacity-6.0.0-py2.py3-none-any.whl (24 kB)
Collecting pyhamcrest<2.0,>=1.9
Downloading PyHamcrest-1.10.1.tar.gz (43 kB)
Collecting six>=1.5.2
Downloading six-1.14.0-py2.py3-none-any.whl (10 kB)
Collecting enum34>=1.0.4; python_version < "3.4"
Downloading enum34-1.1.6-py2-none-any.whl (12 kB)
Collecting docopt
Downloading docopt-0.6.2.tar.gz (25 kB)
Collecting requests>=2.7.0
Downloading requests-2.23.0-py2.py3-none-any.whl (58 kB)
Collecting pbr>=0.11
Downloading pbr-5.4.4-py2.py3-none-any.whl (110 kB)
Collecting funcsigs>=1; python_version < "3.3"
Downloading funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting pyasn1>=0.1.7
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting pyasn1-modules>=0.0.5
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa>=3.1.4
Downloading rsa-4.0-py2.py3-none-any.whl (38 kB)
Requirement already satisfied: setuptools in
/usr/local/lib/python2.7/site-packages (from protobuf==3.9.0->-r
/tmp/base_image_requirements.txt (line 38)) (44.0.0)
Collecting pyparsing>=2.1.4
Downloading pyparsing-2.4.6-py2.py3-none-any.whl (67 kB)
Collecting fasteners>=0.14
Downloading fasteners-0.15-py2.py3-none-any.whl (23 kB)
Collecting grpc-google-iam-v1<0.12dev,>=0.11.4
Downloading grpc-google-iam-v1-0.11.4.tar.gz (12 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.6.0
Downloading google_api_core-1.16.0-py2.py3-none-any.whl (70 kB)
Collecting google-resumable-media>=0.3.1
Downloading google_resumable_media-0.5.0-py2.py3-none-any.whl (38 kB)
Collecting googleapis-common-protos<2.0dev,>=1.5.2
Downloading googleapis-common-protos-1.51.0.tar.gz (35 kB)
Collecting python-dateutil>=2.5.0
Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting absl-py>=0.7.0
Downloading absl-py-0.9.0.tar.gz (104 kB)
Collecting gast==0.2.2
Downloading gast-0.2.2.tar.gz (10 kB)
Collecting keras-applications>=1.0.8
Downloading Keras_Applications-1.0.8.tar.gz (289 kB)
Collecting astor>=0.6.0
Downloading astor-0.8.1-py2.py3-none-any.whl (27 kB)
Collecting tensorflow-estimator<2.2.0,>=2.1.0rc0
Downloading tensorflow_estimator-2.1.0-py2.py3-none-any.whl (448 kB)
Collecting google-pasta>=0.1.6
Downloading google_pasta-0.1.8-py2-none-any.whl (57 kB)
Requirement already satisfied: wheel; python_version < "3" in
/usr/local/lib/python2.7/site-packages (from tensorflow==2.1.0->-r
/tmp/base_image_requirements.txt (line 70)) (0.34.2)
Collecting keras-preprocessing>=1.1.0
Downloading Keras_Preprocessing-1.1.0-py2.py3-none-any.whl (41 kB)
Collecting opt-einsum>=2.3.2
Downloading opt_einsum-2.3.2.tar.gz (59 kB)
Collecting backports.weakref>=1.0rc1; python_version < "3.4"
Downloading backports.weakref-1.0.post1-py2.py3-none-any.whl (5.2 kB)
Collecting termcolor>=1.1.0
Downloading termcolor-1.1.0.tar.gz (3.9 kB)
Collecting wrapt>=1.11.1
Downloading wrapt-1.12.0.tar.gz (27 kB)
Collecting tensorboard<2.2.0,>=2.1.0
Downloading tensorboard-2.1.0-py2-none-any.whl (3.8 MB)
Collecting functools32>=3.2.3; python_version < "3"
Downloading functools32-3.2.3-2.tar.gz (31 kB)
Collecting monotonic>=0.6; python_version == "2.7"
Downloading monotonic-1.5-py2.py3-none-any.whl (5.3 kB)
Collecting certifi>=2017.4.17
Downloading certifi-2019.11.28-py2.py3-none-any.whl (156 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Downloading urllib3-1.25.8-py2.py3-none-any.whl (125 kB)
Collecting idna<3,>=2.5
Downloading idna-2.9-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting google-auth<2.0dev,>=0.4.0
Downloading google_auth-1.11.2-py2.py3-none-any.whl (76 kB)
Collecting h5py
Downloading h5py-2.10.0-cp27-cp27mu-manylinux1_x86_64.whl (2.8 MB)
Collecting werkzeug>=0.11.15
Downloading Werkzeug-1.0.0-py2.py3-none-any.whl (298 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
Downloading google_auth_oauthlib-0.4.1-py2.py3-none-any.whl (18 kB)
Collecting markdown>=2.6.8
Downloading Markdown-3.1.1-py2.py3-none-any.whl (87 kB)
Collecting cachetools<5.0,>=2.0.0
Downloading cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting requests-oauthlib>=0.7.0
Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB)
Collecting oauthlib>=3.0.0
Downloading oauthlib-3.1.0-py2.py3-none-any.whl (147 kB)
Building wheels for collected packages: avro, crcmod, dill, future, hdfs,
httplib2, oauth2client, pyvcf, pyyaml, googledatastore,
proto-google-cloud-datastore-v1, python-snappy, python-gflags, pyhamcrest,
docopt, grpc-google-iam-v1, googleapis-common-protos, absl-py, gast,
keras-applications, opt-einsum, termcolor, wrapt, functools32
Building wheel for avro (setup.py): started
Building wheel for avro (setup.py): finished with status 'done'
Created wheel for avro: filename=avro-1.8.2-py2-none-any.whl size=36660
sha256=59e75b32b1cc57c153e061ff8cde790272a2e7bc9dbe5a07103c4b446ee13d0d
Stored in directory:
/root/.cache/pip/wheels/c7/58/79/ccd08296dd8ece147346f558d9b7e94fbbaa4fe1c20363fd0c
Building wheel for crcmod (setup.py): started
Building wheel for crcmod (setup.py): finished with status 'done'
Created wheel for crcmod: filename=crcmod-1.7-cp27-cp27mu-linux_x86_64.whl
size=32319
sha256=538c8df05a38518d2c35f688e7d3d064de7af092426fe418095b7f59afd494ed
Stored in directory:
/root/.cache/pip/wheels/06/c2/19/2d00b8cea7d9ac6e19d286b0c41cf7a9eb39f64bd21ed43194
Building wheel for dill (setup.py): started
Building wheel for dill (setup.py): finished with status 'done'
Created wheel for dill: filename=dill-0.3.0-py2-none-any.whl size=77512
sha256=61f27c852fcec72aab9a8d5830c4f94cf6df18bc99d144bee0acd78fcb7409e0
Stored in directory:
/root/.cache/pip/wheels/81/29/57/b427ee970b6fb3df0df261576843d275406ab127907720568c
Building wheel for future (setup.py): started
Building wheel for future (setup.py): finished with status 'done'
Created wheel for future: filename=future-0.17.1-py2-none-any.whl size=500237
sha256=5d5dddaa125adb6f82e3d607ab77c893ab7908d746a7701f99fe1d628265a364
Stored in directory:
/root/.cache/pip/wheels/26/0e/43/4f182ac276f4673de4d9fd0f9d8baaa6feb6a5120faca5dfcd
Building wheel for hdfs (setup.py): started
Building wheel for hdfs (setup.py): finished with status 'done'
Created wheel for hdfs: filename=hdfs-2.5.6-py2-none-any.whl size=32842
sha256=f88e9d1b29feea26e96dda8ba830c12fc4946e0fdad477d871a1bdfa560b411e
Stored in directory:
/root/.cache/pip/wheels/26/1b/cb/0ff47e78074a9ab52df50d88ffa2197e9ffc3085d35aae5868
Building wheel for httplib2 (setup.py): started
Building wheel for httplib2 (setup.py): finished with status 'done'
Created wheel for httplib2: filename=httplib2-0.12.0-py2-none-any.whl
size=95044
sha256=3f0fe2cd6d15eb912ca71de8c412f77fa3bc8daca4fa4d4d7e7bae57561900b8
Stored in directory:
/root/.cache/pip/wheels/f3/b3/8d/4e8136226207f12fe8eac82ce8bb55efd1da5982af842c5d27
Building wheel for oauth2client (setup.py): started
Building wheel for oauth2client (setup.py): finished with status 'done'
Created wheel for oauth2client: filename=oauth2client-3.0.0-py2-none-any.whl
size=106382
sha256=8870939601872b3435ba391537ee3ac8f9ae8999abd5a7270300be25521d993c
Stored in directory:
/root/.cache/pip/wheels/b3/ca/7f/39e3e6758df2c1bfc56e12e3a7cb4693a7da0a63f0c9791f14
Building wheel for pyvcf (setup.py): started
Building wheel for pyvcf (setup.py): finished with status 'done'
Created wheel for pyvcf: filename=PyVCF-0.6.8-py2-none-any.whl size=36042
sha256=b5e8bb7cffc48e191f2c048f2d708d925ec1662a0bd124861daa2db7f9575a04
Stored in directory:
/root/.cache/pip/wheels/b8/43/84/5248fa58c81c6f2a9b1e4f1f8b12573f79a75f492c7a1b0e5a
Building wheel for pyyaml (setup.py): started
Building wheel for pyyaml (setup.py): finished with status 'done'
Created wheel for pyyaml: filename=PyYAML-5.1-cp27-cp27mu-linux_x86_64.whl
size=352019
sha256=00283bad35bb8e758851f2b93cd707ffbb3bbdd4e47cad67a9e276ac8fa16493
Stored in directory:
/root/.cache/pip/wheels/a2/39/f3/2601aa6630b855ea35bc2a13ae08ddb71edab0b053d750ef8a
Building wheel for googledatastore (setup.py): started
Building wheel for googledatastore (setup.py): finished with status 'done'
Created wheel for googledatastore:
filename=googledatastore-7.0.2-py2-none-any.whl size=18154
sha256=6d936d029747d54dd8a3880e29cc0c7d26889384018bf4276ac4b1fac1c61675
Stored in directory:
/root/.cache/pip/wheels/a6/07/b7/048bd604cfadf321bc995c1d2b6e92770bf852e2209b9dcc97
Building wheel for proto-google-cloud-datastore-v1 (setup.py): started
Building wheel for proto-google-cloud-datastore-v1 (setup.py): finished with
status 'done'
Created wheel for proto-google-cloud-datastore-v1:
filename=proto_google_cloud_datastore_v1-0.90.4-py2-none-any.whl size=23752
sha256=9f9173f9742dd0624a1d5d1fd54a6ba741725d5008e6ce06208d5eea2f8b756e
Stored in directory:
/root/.cache/pip/wheels/80/86/e7/3e30f012839d7608dc34c5bb5087356307a028c7e1c44c3075
Building wheel for python-snappy (setup.py): started
Building wheel for python-snappy (setup.py): finished with status 'done'
Created wheel for python-snappy:
filename=python_snappy-0.5.4-cp27-cp27mu-linux_x86_64.whl size=34276
sha256=ef0be14222dd1d78527be8e7bf6236fceacd46c178d3f44cdbca3d35c688a0af
Stored in directory:
/root/.cache/pip/wheels/df/42/e9/4247d8ca6cee9fb4ac0308d6a74bd2ba8ab0bb0d988125a595
Building wheel for python-gflags (setup.py): started
Building wheel for python-gflags (setup.py): finished with status 'done'
Created wheel for python-gflags:
filename=python_gflags-3.0.6-py2-none-any.whl size=54291
sha256=21bd64aba18e6f62aceac1aee8bfea9f62c475c4f047b9a4bc9951221762b097
Stored in directory:
/root/.cache/pip/wheels/77/b7/a7/6b485500f0b52de4bcf34db105b7ab7e9009d219ab6c56e386
Building wheel for pyhamcrest (setup.py): started
Building wheel for pyhamcrest (setup.py): finished with status 'done'
Created wheel for pyhamcrest: filename=PyHamcrest-1.10.1-py2-none-any.whl
size=48898
sha256=afab556aaea8efb67e7003156b96c0f6a139d90531d1b942efd64fa72ad38695
Stored in directory:
/root/.cache/pip/wheels/f5/8c/e2/f0cea19d340270166bbfd4a2e9d8b8c132e26ef7e1376a0890
Building wheel for docopt (setup.py): started
Building wheel for docopt (setup.py): finished with status 'done'
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl
size=13704
sha256=b3d44234ba8dbc54f2ef807f09ea586e83645963acdcff1334c1e1ac5c05f2b0
Stored in directory:
/root/.cache/pip/wheels/1c/d7/2d/aefbee2bf20e0ed968d4ab943e03451db0f14c52b5f624fc7e
Building wheel for grpc-google-iam-v1 (setup.py): started
Building wheel for grpc-google-iam-v1 (setup.py): finished with status 'done'
Created wheel for grpc-google-iam-v1:
filename=grpc_google_iam_v1-0.11.4-py2-none-any.whl size=16130
sha256=1d5ff03c1e69d7fd6c5228fdbac2ea359bf99f940f01d8540d251830de68f34e
Stored in directory:
/root/.cache/pip/wheels/1f/58/c6/42524ac384abf9c039cbb9c07e5563ecb23cb33ef011182c00
Building wheel for googleapis-common-protos (setup.py): started
Building wheel for googleapis-common-protos (setup.py): finished with status
'done'
Created wheel for googleapis-common-protos:
filename=googleapis_common_protos-1.51.0-py2-none-any.whl size=77593
sha256=601c9107287ae8d4cc16503da9030440b754f237809032c627ff93d32a603617
Stored in directory:
/root/.cache/pip/wheels/56/af/44/f0c28e985bc224ffb90612f7cdeef432ba4fbd5d15485ab271
Building wheel for absl-py (setup.py): started
Building wheel for absl-py (setup.py): finished with status 'done'
Created wheel for absl-py: filename=absl_py-0.9.0-py2-none-any.whl
size=121931
sha256=0c9e89820dbfb233e3c5739faf266cbae5d2e3b95bd29670815ef06f2fe71136
Stored in directory:
/root/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93
Building wheel for gast (setup.py): started
Building wheel for gast (setup.py): finished with status 'done'
Created wheel for gast: filename=gast-0.2.2-py2-none-any.whl size=7538
sha256=a703d596325d8e4d35510c1fbee6e573f3b7a4f21002a7c180e25316d20bf199
Stored in directory:
/root/.cache/pip/wheels/0f/10/f7/29260ef8a721b90061c8c70a4f0130a64036e8dafe15acc097
Building wheel for keras-applications (setup.py): started
Building wheel for keras-applications (setup.py): finished with status 'done'
Created wheel for keras-applications:
filename=Keras_Applications-1.0.8-py2-none-any.whl size=50702
sha256=d788996d5f841a340ced7e8f8feb17e2bfe4c0af991a155e08b0ceff117f3bde
Stored in directory:
/root/.cache/pip/wheels/71/a0/64/e2e0c93740e0460f4b7f036141b7c73b5e44ff38f690ddff9f
Building wheel for opt-einsum (setup.py): started
Building wheel for opt-einsum (setup.py): finished with status 'done'
Created wheel for opt-einsum: filename=opt_einsum-2.3.2-py2-none-any.whl
size=49880
sha256=a56cb912c579059ad13b2b087290e8d03872c651970b0a1cfa5b509b2b932ac0
Stored in directory:
/root/.cache/pip/wheels/ef/c4/c2/d0b07dd2a54f4d583a5de0e6ce5eb7a1832961b9a10d1ec953
Building wheel for termcolor (setup.py): started
Building wheel for termcolor (setup.py): finished with status 'done'
Created wheel for termcolor: filename=termcolor-1.1.0-py2-none-any.whl
size=4831
sha256=6b5f20e95b334c7970b422796543df16844ac3fd8635046f40bc5e3153ff2853
Stored in directory:
/root/.cache/pip/wheels/48/54/87/2f4d1a48c87e43906477a3c93d9663c49ca092046d5a4b00b4
Building wheel for wrapt (setup.py): started
Building wheel for wrapt (setup.py): finished with status 'done'
Created wheel for wrapt: filename=wrapt-1.12.0-cp27-cp27mu-linux_x86_64.whl
size=66630
sha256=7a92c18f459093c0c75c1254af985490e608c22c341df5a31192d57151ec58ed
Stored in directory:
/root/.cache/pip/wheels/c0/72/78/e8f740a4658a7d7324515b608f758e861cbbbfb3b54c9dd481
Building wheel for functools32 (setup.py): started
Building wheel for functools32 (setup.py): finished with status 'done'
Created wheel for functools32:
filename=functools32-3.2.3.post2-py2-none-any.whl size=14556
sha256=e85f17a1513437ba10630063f91d12b87c6553537783e36f1e61fc5b2cd5b3ad
Stored in directory:
/root/.cache/pip/wheels/c2/ea/a3/25af52265fad6418a74df0b8d9ca8b89e0b3735dbd4d0d3794
Successfully built avro crcmod dill future hdfs httplib2 oauth2client pyvcf
pyyaml googledatastore proto-google-cloud-datastore-v1 python-snappy
python-gflags pyhamcrest docopt grpc-google-iam-v1 googleapis-common-protos
absl-py gast keras-applications opt-einsum termcolor wrapt functools32
[91mERROR: google-cloud-bigtable 0.32.1 has requirement
google-cloud-core<0.30dev,>=0.29.0, but you'll have google-cloud-core 1.0.2
which is incompatible.
ERROR: tensorboard 2.1.0 has requirement grpcio>=1.24.3, but you'll have grpcio
1.22.0 which is incompatible.
[0mInstalling collected packages: avro, fastavro, crcmod, dill, future,
futures, six, enum34, grpcio, docopt, certifi, urllib3, idna, chardet,
requests, hdfs, httplib2, pbr, funcsigs, mock, pyasn1, pyasn1-modules, rsa,
oauth2client, protobuf, numpy, pyarrow, pyparsing, pydot, pytz, pyvcf, pyyaml,
typing, nose, monotonic, fasteners, google-apitools, googleapis-common-protos,
proto-google-cloud-datastore-v1, googledatastore, grpc-google-iam-v1,
cachetools, google-auth, google-api-core, google-cloud-pubsub,
google-resumable-media, google-cloud-core, google-cloud-bigquery,
google-cloud-bigtable, google-cloud-datastore, cython, python-snappy, scipy,
python-dateutil, pandas, protorpc, python-gflags, absl-py, gast, h5py,
keras-applications, astor, tensorflow-estimator, google-pasta,
keras-preprocessing, opt-einsum, backports.weakref, termcolor, wrapt, werkzeug,
oauthlib, requests-oauthlib, google-auth-oauthlib, markdown, tensorboard,
functools32, tensorflow, pymongo, tenacity, pyhamcrest
[91mERROR: Could not install packages due to an EnvironmentError: [Errno 28]
No space left on device
[0mThe command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._default_implementation_type == 'cpp'; print ('Verified fast
protobuf used.')" && rm -rf /root/.cache/pip' returned a non-zero code: 1
> Task :sdks:python:container:py2:docker FAILED
> Task :runners:spark:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py2:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 41s
96 actionable tasks: 78 executed, 16 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xxpbrs764jttc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
