See <https://builds.apache.org/job/beam_PostCommit_PortableJar_Flink/120/display/redirect?page=changes>
Changes: [lukasz.gajowy] [BEAM-8003] Update IOIT documentation. Remove all mentions of Perfkit. [lukasz.gajowy] [BEAM-8003] Update descriptions of file-based ioits [lukasz.gajowy] [BEAM-8003] Remove "performanceTest" gradle task (obsolete) ------------------------------------------ [...truncated 81.47 KB...] Downloading https://files.pythonhosted.org/packages/81/b7/cef47224900ca67078ed6e2db51342796007433ad38329558f56a15255f5/urllib3-1.25.5-py2.py3-none-any.whl (125kB) Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs==2.5.6->-r /tmp/base_image_requirements.txt (line 34)) Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs==2.5.6->-r /tmp/base_image_requirements.txt (line 34)) Downloading https://files.pythonhosted.org/packages/18/b0/8146a4f8dd402f60744fa380bc73ca47303cccf8b9190fd16a827281eac2/certifi-2019.9.11-py2.py3-none-any.whl (154kB) Collecting monotonic>=0.1 (from fasteners>=0.14->google-apitools==0.5.28->-r /tmp/base_image_requirements.txt (line 50)) Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-pubsub==0.39.1->-r /tmp/base_image_requirements.txt (line 52)) Downloading https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl (73kB) Collecting werkzeug>=0.11.15 (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->-r /tmp/base_image_requirements.txt (line 70)) Downloading https://files.pythonhosted.org/packages/ce/42/3aeda98f96e85fd26180534d36570e4d18108d62ae36f87694b476b83d6f/Werkzeug-0.16.0-py2.py3-none-any.whl (327kB) Collecting markdown>=2.6.8 (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->-r /tmp/base_image_requirements.txt (line 70)) Downloading https://files.pythonhosted.org/packages/c0/4e/fd492e91abdc2d2fcb70ef453064d980688762079397f779758e055f6575/Markdown-3.1.1-py2.py3-none-any.whl (87kB) Collecting h5py (from keras-applications>=1.0.6->tensorflow==1.14.0->-r /tmp/base_image_requirements.txt (line 70)) Downloading https://files.pythonhosted.org/packages/10/56/d5c53cd170529bb40cd7dd43e2b68944cb65a45f65ab4c78a68f4ac9e51e/h5py-2.10.0-cp35-cp35m-manylinux1_x86_64.whl (2.8MB) Collecting cachetools>=2.0.0 (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-pubsub==0.39.1->-r /tmp/base_image_requirements.txt (line 52)) Downloading https://files.pythonhosted.org/packages/2f/a6/30b0a0bef12283e83e58c1d6e7b5aabc7acfc4110df81a4471655d33e704/cachetools-3.1.1-py2.py3-none-any.whl Building wheels for collected packages: avro-python3, crcmod, dill, future, hdfs, httplib2, oauth2client, pyyaml, google-apitools, proto-google-cloud-datastore-v1, python-snappy, protorpc, python-gflags, docopt, grpc-google-iam-v1, googleapis-common-protos, gast, termcolor, wrapt, absl-py Building wheel for avro-python3 (setup.py): started Building wheel for avro-python3 (setup.py): finished with status 'done' Created wheel for avro-python3: filename=avro_python3-1.8.2-cp35-none-any.whl size=43251 sha256=483bc4cdebebd4c5321980ace55bb84a11dec5343f1c11ce8d4b0cacb870fcc5 Stored in directory: /root/.cache/pip/wheels/21/1f/40/289847e9898db4df54ad59ff3706518b7bd757479f93befa74 Building wheel for crcmod (setup.py): started Building wheel for crcmod (setup.py): finished with status 'done' Created wheel for crcmod: filename=crcmod-1.7-cp35-cp35m-linux_x86_64.whl size=35103 sha256=f0e1c82bdfff384c2384531a7e281d1b2a1b22baa1328450049e72d32f0d3cb1 Stored in directory: /root/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac Building wheel for dill (setup.py): started Building wheel for dill (setup.py): finished with status 'done' Created wheel for dill: filename=dill-0.2.9-cp35-none-any.whl size=77404 sha256=e5ec754fb3d660c173833db1062a96e24f28e084cb3b75bbe383c8bc39ad541e Stored in directory: /root/.cache/pip/wheels/5b/d7/0f/e58eae695403de585269f4e4a94e0cd6ca60ec0c202936fa4a Building wheel for future (setup.py): started Building wheel for future (setup.py): finished with status 'done' Created wheel for future: filename=future-0.17.1-cp35-none-any.whl size=488730 sha256=94f3c1245b800d8b6925c3eeaacf49ff52ea824e05b3bbfb43e2a65682531f83 Stored in directory: /root/.cache/pip/wheels/0c/61/d2/d6b7317325828fbb39ee6ad559dbe4664d0896da4721bf379e Building wheel for hdfs (setup.py): started Building wheel for hdfs (setup.py): finished with status 'done' Created wheel for hdfs: filename=hdfs-2.5.6-cp35-none-any.whl size=32842 sha256=80347a24b15834c6bd2daf7588e3b4b238d5531d2137fb3f491223bdc3c5a3ba Stored in directory: /root/.cache/pip/wheels/7e/08/90/26d6cb6d9ba423d6d8da2964f06515c3b863d793422970c946 Building wheel for httplib2 (setup.py): started Building wheel for httplib2 (setup.py): finished with status 'done' Created wheel for httplib2: filename=httplib2-0.12.0-cp35-none-any.whl size=93465 sha256=a8bb0769964193e487be42110f7a2dd899e8a85cc5696d6ba4b37a301aab7e8e Stored in directory: /root/.cache/pip/wheels/6d/41/4b/2b369d6e2b7eaebcdd423516d3fb659c7658c16a2be8fd04ec Building wheel for oauth2client (setup.py): started Building wheel for oauth2client (setup.py): finished with status 'done' Created wheel for oauth2client: filename=oauth2client-3.0.0-cp35-none-any.whl size=106382 sha256=6e3328fa5910cb7dd0c776c82be11ab3b3b99c809e96ddd4c515ed5f1216b8f5 Stored in directory: /root/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d Building wheel for pyyaml (setup.py): started Building wheel for pyyaml (setup.py): finished with status 'done' Created wheel for pyyaml: filename=PyYAML-3.13-cp35-cp35m-linux_x86_64.whl size=386345 sha256=b1a62d2bb7ae8d00dad621c652b9d7d0cf0ab48b6bbf11099354332f7ce8ee5f Stored in directory: /root/.cache/pip/wheels/ad/da/0c/74eb680767247273e2cf2723482cb9c924fe70af57c334513f Building wheel for google-apitools (setup.py): started Building wheel for google-apitools (setup.py): finished with status 'done' Created wheel for google-apitools: filename=google_apitools-0.5.28-cp35-none-any.whl size=130110 sha256=45faa2bfe0d0aba061c4de7fc5ee1cf62576c72d7752bc8cd4ccb53737bc889b Stored in directory: /root/.cache/pip/wheels/d6/c2/92/837e8a4d649a209dff85b38d7fbb576b4b480738be70865f29 Building wheel for proto-google-cloud-datastore-v1 (setup.py): started Building wheel for proto-google-cloud-datastore-v1 (setup.py): finished with status 'done' Created wheel for proto-google-cloud-datastore-v1: filename=proto_google_cloud_datastore_v1-0.90.4-cp35-none-any.whl size=23752 sha256=c7330b41cdf758079c950dc0d245e08238055f9e0941e1dca6a17fc0d9baff76 Stored in directory: /root/.cache/pip/wheels/bd/ce/33/8b769968db3761c42c7a91d8a0dbbafc50acfa0750866c8abd Building wheel for python-snappy (setup.py): started Building wheel for python-snappy (setup.py): finished with status 'done' Created wheel for python-snappy: filename=python_snappy-0.5.4-cp35-cp35m-linux_x86_64.whl size=39074 sha256=e48506f6a5abc8d1d9aec67aa5236469a94f77276cb52184713b19a07a08c045 Stored in directory: /root/.cache/pip/wheels/df/aa/d5/459b834baa4c9f0ea918a38750fb29981e4a01ef523a936c06 Building wheel for protorpc (setup.py): started Building wheel for protorpc (setup.py): finished with status 'done' Created wheel for protorpc: filename=protorpc-0.12.0-cp35-none-any.whl size=137674 sha256=4ccb3175df439fc0a4e15f0e260faace3ec5a60750d4bae8401467af1e5a3966 Stored in directory: /root/.cache/pip/wheels/49/d3/26/afbe1b3330d637b5d405931e00f8833248dbef5e56a567ca9b Building wheel for python-gflags (setup.py): started Building wheel for python-gflags (setup.py): finished with status 'done' Created wheel for python-gflags: filename=python_gflags-3.0.6-cp35-none-any.whl size=54293 sha256=3e50aef3700ad6c2c8b988c1cd59c3031d5af9926959e4154126192f8d2c1450 Stored in directory: /root/.cache/pip/wheels/43/7e/90/b5dfc39cdf0376f79174f6923974d599d4afcc0192cb5208e2 Building wheel for docopt (setup.py): started Building wheel for docopt (setup.py): finished with status 'done' Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=e0ff1ec9db7add94952b57c60beded5ecf36974e28065ec5f58e51adcecadee9 Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e Building wheel for grpc-google-iam-v1 (setup.py): started Building wheel for grpc-google-iam-v1 (setup.py): finished with status 'done' Created wheel for grpc-google-iam-v1: filename=grpc_google_iam_v1-0.11.4-cp35-none-any.whl size=16131 sha256=71777d92457993c71e521563c36f156565af08f4356f907c2fc0cea1367d7f9e Stored in directory: /root/.cache/pip/wheels/b6/c6/31/c20321a5a3fde456fc375b7c2814135e6e98bc0d74c40239d9 Building wheel for googleapis-common-protos (setup.py): started Building wheel for googleapis-common-protos (setup.py): finished with status 'done' Created wheel for googleapis-common-protos: filename=googleapis_common_protos-1.6.0-cp35-none-any.whl size=77578 sha256=30c4bccbf22ade4b5c3e1d92ba4a9bbc7f20425f4a479c1137cddda5c56ece51 Stored in directory: /root/.cache/pip/wheels/9e/3d/a2/1bec8bb7db80ab3216dbc33092bb7ccd0debfb8ba42b5668d5 Building wheel for gast (setup.py): started Building wheel for gast (setup.py): finished with status 'done' Created wheel for gast: filename=gast-0.3.2-cp35-none-any.whl size=9677 sha256=f58726d9a1f728dc88ed5236d89b3061a1da9e3d98c9933385cd1d75a5985170 Stored in directory: /root/.cache/pip/wheels/59/38/c6/234dc39b4f6951a0768fbc02d5b7207137a5b1d9094f0d54bf Building wheel for termcolor (setup.py): started Building wheel for termcolor (setup.py): finished with status 'done' Created wheel for termcolor: filename=termcolor-1.1.0-cp35-none-any.whl size=4832 sha256=b22e27e2ba2bb1fc648a489143b242f61ccaa51215fd0a5ecc210950e648b17d Stored in directory: /root/.cache/pip/wheels/7c/06/54/bc84598ba1daf8f970247f550b175aaaee85f68b4b0c5ab2c6 Building wheel for wrapt (setup.py): started Building wheel for wrapt (setup.py): finished with status 'done' Created wheel for wrapt: filename=wrapt-1.11.2-cp35-cp35m-linux_x86_64.whl size=70107 sha256=5b062a92fe7d6639f910710d48c5735fca08e5d6a1c87dbfa46dc25a86fb131a Stored in directory: /root/.cache/pip/wheels/d7/de/2e/efa132238792efb6459a96e85916ef8597fcb3d2ae51590dfd Building wheel for absl-py (setup.py): started Building wheel for absl-py (setup.py): finished with status 'done' Created wheel for absl-py: filename=absl_py-0.8.0-cp35-none-any.whl size=120988 sha256=46aa8f360ddcb3404fadc2317789b1d9870b9120fac8b08ec78996e725bc07a4 Stored in directory: /root/.cache/pip/wheels/9a/1e/7a/456008eb5e47fd5de792c6139df6d5b3d5f71d51c6a0b94799 Successfully built avro-python3 crcmod dill future hdfs httplib2 oauth2client pyyaml google-apitools proto-google-cloud-datastore-v1 python-snappy protorpc python-gflags docopt grpc-google-iam-v1 googleapis-common-protos gast termcolor wrapt absl-py [91mERROR: google-cloud-bigtable 0.32.1 has requirement google-cloud-core<0.30dev,>=0.29.0, but you'll have google-cloud-core 1.0.2 which is incompatible. [0mInstalling collected packages: avro-python3, fastavro, crcmod, dill, future, six, grpcio, docopt, idna, urllib3, chardet, certifi, requests, hdfs, httplib2, pbr, mock, pyasn1, pyasn1-modules, rsa, oauth2client, protobuf, numpy, pyarrow, pyparsing, pydot, pytz, pyyaml, typing, nose, monotonic, fasteners, google-apitools, googleapis-common-protos, grpc-google-iam-v1, cachetools, google-auth, google-api-core, google-cloud-pubsub, google-cloud-core, google-resumable-media, google-cloud-bigquery, proto-google-cloud-datastore-v1, google-cloud-bigtable, google-cloud-datastore, cython, python-snappy, scipy, python-dateutil, pandas, protorpc, python-gflags, werkzeug, markdown, absl-py, tensorboard, tensorflow-estimator, gast, astor, termcolor, keras-preprocessing, wrapt, h5py, keras-applications, google-pasta, tensorflow, pymongo, tenacity, pyhamcrest Successfully installed absl-py-0.8.0 astor-0.8.0 avro-python3-1.8.2 cachetools-3.1.1 certifi-2019.9.11 chardet-3.0.4 crcmod-1.7 cython-0.29.10 dill-0.2.9 docopt-0.6.2 fastavro-0.21.24 fasteners-0.15 future-0.17.1 gast-0.3.2 google-api-core-1.14.2 google-apitools-0.5.28 google-auth-1.6.3 google-cloud-bigquery-1.17.0 google-cloud-bigtable-0.32.1 google-cloud-core-1.0.2 google-cloud-datastore-1.7.4 google-cloud-pubsub-0.39.1 google-pasta-0.1.7 google-resumable-media-0.4.1 googleapis-common-protos-1.6.0 grpc-google-iam-v1-0.11.4 grpcio-1.22.0 h5py-2.10.0 hdfs-2.5.6 httplib2-0.12.0 idna-2.8 keras-applications-1.0.8 keras-preprocessing-1.1.0 markdown-3.1.1 mock-2.0.0 monotonic-1.5 nose-1.3.7 numpy-1.16.4 oauth2client-3.0.0 pandas-0.24.2 pbr-5.4.3 proto-google-cloud-datastore-v1-0.90.4 protobuf-3.9.0 protorpc-0.12.0 pyarrow-0.14.0 pyasn1-0.4.7 pyasn1-modules-0.2.6 pydot-1.4.1 pyhamcrest-1.9.0 pymongo-3.8.0 pyparsing-2.4.2 python-dateutil-2.8.0 python-gflags-3.0.6 python-snappy-0.5.4 pytz-2019.1 pyyaml-3.13 requests-2.22.0 rsa-4.0 scipy-1.2.2 six-1.12.0 tenacity-5.1.1 tensorboard-1.14.0 tensorflow-1.14.0 tensorflow-estimator-1.14.0 termcolor-1.1.0 typing-3.6.6 urllib3-1.25.5 werkzeug-0.16.0 wrapt-1.11.2 Verified fast protobuf used. Removing intermediate container 7e825bb98675 ---> 167e37e7e951 Step 7/10 : COPY target/apache-beam.tar.gz /opt/apache/beam/tars/ ---> 2e91b0f9d0ac Step 8/10 : RUN pip install /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && rm -rf /root/.cache/pip ---> Running in 8ee8280bf775 Processing /opt/apache/beam/tars/apache-beam.tar.gz Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (1.7) Requirement already satisfied: dill<0.4.0,>=0.2.9 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.2.9) Requirement already satisfied: fastavro<0.22,>=0.21.4 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.21.24) Requirement already satisfied: future<1.0.0,>=0.16.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.17.1) Requirement already satisfied: grpcio<2,>=1.12.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (1.22.0) Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (2.5.6) Requirement already satisfied: httplib2<=0.12.0,>=0.8 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.12.0) Requirement already satisfied: mock<3.0.0,>=1.0.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (2.0.0) Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (3.8.0) Requirement already satisfied: oauth2client<4,>=2.0.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (3.0.0) Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (3.9.0) Requirement already satisfied: pydot<2,>=1.2.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (1.4.1) Requirement already satisfied: python-dateutil<3,>=2.8.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (2.8.0) Requirement already satisfied: pytz>=2018.3 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (2019.1) Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (3.13) Requirement already satisfied: avro-python3<2.0.0,>=1.8.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (1.8.2) Requirement already satisfied: pyarrow<0.15.0,>=0.11.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.14.0) Requirement already satisfied: cachetools<4,>=3.1.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (3.1.1) Requirement already satisfied: google-apitools<0.5.29,>=0.5.28 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.5.28) Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (1.7.4) Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.39.1) Requirement already satisfied: google-cloud-bigquery<1.18.0,>=1.6.0 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (1.17.0) Requirement already satisfied: google-cloud-core<2,>=0.28.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (1.0.2) Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1 in /usr/local/lib/python3.5/site-packages (from apache-beam==2.17.0.dev0) (0.32.1) Requirement already satisfied: six>=1.5.2 in /usr/local/lib/python3.5/site-packages (from grpcio<2,>=1.12.1->apache-beam==2.17.0.dev0) (1.12.0) Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python3.5/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.17.0.dev0) (2.22.0) Requirement already satisfied: docopt in /usr/local/lib/python3.5/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.17.0.dev0) (0.6.2) Requirement already satisfied: pbr>=0.11 in /usr/local/lib/python3.5/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.17.0.dev0) (5.4.3) Requirement already satisfied: pyasn1-modules>=0.0.5 in /usr/local/lib/python3.5/site-packages (from oauth2client<4,>=2.0.1->apache-beam==2.17.0.dev0) (0.2.6) Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python3.5/site-packages (from oauth2client<4,>=2.0.1->apache-beam==2.17.0.dev0) (0.4.7) Requirement already satisfied: rsa>=3.1.4 in /usr/local/lib/python3.5/site-packages (from oauth2client<4,>=2.0.1->apache-beam==2.17.0.dev0) (4.0) Requirement already satisfied: setuptools in /usr/local/lib/python3.5/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.17.0.dev0) (41.2.0) Requirement already satisfied: pyparsing>=2.1.4 in /usr/local/lib/python3.5/site-packages (from pydot<2,>=1.2.0->apache-beam==2.17.0.dev0) (2.4.2) Requirement already satisfied: numpy>=1.14 in /usr/local/lib/python3.5/site-packages (from pyarrow<0.15.0,>=0.11.1->apache-beam==2.17.0.dev0) (1.16.4) Requirement already satisfied: fasteners>=0.14 in /usr/local/lib/python3.5/site-packages (from google-apitools<0.5.29,>=0.5.28->apache-beam==2.17.0.dev0) (0.15) Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.6.0 in /usr/local/lib/python3.5/site-packages (from google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.17.0.dev0) (1.14.2) Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.4 in /usr/local/lib/python3.5/site-packages (from google-cloud-pubsub<1.1.0,>=0.39.0->apache-beam==2.17.0.dev0) (0.11.4) Requirement already satisfied: google-resumable-media>=0.3.1 in /usr/local/lib/python3.5/site-packages (from google-cloud-bigquery<1.18.0,>=1.6.0->apache-beam==2.17.0.dev0) (0.4.1) Requirement already satisfied: idna<2.9,>=2.5 in /usr/local/lib/python3.5/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.17.0.dev0) (2.8) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python3.5/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.17.0.dev0) (3.0.4) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.5/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.17.0.dev0) (2019.9.11) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.5/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.17.0.dev0) (1.25.5) Requirement already satisfied: monotonic>=0.1 in /usr/local/lib/python3.5/site-packages (from fasteners>=0.14->google-apitools<0.5.29,>=0.5.28->apache-beam==2.17.0.dev0) (1.5) Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in /usr/local/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.17.0.dev0) (1.6.0) Requirement already satisfied: google-auth<2.0dev,>=0.4.0 in /usr/local/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.17.0.dev0) (1.6.3) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started Building wheel for apache-beam (setup.py): still running... Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.17.0.dev0-cp35-cp35m-linux_x86_64.whl size=6246271 sha256=cc5d77bd06726b3364e70c50cb07e442e1bb74461791f0518f6239315eaa36bb Stored in directory: /root/.cache/pip/wheels/4b/7d/dd/a19128d4b755625dce0a4a284246bffb9f82e49379d8e9d5f5 Successfully built apache-beam Installing collected packages: apache-beam Successfully installed apache-beam-2.17.0.dev0 Removing intermediate container 8ee8280bf775 ---> 3bd192926404 Step 9/10 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/ ---> aa5da2da2abd Step 10/10 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in ff1a126f8f5d Removing intermediate container ff1a126f8f5d ---> 4b00f9a5fc3b Successfully built 4b00f9a5fc3b Successfully tagged apachebeam/python3.5_sdk:2.17.0.dev > Task :runners:flink:1.8:job-server:testPipelineJar FAILED while [[ $# -gt 0 ]] do key="$1" case $key in --flink_job_server_jar) FLINK_JOB_SERVER_JAR="$2" shift # past argument shift # past value ;; --env_dir) ENV_DIR="$2" shift # past argument shift # past value ;; --python_root_dir) PYTHON_ROOT_DIR="$2" shift # past argument shift # past value ;; --python_version) PYTHON_VERSION="$2" shift # past argument shift # past value ;; *) # unknown option echo "Unknown option: $1" exit 1 ;; esac done # Go to the root of the repository cd $(git rev-parse --show-toplevel) git rev-parse --show-toplevel # Verify docker command exists /usr/bin/docker command -v docker docker -v Docker version 18.09.4, build d14af54 CONTAINER=$USER-docker-apache.bintray.io/beam/python$PYTHON_VERSION TAG=latest # Verify container has already been built docker images $CONTAINER:$TAG | grep $TAG FAILURE: Build failed with an exception. * Where: Script '<https://builds.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/job-server/flink_job_server.gradle'> line: 185 * What went wrong: Execution failed for task ':runners:flink:1.8:job-server:testPipelineJar'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 29s 66 actionable tasks: 64 executed, 1 from cache, 1 up-to-date Publishing build scan... https://gradle.com/s/teveuivi2ub4u Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
