See <https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/1936/display/redirect?page=changes>
Changes: [pabloem] Revert "Merge pull request #11104 from y1chi/update_tornado_test" [lcwik] [BEAM-9668] Disable tests till Dataflow containers are updated. [github] [BEAM-9652] Ensure that the multipartition write sets the correct coder [github] [BEAM-8889]add experiment flag use_grpc_for_gcs (#11183) ------------------------------------------ [...truncated 1.06 MB...] Step 11/15 : RUN pip freeze --all ---> Running in 17ea00b8459c absl-py==0.9.0 apache-beam==2.21.0.dev0 astor==0.8.1 avro-python3==1.8.2 cachetools==3.1.1 certifi==2019.11.28 chardet==3.0.4 crcmod==1.7 Cython==0.29.13 dill==0.3.1.1 docopt==0.6.2 fastavro==0.21.24 fasteners==0.15 future==0.17.1 gast==0.2.2 google-api-core==1.16.0 google-apitools==0.5.28 google-auth==1.12.0 google-auth-oauthlib==0.4.1 google-cloud-bigquery==1.24.0 google-cloud-bigtable==1.0.0 google-cloud-core==1.1.0 google-cloud-datastore==1.7.4 google-cloud-dlp==0.13.0 google-cloud-language==1.3.0 google-cloud-pubsub==1.0.2 google-cloud-spanner==1.13.0 google-cloud-videointelligence==1.13.0 google-cloud-vision==0.42.0 google-pasta==0.2.0 google-resumable-media==0.5.0 googleapis-common-protos==1.51.0 grpc-google-iam-v1==0.12.3 grpcio==1.24.3 grpcio-gcp==0.2.2 guppy3==3.0.9 h5py==2.10.0 hdfs==2.5.8 httplib2==0.12.0 idna==2.9 Keras-Applications==1.0.8 Keras-Preprocessing==1.1.0 Markdown==3.2.1 mock==2.0.0 monotonic==1.5 nose==1.3.7 numpy==1.17.3 oauth2client==3.0.0 oauthlib==3.1.0 opt-einsum==3.2.0 pandas==0.25.2 pbr==5.4.4 pip==20.0.2 protobuf==3.11.1 protorpc==0.12.0 pyarrow==0.15.1 pyasn1==0.4.8 pyasn1-modules==0.2.8 pydot==1.4.1 PyHamcrest==1.10.1 pymongo==3.9.0 pyparsing==2.4.6 python-dateutil==2.8.1 python-gflags==3.0.6 pytz==2019.3 PyYAML==5.1 requests==2.23.0 requests-oauthlib==1.3.0 rsa==4.0 scipy==1.4.1 setuptools==46.1.3 six==1.14.0 tenacity==6.1.0 tensorboard==2.1.1 tensorflow==2.1.0 tensorflow-estimator==2.1.0 termcolor==1.1.0 typing==3.7.4.1 typing-extensions==3.7.4.1 urllib3==1.25.8 Werkzeug==1.0.1 wheel==0.34.2 wrapt==1.12.1 Removing intermediate container 17ea00b8459c ---> 8c03efbe58fe Step 12/15 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/ ---> d904b874aac8 Step 13/15 : COPY target/LICENSE /opt/apache/beam/ ---> b68f57f09409 Step 14/15 : COPY target/NOTICE /opt/apache/beam/ ---> 9a3503247ffd Step 15/15 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 8f6c1953c293 Removing intermediate container 8f6c1953c293 ---> 0e37f07dc5bf Successfully built 0e37f07dc5bf Successfully tagged apache/beam_python3.5_sdk:2.21.0.dev > Task :sdks:python:test-suites:portable:py35:portableWordCountBatch WARNING:root:Make sure that locally built Python SDK docker image has Python 3.5 interpreter. INFO:root:Using Python SDK docker image: apache/beam_python3.5_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com WARNING:root:Make sure that locally built Python SDK docker image has Python 3.5 interpreter. INFO:root:Using Python SDK docker image: apache/beam_python3.5_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fec982ff730> ==================== INFO:apache_beam.utils.subprocess_server:Starting service with ['docker' 'run' '-v' '/usr/bin/docker:/bin/docker' '-v' '/var/run/docker.sock:/var/run/docker.sock' '--network=host' 'apache/beam_flink1.10_job_server:latest' '--job-host' 'localhost' '--job-port' '36209' '--artifact-port' '47715' '--expansion-port' '35779'] ERROR:apache_beam.utils.subprocess_server:Error bringing up service Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/utils/subprocess_server.py";,> line 101, in start channel = grpc.insecure_channel(endpoint) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/__init__.py";,> line 1860, in insecure_channel from grpc import _channel # pylint: disable=cyclic-import File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_channel.py";,> line 25, in <module> import grpc.experimental File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/experimental/__init__.py";,> line 89, in <module> from grpc._simple_stubs import unary_unary, unary_stream, stream_unary, stream_stream File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_simple_stubs.py";,> line 61 _LOGGER.debug(f"Creating insecure channel with options '{options}' " + ^ SyntaxError: invalid syntax Traceback (most recent call last): File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main "__main__", mod_spec) File "/usr/lib/python3.5/runpy.py", line 85, in _run_code exec(code, run_globals) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/examples/wordcount.py";,> line 142, in <module> run() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/examples/wordcount.py";,> line 121, in run result = p.run() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/pipeline.py";,> line 498, in run self._options).run(False) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/pipeline.py";,> line 511, in run return self.runner.run_pipeline(self, self._options) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 404, in run_pipeline job_service_handle = self.create_job_service(options) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 311, in create_job_service return self.create_job_service_handle(server.start(), options) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/job_server.py";,> line 85, in start self._endpoint = self._job_server.start() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/job_server.py";,> line 114, in start return self._server.start() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/utils/subprocess_server.py";,> line 101, in start channel = grpc.insecure_channel(endpoint) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/__init__.py";,> line 1860, in insecure_channel from grpc import _channel # pylint: disable=cyclic-import File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_channel.py";,> line 25, in <module> import grpc.experimental File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/experimental/__init__.py";,> line 89, in <module> from grpc._simple_stubs import unary_unary, unary_stream, stream_unary, stream_stream File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_simple_stubs.py";,> line 61 _LOGGER.debug(f"Creating insecure channel with options '{options}' " + ^ SyntaxError: invalid syntax > Task :sdks:python:test-suites:portable:py35:portableWordCountBatch FAILED > Task :sdks:python:test-suites:portable:py35:portableWordCountStreaming WARNING:root:Make sure that locally built Python SDK docker image has Python 3.5 interpreter. INFO:root:Using Python SDK docker image: apache/beam_python3.5_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com WARNING:root:Make sure that locally built Python SDK docker image has Python 3.5 interpreter. INFO:root:Using Python SDK docker image: apache/beam_python3.5_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com INFO:apache_beam.utils.subprocess_server:Starting service with ['docker' 'run' '-v' '/usr/bin/docker:/bin/docker' '-v' '/var/run/docker.sock:/var/run/docker.sock' '--network=host' 'apache/beam_flink1.10_job_server:latest' '--job-host' 'localhost' '--job-port' '47173' '--artifact-port' '50273' '--expansion-port' '50971'] ERROR:apache_beam.utils.subprocess_server:Error bringing up service Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/utils/subprocess_server.py";,> line 101, in start channel = grpc.insecure_channel(endpoint) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/__init__.py";,> line 1860, in insecure_channel from grpc import _channel # pylint: disable=cyclic-import File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_channel.py";,> line 25, in <module> import grpc.experimental File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/experimental/__init__.py";,> line 89, in <module> from grpc._simple_stubs import unary_unary, unary_stream, stream_unary, stream_stream File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_simple_stubs.py";,> line 61 _LOGGER.debug(f"Creating insecure channel with options '{options}' " + ^ SyntaxError: invalid syntax Traceback (most recent call last): File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main "__main__", mod_spec) File "/usr/lib/python3.5/runpy.py", line 85, in _run_code exec(code, run_globals) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/examples/wordcount.py";,> line 142, in <module> run() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/examples/wordcount.py";,> line 121, in run result = p.run() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/pipeline.py";,> line 498, in run self._options).run(False) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/pipeline.py";,> line 511, in run return self.runner.run_pipeline(self, self._options) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 404, in run_pipeline job_service_handle = self.create_job_service(options) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 311, in create_job_service return self.create_job_service_handle(server.start(), options) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/job_server.py";,> line 85, in start self._endpoint = self._job_server.start() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/runners/portability/job_server.py";,> line 114, in start return self._server.start() File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/apache_beam/utils/subprocess_server.py";,> line 101, in start channel = grpc.insecure_channel(endpoint) File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/__init__.py";,> line 1860, in insecure_channel from grpc import _channel # pylint: disable=cyclic-import File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_channel.py";,> line 25, in <module> import grpc.experimental File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/experimental/__init__.py";,> line 89, in <module> from grpc._simple_stubs import unary_unary, unary_stream, stream_unary, stream_stream File "<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703439/lib/python3.5/site-packages/grpc/_simple_stubs.py";,> line 61 _LOGGER.debug(f"Creating insecure channel with options '{options}' " + ^ SyntaxError: invalid syntax > Task :sdks:python:test-suites:portable:py35:portableWordCountStreaming FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py35:portableWordCountBatch'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py35:portableWordCountStreaming'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 5m 22s 84 actionable tasks: 21 executed, 63 up-to-date Publishing build scan... https://gradle.com/s/gafg7myekbo42 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
