See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3377/display/redirect>
Changes: ------------------------------------------ [...truncated 361.14 KB...] fi Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet INFO: The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value. Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet INFO: The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value. Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet INFO: The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value. Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet INFO: The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb. Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet INFO: The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb. Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet INFO: The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb. Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.minicluster.MiniCluster start INFO: Starting Flink Mini Cluster Mar 13, 2021 6:19:08 AM org.apache.flink.runtime.minicluster.MiniCluster start INFO: Starting Metrics Registry WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.7_sdk:2.30.0.dev INFO:root:Using provided Python SDK container image: apache/beam_python3.7_sdk:2.30.0.dev INFO:root:Python SDK container image set to "apache/beam_python3.7_sdk:2.30.0.dev" for Docker environment Mar 13, 2021 6:19:09 AM org.apache.flink.runtime.metrics.MetricRegistryImpl <init> INFO: No metrics reporter configured, no metrics will be exposed/reported. Mar 13, 2021 6:19:09 AM org.apache.flink.runtime.minicluster.MiniCluster start INFO: Starting RPC Service(s) INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fcd3ae599d8> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fcd3ae5b158> ==================== INFO:apache_beam.runners.portability.flink_runner:Adding HTTP protocol scheme to flink_master parameter: http://localhost:36077 Mar 13, 2021 6:19:09 AM org.apache.flink.runtime.clusterframework.BootstrapTools startLocalActorSystem INFO: Trying to start local actor system INFO:apache_beam.runners.portability.abstract_job_service:Artifact server started on port 40227 INFO:apache_beam.runners.portability.abstract_job_service:Running job 'job-1ff7666d-c628-41b4-a86f-b8fabf0376e4' Mar 13, 2021 6:19:10 AM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1 applyOrElse INFO: Slf4jLogger started Mar 13, 2021 6:19:10 AM org.apache.flink.runtime.clusterframework.BootstrapTools startActorSystem INFO: Actor system started at akka://flink Mar 13, 2021 6:19:10 AM org.apache.flink.runtime.clusterframework.BootstrapTools startLocalActorSystem INFO: Trying to start local actor system Mar 13, 2021 6:19:10 AM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1 applyOrElse INFO: Slf4jLogger started Mar 13, 2021 6:19:10 AM org.apache.flink.runtime.clusterframework.BootstrapTools startActorSystem INFO: Actor system started at akka://flink-metrics Mar 13, 2021 6:19:10 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer INFO: Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService . Mar 13, 2021 6:19:10 AM org.apache.flink.runtime.minicluster.MiniCluster createHighAvailabilityServices INFO: Starting high-availability services Mar 13, 2021 6:19:10 AM org.apache.flink.runtime.blob.BlobServer <init> INFO: Created BLOB server storage directory /tmp/blobStore-1ace6ab7-422e-4f91-9499-7ad6e539cb25 Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.blob.BlobServer <init> INFO: Started BLOB server at 0.0.0.0:37115 - max concurrent requests: 50 - max backlog: 1000 Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.blob.AbstractBlobCache <init> INFO: Created BLOB cache storage directory /tmp/blobStore-92e27c2f-0816-4bea-b6be-a35e09ea5b20 Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.blob.AbstractBlobCache <init> INFO: Created BLOB cache storage directory /tmp/blobStore-56f86132-505a-4573-ae92-891f022f5450 Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.minicluster.MiniCluster startTaskManagers INFO: Starting 1 TaskManger(s) Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.taskexecutor.TaskManagerRunner startTaskManager INFO: Starting TaskManager with ResourceID: f1978cb2-d19f-41f1-93bd-aa129728207d Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.taskexecutor.TaskManagerServices checkTempDirs INFO: Temporary file directory '/tmp': total 484 GB, usable 290 GB (59.92% usable) Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,> line 170, in _new_conn (self._dns_host, self.port), self.timeout, **extra_kw File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/util/connection.py";,> line 96, in create_connection raise err File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/util/connection.py";,> line 86, in create_connection sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 706, in urlopen chunked=chunked, File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,> line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.7/http/client.py", line 1229, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.7/http/client.py", line 1275, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.7/http/client.py", line 1224, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.7/http/client.py", line 1016, in _send_output self.send(msg) File "/usr/lib/python3.7/http/client.py", line 956, in send self.connect() File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,> line 200, in connect conn = self._new_conn() File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,> line 182, in _new_conn self, "Failed to establish a new connection: %s" % e urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fcd378dcf98>: Failed to establish a new connection: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/adapters.py";,> line 449, in send timeout=timeout File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 756, in urlopen method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2] File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/util/retry.py";,> line 573, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=36077): Max retries exceeded with url: /v1/jars/upload (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcd378dcf98>: Failed to establish a new connection: [Errno 111] Connection refused')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<string>", line 31, in <module> File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,> line 561, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py";,> line 48, in run_pipeline return super(FlinkRunner, self).run_pipeline(pipeline, options) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 442, in run_pipeline job_service_handle.submit(proto_pipeline) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 118, in submit return self.run(prepare_response.preparation_id) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 245, in run beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id)) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py";,> line 123, in Run self._jobs[job_id].run() File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,> line 153, in run files={'jarfile': ('beam.jar', jar_file)})['filename'].split('/')[-1] File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,> line 141, in post return self.request(requests.post, path, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,> line 129, in request response = method(url, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/api.py";,> line 119, in post return request('post', url, data=data, json=json, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/api.py";,> line 61, in request return session.request(method=method, url=url, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/sessions.py";,> line 542, in request resp = self.send(prep, **send_kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/sessions.py";,> line 655, in send r = adapter.send(request, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/adapters.py";,> line 516, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=36077): Max retries exceeded with url: /v1/jars/upload (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fcd378dcf98>: Failed to establish a new connection: [Errno 111] Connection refused')) Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl createFiles INFO: FileChannelManager uses directory /tmp/flink-io-008e42fd-179f-47f9-b62e-db9b72677213 for spill files. Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl createFiles INFO: FileChannelManager uses directory /tmp/flink-netty-shuffle-9aa34b52-5d02-46d2-a815-87303a804bd1 for spill files. Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.io.network.buffer.NetworkBufferPool <init> INFO: Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment start INFO: Starting the network environment and its components. Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.taskexecutor.KvStateService start INFO: Starting the kvState service and its components. Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer INFO: Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 . Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService start INFO: Start job leader service. Mar 13, 2021 6:19:11 AM org.apache.flink.runtime.filecache.FileCache <init> INFO: User file cache uses directory /tmp/flink-dist-cache-ca541ae7-1b76-4723-8e82-b0808e155c5e Mar 13, 2021 6:19:11 AM org.apache.flink.configuration.Configuration loggingFallback INFO: Config uses fallback configuration key 'rest.port' instead of key 'rest.bind-port' kill %1 || echo "Failed to shut down Flink mini cluster" rm -rf "$ENV_DIR" if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then echo ">>> SUCCESS" else echo ">>> FAILURE" fi exit $TEST_EXIT_CODE > Task > :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession > FAILED kill %1 || echo "Failed to shut down Flink mini cluster" rm -rf "$ENV_DIR" if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then echo ">>> SUCCESS" else echo ">>> FAILURE" fi exit $TEST_EXIT_CODE FAILURE: Build completed with 4 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 4: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 18m 49s 151 actionable tasks: 109 executed, 39 from cache, 3 up-to-date Publishing build scan... https://gradle.com/s/v6qog2s5rjrdo Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
