See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3846/display/redirect>
Changes: ------------------------------------------ [...truncated 163.56 KB...] INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.32.0.dev" for Docker environment INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f07e1665b70> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f07e1665bf8> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f07e1667378> ==================== INFO:apache_beam.runners.portability.flink_runner:Adding HTTP protocol scheme to flink_master parameter: http://localhost:40011 Jul 15, 2021 6:28:05 PM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1 applyOrElse INFO: Slf4jLogger started Jul 15, 2021 6:28:05 PM org.apache.flink.runtime.clusterframework.BootstrapTools startActorSystem INFO: Actor system started at akka://flink Jul 15, 2021 6:28:05 PM org.apache.flink.runtime.clusterframework.BootstrapTools startLocalActorSystem INFO: Trying to start local actor system Jul 15, 2021 6:28:06 PM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1 applyOrElse INFO: Slf4jLogger started Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.clusterframework.BootstrapTools startActorSystem INFO: Actor system started at akka://flink-metrics Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer INFO: Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService . Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.minicluster.MiniCluster createHighAvailabilityServices INFO: Starting high-availability services Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.BlobServer <init> INFO: Created BLOB server storage directory /tmp/blobStore-ce693db3-e177-489a-8802-181fd03c262b Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.BlobServer <init> INFO: Started BLOB server at 0.0.0.0:42061 - max concurrent requests: 50 - max backlog: 1000 Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.AbstractBlobCache <init> INFO: Created BLOB cache storage directory /tmp/blobStore-338c8100-a299-400a-b602-dc1afc9339e3 Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.AbstractBlobCache <init> INFO: Created BLOB cache storage directory /tmp/blobStore-778f36bb-aaa1-458b-89ee-6440148e9100 Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.minicluster.MiniCluster startTaskManagers INFO: Starting 1 TaskManger(s) Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.taskexecutor.TaskManagerRunner startTaskManager INFO: Starting TaskManager with ResourceID: 856d555c-0c3a-4da5-b81c-ddd2669f92c7 INFO:apache_beam.runners.portability.abstract_job_service:Artifact server started on port 46823 INFO:apache_beam.runners.portability.abstract_job_service:Running job 'job-24198948-0bdb-4326-ac29-986a9d26a1f1' Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.taskexecutor.TaskManagerServices checkTempDirs INFO: Temporary file directory '/tmp': total 484 GB, usable 121 GB (25.00% usable) Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl createFiles INFO: FileChannelManager uses directory /tmp/flink-io-9f1241ee-3784-4d7a-9fb9-d39bee55d8c3 for spill files. Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl createFiles INFO: FileChannelManager uses directory /tmp/flink-netty-shuffle-b3cc1eae-57aa-4741-b1dc-308124edc81b for spill files. Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.io.network.buffer.NetworkBufferPool <init> INFO: Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment start INFO: Starting the network environment and its components. Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.taskexecutor.KvStateService start INFO: Starting the kvState service and its components. Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer INFO: Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 . Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService start INFO: Start job leader service. Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.filecache.FileCache <init> INFO: User file cache uses directory /tmp/flink-dist-cache-ebf25a32-9272-4b96-92a1-277524509d56 Jul 15, 2021 6:28:07 PM org.apache.flink.configuration.Configuration loggingFallback INFO: Config uses fallback configuration key 'rest.port' instead of key 'rest.bind-port' Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.rest.RestServerEndpoint start INFO: Starting rest endpoint. Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py";,> line 170, in _new_conn (self._dns_host, self.port), self.timeout, **extra_kw File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/util/connection.py";,> line 96, in create_connection raise err File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/util/connection.py";,> line 86, in create_connection sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connectionpool.py";,> line 706, in urlopen chunked=chunked, File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connectionpool.py";,> line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py";,> line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.6/http/client.py", line 1239, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output self.send(msg) File "/usr/lib/python3.6/http/client.py", line 964, in send self.connect() File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py";,> line 200, in connect conn = self._new_conn() File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py";,> line 182, in _new_conn self, "Failed to establish a new connection: %s" % e urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f07e0a95630>: Failed to establish a new connection: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/adapters.py";,> line 449, in send timeout=timeout File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connectionpool.py";,> line 756, in urlopen method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2] File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/util/retry.py";,> line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=40011): Max retries exceeded with url: /v1/jars/upload (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07e0a95630>: Failed to establish a new connection: [Errno 111] Connection refused',)) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<string>", line 31, in <module> File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,> line 564, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py";,> line 45, in run_pipeline return super(FlinkRunner, self).run_pipeline(pipeline, options) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 440, in run_pipeline job_service_handle.submit(proto_pipeline) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 115, in submit return self.run(prepare_response.preparation_id) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 242, in run beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id)) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py";,> line 120, in Run self._jobs[job_id].run() File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,> line 150, in run files={'jarfile': ('beam.jar', jar_file)})['filename'].split('/')[-1] File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,> line 138, in post return self.request(requests.post, path, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,> line 126, in request response = method(url, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/api.py";,> line 117, in post return request('post', url, data=data, json=json, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/api.py";,> line 61, in request return session.request(method=method, url=url, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/sessions.py";,> line 542, in request resp = self.send(prep, **send_kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/sessions.py";,> line 655, in send r = adapter.send(request, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/adapters.py";,> line 516, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=40011): Max retries exceeded with url: /v1/jars/upload (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07e0a95630>: Failed to establish a new connection: [Errno 111] Connection refused',)) Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find WARNING: Log file environment variable 'log.file' is not set. Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find WARNING: JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'. kill %1 || echo "Failed to shut down Flink mini cluster" rm -rf "$ENV_DIR" Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.blob.AbstractBlobCache close INFO: Shutting down BLOB cache Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown INFO: Shutting down TaskExecutorLocalStateStoresManager. if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then echo ">>> SUCCESS" else echo ">>> FAILURE" fi exit $TEST_EXIT_CODE > Task > :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession > FAILED FAILURE: Build completed with 6 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 4: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 5: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 6: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 27m 38s 154 actionable tasks: 111 executed, 40 from cache, 3 up-to-date Publishing build scan... https://gradle.com/s/nfikqtiqwixm4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
