See
<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/6571/display/redirect>
Changes:
------------------------------------------
[...truncated 732.94 KB...]
INFO: No metrics reporter configured, no metrics will be exposed/reported.
Jun 02, 2023 6:16:08 AM org.apache.flink.runtime.minicluster.MiniCluster start
INFO: Starting RPC Service(s)
Jun 02, 2023 6:16:08 AM org.apache.flink.runtime.rpc.akka.AkkaBootstrapTools
startLocalActorSystem
INFO: Trying to start local actor system
Jun 02, 2023 6:16:10 AM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1
applyOrElse
INFO: Slf4jLogger started
Jun 02, 2023 6:16:10 AM org.apache.flink.runtime.rpc.akka.AkkaBootstrapTools
startActorSystem
INFO: Actor system started at akka://flink
Jun 02, 2023 6:16:10 AM org.apache.flink.runtime.rpc.akka.AkkaBootstrapTools
startLocalActorSystem
INFO: Trying to start local actor system
Jun 02, 2023 6:16:10 AM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1
applyOrElse
INFO: Slf4jLogger started
Jun 02, 2023 6:16:10 AM org.apache.flink.runtime.rpc.akka.AkkaBootstrapTools
startActorSystem
INFO: Actor system started at akka://flink-metrics
Jun 02, 2023 6:16:10 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
startServer
INFO: Starting RPC endpoint for
org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService .
Jun 02, 2023 6:16:10 AM org.apache.flink.runtime.blob.BlobServer <init>
INFO: Created BLOB server storage directory
/tmp/minicluster_77e434df0878e1a7a1ae498fef6650c4/blobStorage
Jun 02, 2023 6:16:10 AM org.apache.flink.runtime.blob.BlobServer <init>
INFO: Started BLOB server at 0.0.0.0:40969 - max concurrent requests: 50 - max
backlog: 1000
INFO:apache_beam.runners.portability.abstract_job_service:Artifact server
started on port 34483
INFO:apache_beam.runners.portability.abstract_job_service:Running job
'job-97f1f601-b34a-41b0-9e8d-eb2bb7e9e2de'
Jun 02, 2023 6:16:11 AM org.apache.hadoop.util.NativeCodeLoader <clinit>
WARNING: Unable to load native-hadoop library for your platform... using
builtin-java classes where applicable
Jun 02, 2023 6:16:11 AM
org.apache.flink.runtime.security.token.KerberosDelegationTokenManagerFactory
create
INFO: Cannot use kerberos delegation token manager no valid kerberos
credentials provided.
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.blob.AbstractBlobCache <init>
INFO: Created BLOB cache storage directory
/tmp/minicluster_77e434df0878e1a7a1ae498fef6650c4/blobStorage
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.blob.AbstractBlobCache <init>
INFO: Created BLOB cache storage directory
/tmp/minicluster_77e434df0878e1a7a1ae498fef6650c4/blobStorage
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.minicluster.MiniCluster
startTaskManagers
INFO: Starting 1 TaskManager(s)
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.taskexecutor.TaskManagerRunner
startTaskManager
INFO: Starting TaskManager with ResourceID: 9707c215-1309-4876-bc77-d16bb77d5442
Jun 02, 2023 6:16:11 AM
org.apache.flink.runtime.taskexecutor.TaskManagerServices checkTempDirs
INFO: Temporary file directory '/tmp': total 969 GB, usable 685 GB (70.69%
usable)
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.io.disk.iomanager.IOManager
<init>
INFO: Created a new FileChannelManager for spilling of task related data to
disk (joins, sorting, ...). Used directories:
/tmp/flink-io-8e596102-6232-4529-9db9-fd3189c51fc4
Jun 02, 2023 6:16:11 AM
org.apache.flink.runtime.io.network.NettyShuffleServiceFactory
createNettyShuffleEnvironment
INFO: Created a new FileChannelManager for storing result partitions of
BLOCKING shuffles. Used directories:
/tmp/flink-netty-shuffle-7325d279-2bcd-46b0-bc47-e1a1bfd1f6f3
Jun 02, 2023 6:16:11 AM
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool <init>
INFO: Allocated 64 MB for network buffer pool (number of memory segments: 2048,
bytes per segment: 32768).
Jun 02, 2023 6:16:11 AM
org.apache.flink.runtime.io.network.NettyShuffleEnvironment start
INFO: Starting the network environment and its components.
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.taskexecutor.KvStateService
start
INFO: Starting the kvState service and its components.
Jun 02, 2023 6:16:11 AM org.apache.flink.configuration.Configuration
loggingFallback
INFO: Config uses fallback configuration key 'akka.ask.timeout' instead of key
'taskmanager.slot.timeout'
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
startServer
INFO: Starting RPC endpoint for
org.apache.flink.runtime.taskexecutor.TaskExecutor at
akka://flink/user/rpc/taskmanager_0 .
Jun 02, 2023 6:16:11 AM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService start
INFO: Start job leader service.
Jun 02, 2023 6:16:11 AM org.apache.flink.runtime.filecache.FileCache <init>
INFO: User file cache uses directory
/tmp/flink-dist-cache-1aaf9bb3-5c53-47a5-acca-4fac551debb8
Jun 02, 2023 6:16:12 AM org.apache.flink.configuration.Configuration
loggingFallback
INFO: Config uses fallback configuration key 'rest.port' instead of key
'rest.bind-port'
Jun 02, 2023 6:16:12 AM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO: Starting rest endpoint.
Jun 02, 2023 6:16:12 AM
org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
WARNING: Log file environment variable 'log.file' is not set.
Jun 02, 2023 6:16:12 AM
org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
WARNING: JobManager log files are unavailable in the web dashboard. Log file
location not found in environment variable 'log.file' or configuration key
'web.log.path'.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,>
line 204, in _new_conn
socket_options=self.socket_options,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/util/connection.py";,>
line 85, in create_connection
raise err
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/util/connection.py";,>
line 73, in create_connection
sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connectionpool.py";,>
line 802, in urlopen
**response_kw,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connectionpool.py";,>
line 504, in _make_request
enforce_content_length=enforce_content_length,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,>
line 388, in request
self.endheaders()
File "/usr/lib/python3.7/http/client.py", line 1276, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.7/http/client.py", line 1036, in _send_output
self.send(msg)
File "/usr/lib/python3.7/http/client.py", line 976, in send
self.connect()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,>
line 236, in connect
self.sock = self._new_conn()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connection.py";,>
line 217, in _new_conn
) from e
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection
object at 0x7f409ce1bbd0>: Failed to establish a new connection: [Errno 111]
Connection refused
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/adapters.py";,>
line 497, in send
chunked=chunked,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/connectionpool.py";,>
line 845, in urlopen
method, url, error=new_e, _pool=self, _stacktrace=sys.exc_info()[2]
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/urllib3/util/retry.py";,>
line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type:
ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost',
port=46525): Max retries exceeded with url: /v1/jars/upload (Caused by
NewConnectionError('<urllib3.connection.HTTPConnection object at
0x7f409ce1bbd0>: Failed to establish a new connection: [Errno 111] Connection
refused'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<string>", line 31, in <module>
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 577, in run
return self.runner.run_pipeline(self, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py";,>
line 45, in run_pipeline
return super().run_pipeline(pipeline, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 448, in run_pipeline
job_service_handle.submit(proto_pipeline)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 117, in submit
return self.run(prepare_response.preparation_id)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 245, in run
beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py";,>
line 120, in Run
self._jobs[job_id].run()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,>
line 154, in run
files={'jarfile': ('beam.jar', jar_file)})['filename'].split('/')[-1]
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,>
line 142, in post
return self.request(requests.post, path, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py";,>
line 130, in request
response = method(url, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/api.py";,>
line 115, in post
return request("post", url, data=data, json=json, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/api.py";,>
line 59, in request
return session.request(method=method, url=url, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/sessions.py";,>
line 589, in request
resp = self.send(prep, **send_kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/sessions.py";,>
line 703, in send
r = adapter.send(request, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/requests/adapters.py";,>
line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost',
port=46525): Max retries exceeded with url: /v1/jars/upload (Caused by
NewConnectionError('<urllib3.connection.HTTPConnection object at
0x7f409ce1bbd0>: Failed to establish a new connection: [Errno 111] Connection
refused'))
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO: Rest endpoint listening at 127.0.0.1:46525
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
updateLeader
INFO: Proposing leadership to contender http://127.0.0.1:46525
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
startInternal
INFO: Web frontend listening at http://127.0.0.1:46525.
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
grantLeadership
INFO: http://127.0.0.1:46525 was granted leadership with
leaderSessionID=9133eee2-16f8-4b21-82cd-b539ea6ddf02
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
confirmLeader
INFO: Received confirmation of leadership for leader http://127.0.0.1:46525 ,
session=9133eee2-16f8-4b21-82cd-b539ea6ddf02
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
updateLeader
INFO: Proposing leadership to contender LeaderContender: DefaultDispatcherRunner
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl start
INFO: Starting resource manager service.
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
updateLeader
INFO: Proposing leadership to contender LeaderContender:
ResourceManagerServiceImpl
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner
lambda$grantLeadership$0
INFO: DefaultDispatcherRunner was granted leadership with leader id
b596a274-faeb-43fd-8dfb-830227e87ea4. Creating new DispatcherLeaderProcess.
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.minicluster.MiniCluster start
INFO: Flink Mini Cluster started successfully
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl
lambda$grantLeadership$2
INFO: Resource manager service is granted leadership with session id
b2c5c7d4-142e-422c-a132-b33426fef228.
Started Flink mini cluster (1 TaskManagers with 1 task slots) with Rest API at
java.util.concurrent.CompletableFuture@388b401d[Completed normally]
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
startInternal
INFO: Start SessionDispatcherLeaderProcess.
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess
recoverJobs
INFO: Recover all persisted job graphs that are not finished, yet.
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess
recoverJobs
INFO: Successfully recovered 0 persisted job graphs.
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
startServer
INFO: Starting RPC endpoint for
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at
akka://flink/user/rpc/resourcemanager_1 .
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
startServer
INFO: Starting RPC endpoint for
org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/rpc/dispatcher_2 .
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.resourcemanager.ResourceManager onStart
INFO: Starting the resource manager.
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
confirmLeader
INFO: Received confirmation of leadership for leader
akka://flink/user/rpc/resourcemanager_1 ,
session=b2c5c7d4-142e-422c-a132-b33426fef228
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
connectToResourceManager
INFO: Connecting to ResourceManager
akka://flink/user/rpc/resourcemanager_1(a132b33426fef228b2c5c7d4142e422c).
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
confirmLeader
INFO: Received confirmation of leadership for leader
akka://flink/user/rpc/dispatcher_2 ,
session=b596a274-faeb-43fd-8dfb-830227e87ea4
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.registration.RetryingRegistration
lambda$startRegistration$0
INFO: Resolved ResourceManager address, beginning registration
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.resourcemanager.ResourceManager
registerTaskExecutorInternal
INFO: Registering TaskManager with ResourceID
9707c215-1309-4876-bc77-d16bb77d5442 (akka://flink/user/rpc/taskmanager_0) at
ResourceManager
Jun 02, 2023 6:16:13 AM
org.apache.flink.runtime.taskexecutor.TaskExecutorToResourceManagerConnection
onRegistrationSuccess
INFO: Successful registration at resource manager
akka://flink/user/rpc/resourcemanager_1 under registration id
3bf5e34cd59b4d0bd7341aca72a0d4a1.
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Jun 02, 2023 6:16:13 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory
/tmp/flink-dist-cache-1aaf9bb3-5c53-47a5-acca-4fac551debb8
>>> FAILURE
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
> Task
> :sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession
> FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 411
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 411
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 36s
148 actionable tasks: 99 executed, 45 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/kh3iuhh6yqsju
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
