tvalentyn commented on PR #33317:
URL: https://github.com/apache/beam/pull/33317#issuecomment-2529247089
SDK crash logs:
```
2024-12-09 11:31:41.296
Waiting for 2 of 2 SDK Harnesses to register.
2024-12-09 11:31:41.466
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.466
2024/12/09 19:31:41 ERROR Exception in thread fn_api_status_handler:
2024-12-09 11:31:41.466
{"stream":"stderr"}
2024-12-09 11:31:41.466
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.466
2024/12/09 19:31:41 ERROR Traceback (most recent call last):
2024-12-09 11:31:41.466
{"stream":"stderr"}
2024-12-09 11:31:41.466
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR File "/usr/local/lib/python3.9/threading.py",
line 980, in _bootstrap_inner
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR self.run()
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR File "/usr/local/lib/python3.9/threading.py",
line 917, in run
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR self._target(*self._args, **self._kwargs)
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR File
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/worker_status.py",
line 175, in <lambda>
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR target=lambda: self._serve(),
name='fn_api_status_handler')
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR File
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/worker_status.py",
line 196, in _serve
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR for request in
self._status_stub.WorkerStatus(self._get_responses()):
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR File
"/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 543, in __next__
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR return self._next()
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR Exception in thread read_state:
2024-12-09 11:31:41.467
Traceback (most recent call last):
2024-12-09 11:31:41.467
File "/usr/local/lib/python3.9/threading.py", line 980, in _bootstrap_inner
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR self.run()
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR File "/usr/local/lib/python3.9/threading.py",
line 917, in run
2024-12-09 11:31:41.467
self._target(*self._args, **self._kwargs)
2024-12-09 11:31:41.467
File
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 1069, in pull_responses
2024-12-09 11:31:41.467
for response in responses:
2024-12-09 11:31:41.467
File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 543,
in __next__
2024-12-09 11:31:41.467
return self._next()
2024-12-09 11:31:41.467
File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 969,
in _next
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR Exception in thread read_grpc_client_inputs:
2024-12-09 11:31:41.467
Traceback (most recent call last):
2024-12-09 11:31:41.467
File "/usr/local/lib/python3.9/threading.py", line 980, in _bootstrap_inner
2024-12-09 11:31:41.467
self.run()
2024-12-09 11:31:41.467
File "/usr/local/lib/python3.9/threading.py", line 917, in run
2024-12-09 11:31:41.467
self._target(*self._args, **self._kwargs)
2024-12-09 11:31:41.467
File
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/data_plane.py",
line 721, in <lambda>
2024-12-09 11:31:41.467
target=lambda: self._read_inputs(elements_iterator),
2024-12-09 11:31:41.467
File
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.9/site-packages/apache_beam/runners/worker/data_plane.py",
line 704, in _read_inputs
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR for elements in elements_iterator:
2024-12-09 11:31:41.467
File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 543,
in __next__
2024-12-09 11:31:41.467
return self._next()
2024-12-09 11:31:41.467
File "/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 969,
in _next
2024-12-09 11:31:41.467
raise self
2024-12-09 11:31:41.467
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC
that terminated with:
2024-12-09 11:31:41.467
status = StatusCode.UNAVAILABLE
2024-12-09 11:31:41.467
details = "Socket closed"
2024-12-09 11:31:41.467
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%!B(MISSING)::1%!D(MISSING):12371 {grpc_message:"Socket closed",
grpc_status:14, created_time:"2024-12-09T19:31:40.530223205+00:00"}"
2024-12-09 11:31:41.467
>
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR raise self
2024-12-09 11:31:41.467
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC
that terminated with:
2024-12-09 11:31:41.467
status = StatusCode.UNAVAILABLE
2024-12-09 11:31:41.467
details = "Socket closed"
2024-12-09 11:31:41.467
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%!B(MISSING)::1%!D(MISSING):12371 {grpc_message:"Socket closed",
grpc_status:14, created_time:"2024-12-09T19:31:40.530280385+00:00"}"
2024-12-09 11:31:41.467
>
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR File
"/usr/local/lib/python3.9/site-packages/grpc/_channel.py", line 969, in _next
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR raise self
2024-12-09 11:31:41.467
{"stream":"stderr"}
2024-12-09 11:31:41.467
2024/12/09 19:31:41 boot.go: error logging message over FnAPI. endpoint
localhost:12370 error: EOF message follows
2024-12-09 11:31:41.467
2024/12/09 19:31:41 ERROR grpc._channel._MultiThreadedRendezvous:
<_MultiThreadedRendezvous of RPC that terminated with:
2024-12-09 11:31:41.467
status = StatusCode.UNAVAILABLE
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
