Abacn commented on issue #22809: URL: https://github.com/apache/beam/issues/22809#issuecomment-1405801259
Giving up testing locally... Python direct runner does not quite support streaming and stuck indefinetely; flink runner does not see incoming data, waiting for ~1 min then the following error happens and job fails: ``` INFO:apache_beam.utils.subprocess_server:Caused by: java.util.concurrent.TimeoutException: Heartbeat of TaskManager with id 192.168.10.176:56431-3bf602 timed out. INFO:apache_beam.utils.subprocess_server: ... 30 more INFO:apache_beam.utils.subprocess_server: ERROR:root:java.util.concurrent.TimeoutException: Heartbeat of TaskManager with id 192.168.10.176:56431-3bf602 timed out. INFO:apache_beam.runners.portability.portable_runner:Job state changed to FAILED ``` setting max_records or max_read_time do see records popping up when num record reached or timeout. Will test on Dataflow runner tomorrow We definitely need to improve test infrastructure. The missing piece of direct runner has generated substantial confusions... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
