chamikaramj commented on issue #22809: URL: https://github.com/apache/beam/issues/22809#issuecomment-1424671633
> If I add max_records I can can data from the DirectRunner but I haven't been able to consume messages with the DataFlowRunner. This likely indicates that the issue you are running into for Dataflow is unrelated to other issues mentioned here. Possibly it's due to Dataflow workers not being able to connect to your on-prem cluster but hard to say without looking at the job. If you file a Dataflow support ticket, they should be able to look at your specific job. The issue https://github.com/apache/beam/issues/20979 mentioned above should not affect Dataflow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
