benvit92 commented on issue #27165: URL: https://github.com/apache/beam/issues/27165#issuecomment-1644183789
ok I am gonna structure my thought a little bit better here :) So there are 2 `KinesisReader.java` around, one v1 and one v2, and as far as I can tell `KinesisTransformRegistrar.java` used to map the Python interface to the source Java package is relying on the v1 one. https://github.com/apache/beam/pull/26953 fixed the issues in the `KinesisReader.java` v2 but not in the v1 and as a test I myself cloned master and applied the same fix on the v1 files and after that, the job runs without error. I do encounter another issue though which is then when running on my laptop using the `DirectRunner` nothing happens when it comes to reading data even if I have data in the source stream and I am using the option `InitialPositionInStream.TRIM_HORIZON`, so the job runs but no data are read. I also tried to make the KinesisTransformRegistrar.java` point to v2 as the job does get deprecation warnings as v1 seems to be deprecated but my understanding of the project is not enough to make it work right now (plus my Java is a bit rusty 😓 ). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
