dummy-work-account commented on issue #28131:
URL: https://github.com/apache/beam/issues/28131#issuecomment-1690661104
When I comment out the windowinto line the error goes away but the pipeline
still doesn't function as expected -- which might be an issue with my custom
DoFn
```python
with beam.Pipeline(options=options) as pipeline:
messages = (
pipeline
| f"Read from input topic {subscription_id}" >>
beam.io.ReadFromPubSub(subscription=subscription_id,
with_attributes=False)
| f"Deserialize Avro {subscription_id}" >> beam.ParDo(
ConfluentAvroReader(schema_registry_conf)).with_outputs(
"record", "error"))
records = messages["record"]
errors = messages["error"]
(records
| 'Aggregate msgs in fixed window' >>
beam.WindowInto(beam.window.FixedWindows(15))
| 'Send hardcoded value to datadog' >> beam.ParDo(SendToDatadog())
| 'Print results' >> beam.Map(print)
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
