olehborysevych commented on code in PR #29507: URL: https://github.com/apache/beam/pull/29507#discussion_r1411164727
########## learning/prompts/code-explaination/03_io_bigquery.md: ########## @@ -0,0 +1,34 @@ +Prompt: +What does this code do? +```python Review Comment: big query is not ready yet. I will remove from PR, ########## learning/prompts/code-explaination/03_io_bigquery.md: ########## @@ -0,0 +1,34 @@ +Prompt: +What does this code do? +```python +pipeline_options = PipelineOptions(pipeline_args) + +with beam.Pipeline(options=options) as p: + (p | "Read" >> ReadFromPubSub(subscription=input_subscription) + | "Process" >> ParDo(ProcessMessage()) + | "Write" >> WriteToPubSub(topic=output_topic)) +``` + +Response: +This code reads messages from a [PubSub](https://cloud.google.com/pubsub) subscription `input_subscription` using the `ReadFromPubSub`, processes them and writes the resulting collection to a PubSub topic `output_topic` using the `WriteToPubSub` transform. + +PubSub is currently supported only in streaming pipelines. + +Reading messages directly from a topic is also supported. In this case a temporary subscription will be created automatically. Review Comment: big query is not ready yet. I will remove from PR, -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
