Re: [PR] [YAML] - Kafka write and RAW format [beam]

Fri, 27 Oct 2023 03:30:12 -0700 


ffernandez92 commented on PR #29160:
URL: https://github.com/apache/beam/pull/29160#issuecomment-1782679559

   This PR completes the write Kafka part as well as the RAW feature. 
   
   I ran a quick test using DF to validate that everything works as expected 
(in addition of course to the unit tests). It works fine.
   
   ![Screenshot 2023-10-27 at 11 41 
12](https://github.com/apache/beam/assets/20140348/114980b6-e612-4c12-91ab-2cfad3adeea2)
   
   This is the YAML config I've used (writing here for documenting purposes):
   
   ```
   pipeline:
     transforms:
       - type: ReadFromKafka
         config:
           topic: input_topic
           format: RAW
           bootstrap_servers: <kafka_bootstrap_servers>
       - type: WriteToKafka
         config:
           topic: output_topic
           format: RAW
           bootstrap_servers: <kafka_bootstrap_servers>
         input: ReadFromKafka.output


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to