olehborysevych commented on code in PR #29507: URL: https://github.com/apache/beam/pull/29507#discussion_r1411130292
########## learning/prompts/documentation-lookup/13_advanced_splittable_dofn.md: ########## @@ -0,0 +1,18 @@ +Prompt: +What is Splittable DoFn in Apache Beam? +Response: +Splittable DoFn (SDF) is a generalization of [DoFn](https://beam.apache.org/documentation/programming-guide/#pardo) that lets you process elements in a non-monolithic way. Splittable DoFn makes it easier to create complex, modular I/O connectors in Beam. +When you apply a splittable DoFn to an element, the runner has the option of splitting the element’s processing into smaller tasks. You can checkpoint the processing of an element, and you can split the remaining work to yield additional parallelism. Review Comment: Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
