Hi,
can you give an example of what you mean for better understanding? Do
you mean using Beam as a scheduler of other ETL workflows?
Jan
On 12/14/23 13:17, data_nerd_666 wrote:
Hi all,
I am new to apache beam, and am very excited to find beam in apache
community. I see lots of use cases of using apache beam for data flow
(process large amount of batch/streaming data). I am just wondering
whether I can use apache beam for control flow (ETL workflow). I don't
mean the spark/flink job in the ETL workflow, I mean the ETL workflow
itself. Because ETL workflow is also a DAG which is very similar as
the abstraction of apache beam, but unfortunately I didn't find such
use cases on internet. So I'd like to ask this question in beam
community to confirm whether I can use apache beam for control flow
(ETL workflow). If yes, please let me know some success stories of
this. Thanks
