Hi, I have a few piplines that are an ETL from different systems to bigquery. I would like to write the status of the ETL after all records have been updated to the bigquery. The problem is that writing to bigquery is a sink and you cannot have any other steps after the sink. I tried a sideoutput, but this is called in no correlation to the writing to bigquery, so i don't know if it succeeded or failed.
any ideas? chaim
