[
https://issues.apache.org/jira/browse/BEAM-14185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Oliveira updated BEAM-14185:
-----------------------------------
Resolution: Fixed
Status: Resolved (was: Open)
> [SpannerIO.readChangeStreams] Drop metadata tables at the end of the job
> ------------------------------------------------------------------------
>
> Key: BEAM-14185
> URL: https://issues.apache.org/jira/browse/BEAM-14185
> Project: Beam
> Issue Type: New Feature
> Components: io-java-gcp
> Affects Versions: 2.37.0
> Reporter: Thiago Nunes
> Assignee: Thiago Nunes
> Priority: P2
> Fix For: 2.38.0
>
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> The SpannerIO.readChangeStreams Connector uses metadata tables to keep track
> of its internal state during execution. At the moment, these metadata tables
> linger after the execution, meaning that users will have to drop them
> manually.
> In this change, we would like to drop them automatically once the job
> finishes. This should only occur after all partitions have been processed
> successfully and marked as finished.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
