rzhang10 commented on code in PR #3659:
URL: https://github.com/apache/gobblin/pull/3659#discussion_r1139351226
##########
gobblin-api/src/main/java/org/apache/gobblin/configuration/State.java:
##########
@@ -62,16 +63,21 @@ public class State implements WritableShim {
@Getter
private Properties specProperties;
+ // This in-mem state will be used to share partition completion information
across different MetadataWriter impls
+ public Map<String, Set<String>> tableToCompletedPartitions;
Review Comment:
The thing is if I make it a config, we can basically set it manually outside
of the code logic, which is not what we want, right? Given this is just some
internal memory state.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
