hwani3142 commented on code in PR #11149:
URL: https://github.com/apache/hudi/pull/11149#discussion_r1728904841
##########
hudi-utilities/src/test/java/org/apache/hudi/utilities/streamer/TestStreamSyncUnitTests.java:
##########
@@ -160,6 +165,45 @@ void testGetCheckpointToResume(HoodieStreamer.Config cfg,
HoodieCommitMetadata c
assertEquals(expectedResumeCheckpoint,resumeCheckpoint);
}
+ @ParameterizedTest
+ @MethodSource("getMultiTableStreamerCases")
+ void testCloneConfigsFromMultiTableStreamer(HoodieMultiTableStreamer.Config
cfg) throws IOException {
+ Configuration configuration = new Configuration();
+ JavaSparkContext jssc = mock(JavaSparkContext.class);
+
+ when(jssc.hadoopConfiguration()).thenReturn(configuration);
+
+ HoodieMultiTableStreamer multiTableStreamer = new
HoodieMultiTableStreamer(cfg, jssc);
+ List<TableExecutionContext> tableExecutionContextList =
multiTableStreamer.getTableExecutionContexts();
+ tableExecutionContextList.forEach(it -> {
+ // make sure that if set global properties then each child streamer can
get also
+ assertTrue(it.getConfig().configs.containsAll(cfg.configs));
Review Comment:
@lokeshj1703
We should allow to have empty configs.
[Test case
1](https://github.com/apache/hudi/pull/11149/files#diff-d5d9e34abfadbfc00ca3aa1642dbfde1a59ecaf2976ce7a5be418e9ae0a1a17fR192)
address that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
