the-other-tim-brown commented on code in PR #6135:
URL: https://github.com/apache/hudi/pull/6135#discussion_r957632497
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/SourceFormatAdapter.java:
##########
@@ -96,7 +101,7 @@ public InputBatch<JavaRDD<GenericRecord>>
fetchNewDataInAvroFormat(Option<String
public InputBatch<Dataset<Row>> fetchNewDataInRowFormat(Option<String>
lastCkptStr, long sourceLimit) {
switch (source.getSourceType()) {
case ROW:
- return ((RowSource) source).fetchNext(lastCkptStr, sourceLimit);
Review Comment:
This is to allow us to use base classes other than the Row|Json|AvroSource.
In the case of this PR, I've added a KafkaSource as a base class so we can
reuse the logic for fetching and comitting offsets
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
