homatthew commented on code in PR #3818:
URL: https://github.com/apache/gobblin/pull/3818#discussion_r1380635844
##########
gobblin-modules/gobblin-orc/src/main/java/org/apache/gobblin/writer/GobblinBaseOrcWriter.java:
##########
@@ -241,6 +245,16 @@ protected synchronized void closeInternal()
throw new CloseBeforeFlushException(this.inputSchema.toString());
}
}
+ // Validate the ORC file after writer close. Default is false as it
introduce more load to FS and decrease the performance
+ if(this.validateORCAfterClose) {
+ try(Reader reader =OrcFile.createReader(this.stagingFile, new
OrcFile.ReaderOptions(conf))) {
Review Comment:
whitespace is broken. It won't pass the linter
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
