aryavaibhav93 commented on a change in pull request #3050:
URL: https://github.com/apache/incubator-gobblin/pull/3050#discussion_r444412834
##########
File path:
gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/writer/FileAwareInputStreamDataWriter.java
##########
@@ -140,9 +140,13 @@ public FileAwareInputStreamDataWriter(State state, int
numBranches, int branchId
this.fs = FileSystem.get(uri, conf);
this.fileContext = FileContext.getFileContext(uri, conf);
- this.stagingDir = this.writerAttemptIdOptional.isPresent() ? WriterUtils
- .getWriterStagingDir(state, numBranches, branchId,
this.writerAttemptIdOptional.get())
- : WriterUtils.getWriterStagingDir(state, numBranches, branchId);
+ if
(state.getPropAsBoolean(ConfigurationKeys.USER_DEFINED_STAGING_DIR_FLAG)) {
Review comment:
For backward-compatibility, I have added default value of
USER_DEFINED_STAGING_DIR_FLAG as false, also, in disctp template the value for
the above flag is false
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
