Hi All,
Thanks Priyanka and Yogi for your suggestions.
@Yogi: 1st option which you suggested is not feasible because in the
later versions of Hadoop library may support append operation. I feel 2nd
is the best option.
If there are no comments/suggestions from community, I will go through
t
I propose alternate approach to than the 3 options mentioned above:
In AbstractFileOutputOperator we can introduce one flag saying
isFileSystemAppendSupported.
This flag should be set based on the filePath in setup or activate method.
It can be done in 2 ways:
1. Adding if else rules based on fil
I would suggest, we override "openStream" in GenericFileOutputOpeator, as
suggested in option 2 and then handle "append" in different way for FS
which doesn't support append. Or else create concrete classes for all file
systems which don't support append and override the required functions.
-1 for
