The StreamingFileSink can have a OutputFileConfig [1] to config the prefix and
suffix of the part file, does that work for you ?
[1]
Yes we looked at it ,
The problem is the file name gets generated in a dynamic fashion, based on
which organization data we are getting we generate the file name from the
coming data.
Is there any way we can achieve this ??
On Tue, May 12, 2020 at 8:38 PM Yun Gao wrote:
> Hi Dhurandar:
>
>
Hi Dhurandar:
Currently StreamingFileSink should be able to change the prefix and suffix
of the filename[1], it could be changed to something like -0-0.
Could this solve your problem ?
Best,
Yun
[1]
We want to change the name of the file being generated as the output of our
StreamFileSink.
, when files are generated they are named part-00*, is there a way that we
can change the name.
In Hadoop, we can change RecordWriters and MultipleOutputs. May I please
some help in this regard. This is
