subject:"\[EXTERNAL\] Re\: Bucketing\/Rolling Sink\: New timestamp appeded to the part file name everytime a new part file is rolled"

Re: [EXTERNAL] Re: Bucketing/Rolling Sink: New timestamp appeded to the part file name everytime a new part file is rolled

2017-09-01 Thread Felix Cheung

Yap I was able to get this to work with a custom bucketer. A custom bucketer can use the clock given ("processing time") or it can use a timestamp from the data ("event time") for the bucketing path. From: Raja.Aravapalli Sent:

Re: [EXTERNAL] Re: Bucketing/Rolling Sink: New timestamp appeded to the part file name everytime a new part file is rolled

2017-09-01 Thread Raja . Aravapalli

Thanks Aljoscha for the inputs. I will check to extend “BasePathBucketer” class. Regards, Raja. From: Aljoscha Krettek Date: Friday, September 1, 2017 at 10:27 AM To: Piotr Nowojski Cc: Raja Aravapalli ,