Re: [EXTERNAL] Re: Help required - "BucketingSink" usage to write HDFS Files

2017-08-07 Thread Raja . Aravapalli
Thanks very much for the pointers Vinay. That helps ☺ -Raja. From: vinay patil Date: Monday, August 7, 2017 at 1:56 AM To: "user@flink.apache.org" Subject: Re: [EXTERNAL] Re: Help required - "BucketingSink" usage to write HDFS Files Hi Raja, That is why they are in th

Re: [EXTERNAL] Re: Help required - "BucketingSink" usage to write HDFS Files

2017-08-06 Thread vinay patil
Help-required-BucketingSink-usage-to-write- > HDFS-Files-tp14714.html > > To start a new topic under Apache Flink User Mailing List archive., email > [hidden > email] > To unsubscribe from Apache Flink User Mailing List archive., click here. > NAML > <http://apache-flink-user-mailing-list-archive.2336050.n4.nab

Re: [EXTERNAL] Re: Help required - "BucketingSink" usage to write HDFS Files

2017-08-06 Thread Raja . Aravapalli
/Test/part-0-1.pending Regards, Raja. From: vinay patil Date: Sunday, August 6, 2017 at 10:40 PM To: "user@flink.apache.org" Subject: [EXTERNAL] Re: Help required - "BucketingSink" usage to write HDFS Files Hi Raja, Have you enabled checkpointing? The files will be roll

Re: Help required - "BucketingSink" usage to write HDFS Files

2017-08-06 Thread vinay patil
Hi Raja, Have you enabled checkpointing? The files will be rolled to complete state when the batch size is reached (in your case 2 MB) or when the bucket is inactive for a certain amount of time. Regards, Vinay Patil On Mon, Aug 7, 2017 at 7:53 AM, Raja.Aravapalli [via Apache Flink User Mailin