Re: Flink SQL API: Extra columns added from order by

Hi Morrisa, Can you share more information regarding what type of function "formatDate" is and how did you configure the return type of that function? For the question on the first query If the return type is String, then ASC on a string value should be on alphabetical ordering. However on the

Re: Bandwidth throttling of checkpoints uploading to s3

Thanks for the information Pavel, good to know. And I've created FLINK-13251 to introduce the checkpoint bandwidth throttling feature, FYI. Best Regards, Yu On Sat, 13 Jul 2019 at 00:11, Павел Поцелуев wrote: > >1. We use FsStateBackend

Re: Bandwidth throttling of checkpoints uploading to s3

We use FsStateBackend and state snapshot size is about 700 Mbyte.We are thinking about migration to RocksDBStateBackend and turning on incremental checkpoints.I think incremental size would be small in our current use case so incremental checkpoints can solve the problem.I think it is about 50

Re: Migrating existing application to Flink

I am so excited with 1.9, State Processor API is single handedly the most important update for me. --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Sun, Jul 7, 2019 at 4:34 AM Konstantin Knauf wrote: > Hi Eduardo, > >

Re: Bandwidth throttling of checkpoints uploading to s3

Hi Pavel, Currently there's no such throttling functionality in Flink and I think it's a valid requirement. But before opening a JIRA for this, please allow me to ask for more details to better understand your scenario: 1. What kind of state backend are you using? Since you observe high load to

Bandwidth throttling of checkpoints uploading to s3

Hello! We use flink with periodically checkpointing to s3 file system. And when flink uploads checkpoint to s3 it makes high load to the network. We have found in AWS CLI S3 configuration option called max_bandwidth which allows to limit rate in bytes per second. Is there a way to have the same

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

Congratulations Rong! Best, Congxian Biao Liu 于2019年7月12日周五 下午4:40写道： > Congrats, Rong! > > > Hequn Cheng 于2019年7月12日周五 下午1:09写道： > >> Congratulations Rong! >> >> Best, Hequn >> >> On Fri, Jul 12, 2019 at 12:19 PM Jeff Zhang wrote: >> >>> Congrats, Rong! >>> >>> >>> vino yang 于2019年7月12日周五

Re: user test can't run flink-1.8.1 wordcount

Yes, like the error messages or the logs Jeff Zhang 于2019年7月12日周五 下午4:25写道： > You need to provide more details( like how it doesn't work), otherwise it > is difficult for people to help you. > > > > #38;#38;#38;#38;#38;#10084; <799326...@qq.com> 于2019年7月12日周五 > 下午3:52写道： > >> Dear all, >> I

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

Congrats, Rong! Hequn Cheng 于2019年7月12日周五 下午1:09写道： > Congratulations Rong! > > Best, Hequn > > On Fri, Jul 12, 2019 at 12:19 PM Jeff Zhang wrote: > >> Congrats, Rong! >> >> >> vino yang 于2019年7月12日周五 上午10:08写道： >> >>> congratulations Rong Rong! >>> >>> Fabian Hueske 于2019年7月11日周四

Re: user test can't run flink-1.8.1 wordcount

You need to provide more details( like how it doesn't work), otherwise it is difficult for people to help you. #38;#38;#38;#38;#38;#10084; <799326...@qq.com> 于2019年7月12日周五 下午3:52写道： > Dear all, > I got some issues about flink that Flink-1.8.1’s HA cluster to execute > test cases on the cli

user test can't run flink-1.8.1 wordcount

Dear all,I got some issues about flink that Flink-1.8.1??s HA cluster to execute test cases on the cli client to start the users of outside the cluster. For instance, the command ??flink run WordCounter.jar?? it??s doesn??s work. So, could you give me some successful examples, please.

Re: Migrating existing application to Flink

Great news! Thanks Konstantin On Sun, 7 Jul 2019, 09:34 Konstantin Knauf, wrote: > Hi Eduardo, > > Flink 1.9 will add a new State Processor API [1], which you can use to > create Savepoints from scratch with a batch job. > > Cheers, > > Konstantin > > [1] >

Re: Question in the tutorial

It seems to me that your task manager is started and then failed before registering to the cluster. I think we need the entire log file instead of the result of tail command. Could you just clear the log dir, start the cluster again and wait for a little while (1-2 min should be enough), and post

Re: Table API and ProcessWindowFunction

Hi Flavio, I think the reason that we don't have interfaces like EventTimeObject and ProcessingTimeObject is we don't want to define time attributes anywhere. It is considered to define your time attributes in the source. If we add an interface like EventTimeObject and ProcessingTimeObject in