Re: unsubscribe

2022-05-12 Thread Henry Cai
I did this, but I am still getting emails from the flink user group. On Wed, May 11, 2022 at 6:30 PM yuxia wrote: > To unsubscribe, you can send email to user-unsubscr...@flink.apache.org > with any object. > > Best regards, > Yuxia > > -- >

unsubscribe

2022-05-11 Thread Henry Cai
unsubscribe

Re: Unsubscribe

2022-05-05 Thread Henry Cai
unsubscribe On Wed, May 4, 2022 at 4:27 AM Nishant Gupta wrote: > Unsubscribe >

A question about flink sql retreact stream

2020-11-04 Thread Henry Dai
Dear flink developers I have a question about flink sql, It gives me a lot of trouble, Thank you very much for some help. Lets's assume we have two data stream, `order` and `order_detail`, they are from mysql binlog. Table `order` schema: id int primary key

A question about flink sql retreact stream

2020-11-04 Thread Henry Dai
Dear flink developers I have a question about flink sql, It gives me a lot of trouble, Thank you very much for some help. Lets's assume we have two data stream, `order` and `order_detail`, they are from mysql binlog. Table `order` schema: id int primary key

A question of Flink SQL aggregation

2020-11-04 Thread Henry Dai
Hi, Let's assume we have two stream, order stream& order detail stream, they are from mysql binlog. Table `order` schema: id primary key, order_id and order_status Table `order_detail` schema: id primary key, order_id and quantity one order item have several order_detail items if we have

Re: MODERATE for d...@flink.apache.org

2020-02-24 Thread Henry Saputra
Hi Sri, Thank you for your interest with Apache Flink. To continue to interact with people in the mailing list, please subscribe to the list [1] to make sure your posts are delivered to the right list. Thanks, Henry [1] https://flink.apache.org/community.html#how-to-subscribe-to-a-mailing

Re:回复: 本地checkpoint 文件190G了

2019-11-29 Thread Henry
ser-zh"; >主题: Re: 本地checkpoint 文件190G了 > > >你的 retain 数量设置是多少,然后程序里 state 本身写了多大的 state,有没开启 incremental checkpoint > >Best, >tison. > > >sun <1392427...@qq.com> 于2019年11月30日周六 上午10:28写道: > >> 花了两天时间-- 原始邮 -- >> 发人: &

Re:本地checkpoint 文件190G了

2019-11-29 Thread Henry
是不是很快就增长到那么多了? 在 2019-11-30 10:13:27,"sun" <1392427...@qq.com> 写道: 求助,我的文件夹一直在长大 发自我的iPhone

Re:yarn-session.sh 启动 报错

2019-11-18 Thread Henry
是不是程序里没有指定入口类啊? 在命令行里指定试试? -C com.xx.bbb 在 2019-11-18 16:31:26,"李军" 写道: >启动命令: ./bin/yarn-session.sh -n 2 -jm 1024 -tm 1024 >报错:Error: Could not find or load main class >org.apache.flink.yarn.cli.FlinkYarnSessionCli > > >ResourceManager,NodeManager都已启动。

Re:Re: 通过 yarn-cluster 提交多个任务,Flink 页面只显示最后一个提交的任务

2019-11-18 Thread Henry
终于搞明白了,太感谢啦 在 2019-11-18 16:09:32,"aihua li" 写道: >这个跟每个job申请的资源有关,如果三个job申请的总资源数小于yarn总的资源,那么三个job是可以同时running,否则会有job因为资源申请不到而处于accepted状态 >资源足够的话两个job是可以调度到一台机器上的,只是端口号不同而已,可以从yarn页面上通过链接进入不同的页面查看 > >> 在 2019年11月18日,下午3:54,Henry 写道: >> >> >

Re:Re: 通过 yarn-cluster 提交多个任务,Flink 页面只显示最后一个提交的任务

2019-11-17 Thread Henry
:44:09,"aihua li" 写道: >看了你的截图,链接中是id为0018的application,里面确实只有一个job,另一个job是在id为0019的application里,你变更下链接中的applicationId,应该就能看到另一个作业了 > >> 在 2019年11月17日,下午4:14,Henry 写道: >> >> >> >> 是的,两个程序确实也都在运行,俩程序往数据库里写的数据是不同的,都在更新,所以运行木有问题。但是在 Flink Web 页面里的 Runnin

Re:Re:Re:Re: 通过 yarn-cluster 提交多个任务,Flink 页面只显示最后一个提交的任务

2019-11-17 Thread Henry
在 2019-11-17 16:14:32,"Henry" 写道: > > >是的,两个程序确实也都在运行,俩程序往数据库里写的数据是不同的,都在更新,所以运行木有问题。但是在 Flink Web 页面里的 Running Job >中只有最后提交的那个 >程序,没有先提交的那个程序,确实有问题。您看下那个链接,是我截的图,谢谢。 > > > > > >在 2019-11-17 16:05:29,18612537...@163.com 写道: >>提交两个是两个进程,所以是两个jo

Re:Re: 通过 yarn-cluster 提交多个任务,Flink 页面只显示最后一个提交的任务

2019-11-17 Thread Henry
是的,两个程序确实也都在运行,俩程序往数据库里写的数据是不同的,都在更新,所以运行木有问题。但是在 Flink Web 页面里的 Running Job 中只有最后提交的那个 程序,没有先提交的那个程序,确实有问题。您看下那个链接,是我截的图,谢谢。 在 2019-11-17 16:05:29,18612537...@163.com 写道: >提交两个是两个进程,所以是两个job。我觉得没有任何问题,你点进去flink的页面肯定各是各的。 > >发自我的iPhone > >> 在 2019年11月17日,下午2:51,Henry 写道:

通过 yarn-cluster 提交多个任务,Flink 页面只显示最后一个提交的任务

2019-11-16 Thread Henry
大家好,我想请教一个问题哈。 就是我通过 ./flink run -m yarn-cluster -yn 2 -yjm 1024 -ytm 1024 xxx.jar 的方式提交了两个不同的任务程序,在yarn界面里也能看到两个正在运行的 app ,但是点击 对应的 ApplicationMater 跳转到 Flink-Dashboard 页面之后,在 Running job 页面只看到一个运行的最后提交的程序呢? Task Slot 也只用了 1 个,这是啥情况呢? 也木有报错。yarn 页面显示两个任务都是 Running

通过 yarn-cluster 提交多个任务,Flink 页面只显示最后一个提交的任务

2019-11-15 Thread Henry
大家好,我想请教一个问题哈。 就是我通过 ./flink run -m yarn-cluster -yn 2 -yjm 1024 -ytm 1024 xxx.jar 的方式提交了两个不同的任务程序,在yarn界面里也能看到两个正在运行的 app ,但是点击 对应的 ApplicationMater 跳转到 Flink-Dashboard 页面之后,在 Running job 页面只看到一个运行的最后提交的程序呢? Task Slot 也只用了 1 个,这是啥情况呢? 也木有报错。yarn 页面显示两个任务都是 Running

Re:Re: Flink 的 log 文件夹下产生了 34G 日志

2019-10-28 Thread Henry
/%3c465086db-1679-4dd9-aab5-086bb4039...@gmail.com%3E> >> 在 2019年10月28日,下午10:00,Henry 写道: >> >> >> >> 谢谢您。不过连接打不开呀。 >> >> http://apache-flink.147419.n8.nabble.com/Flink-BlobServerConnection-NoSuchFileException-td722.html#a724 >> >> >

Re:Re: Flink 的 log 文件夹下产生了 34G 日志

2019-10-28 Thread Henry
722.html#a724 > ><http://apache-flink.147419.n8.nabble.com/Flink-BlobServerConnection-NoSuchFileException-td722.html#a724> > > > >> 在 2019年10月28日,下午3:54,Henry 写道: >> >> 您好! >> >> >> 请问一下,发现flink任务失败了,然后程序自己重启也失败,然后就不停的写日志。产生了 34G

Flink 的 log 文件夹下产生了 34G 日志

2019-10-28 Thread Henry
您好! 请问一下,发现flink任务失败了,然后程序自己重启也失败,然后就不停的写日志。产生了 34G log,没看出来这是因为啥导致的, 谢谢大家了。 日志内容如下: https://img-blog.csdnimg.cn/20191028155219828.png https://img-blog.csdnimg.cn/20191028155224293.png https://img-blog.csdnimg.cn/20191028155227494.png

Re:回复: Re: Flink SQL :Unknown or invalid SQL statement.

2019-10-08 Thread Henry
谢谢啦 在 2019-10-09 11:19:17,"pengchengl...@163.com" 写道: >你好,可以参考https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/table/sqlClient.html > > > >pengchengl...@163.com > >发件人: Henry >发送时间: 2019-10-09 10:44 >收件人: user-zh >主题: Re:Re: Fli

Re:Re: Re: Re: Re: Flink 的 log 文件夹下产生了 44G 日志

2019-07-21 Thread Henry
看到啦,谢谢啦。 在 2019-07-21 19:16:36,"Caizhi Weng" 写道: >Hi Henry, > >你可能看错了,仔细看你的 run 函数,里面有个 try catch 里有 running = true... > >Henry 于2019年7月20日周六 下午9:32写道: > >> >> >> 啊!我想起来了,之前忘了因为啥原因了,为了方便调试把 running = false; 改成了 running = true; >> 感谢感谢!

Re:Re: Flink 的 log 文件夹下产生了 44G 日志

2019-07-19 Thread Henry
你好,谢谢!是的,这个Source是用JMS实现的自定义Source。目前还在查原因,但是怎么能够让Flink不这样爆炸写log日志呢?20分钟就能写满磁盘,写了40G多。 在 2019-07-19 11:11:37,"Caizhi Weng" 写道: >Hi Henry, > >这个 source 看起来不像是 Flink 提供的 source,应该是 source 本身实现的问题。你可能需要修改 source >的源码让它出错后关闭或者进行其它处理... > >Henry 于2019年7月19日周五 上午9:3

Flink 的 log 文件夹下产生了 44G 日志

2019-07-18 Thread Henry
大家好,之前那个报错图片大家没看到,重新弄一下。 报错图片链接: https://img-blog.csdnimg.cn/20190719092540880.png https://img-blog.csdnimg.cn/20190719092848500.png 我看报错的原因是,我这里Source用的是ActiveMQ,从昨天早上9点开始运行Flink任务接收消息,到今天早上8点都很正常。然后在今天早上8点4分的时候开始猛报错flink往log文件夹下写日志。第二个图是报错开始,显示ActiveMQ好像超时,然后就是消费者关闭一直猛写log。

Re:Re: Flink 的 log 文件夹下产生了 44G 日志

2019-07-18 Thread Henry
明白啦,谢谢哈。 我以为会显示图片呢。 我贴链接下次。 在 2019-07-18 12:03:57,"zhisheng" 写道: >尴尬了,之前回复的邮件难道都是空白,Henry >你可以把报错信息放到哪个博客里面,然后再这里提供个链接,邮件看不到你的截图错误信息,你可以先根据错误信息定位问题所在,把错误的问题先解决掉,然后再来合理的配置重启策略。 > >Biao Liu 于2019年7月18日周四 上午1:15写道: > >> Hi Henry, >> >> 邮件列表貌似不能支持直接

Flink 的 log 文件夹下产生了 44G 日志

2019-07-16 Thread Henry
您好! 请问一下,把程序打jar包然后提交集群运行了一天,flink安装目录下的log文件夹里产生了44G日志文件。flink 主要做的接收到消息处理完之后写入数据库,但是通过查看数据库数据的情况,数据也挺完整的没有什么错误,可是tail 查看了一下产生的log文件,里面不停的在产生 error 信息,但是也没有看到具体哪里报错,IDEA 本地运行的时候没有报错。据说要在代码设置默认重启策略,我在代码里开启了checkpoint,“senv.enableCheckpointing(6) ,看资料说“如果启用了

[no subject]

2018-11-27 Thread Henry Dai
Hi, Is there a way to get table's metadata in flink? if I emit a table to kafka, then how can I know the table columns when I subscribe the kafka topic and restore the table using *tableEnv.registerDataStream("t1", source, "field1, field2 ...") *in another flink program? Flink should provide

Re: [ANNOUNCE] Flink 1.1.0 Released

2016-08-08 Thread Henry Saputra
Great work all. Great Thanks to Ufuk as RE :) On Monday, August 8, 2016, Stephan Ewen wrote: > Great work indeed, and big thanks, Ufuk! > > On Mon, Aug 8, 2016 at 6:55 PM, Vasiliki Kalavri < > vasilikikala...@gmail.com > > wrote: > > > yoo-hoo finally announced 

Re: 1.1-snapshot issues

2016-05-17 Thread Henry Saputra
Looks like it has been resolved, Could you try it again? On Tue, May 17, 2016 at 7:02 AM, Stefano Baghino < stefano.bagh...@radicalbit.io> wrote: > I believe that Apache repo is having some issues right now: > https://status.apache.org/ > > On Tue, May 17, 2016 at 3:55 PM, aris kol

Re: join performance

2016-04-29 Thread Henry Cai
ould trigger the actual window processing. Elements will still be put into > the correct windows based on event time, just the firing of the windows > will change by doing this. > > Cheers, > Aljoscha > > On Fri, 29 Apr 2016 at 08:53 Henry Cai <h...@pinterest.com> wrote: >

Re: join performance

2016-04-29 Thread Henry Cai
com> wrote: > Time unit can be in seconds as well. Is there specific need to get bursts > hourly? > > On Fri, Apr 29, 2016 at 11:48 AM, Henry Cai <h...@pinterest.com> wrote: > >> For the below standard stream/stream join, does flink store the results >> of

join performance

2016-04-29 Thread Henry Cai
For the below standard stream/stream join, does flink store the results of stream 1 and stream 2 into state store for the current hour and at the end of the hour window it will fire the window by iterating through all stored elements in the state store to find join matches? My concern is during

Re: streaming join implementation

2016-04-14 Thread Henry Cai
umblingEventTimeWindows.of(Time.of(5, TimeUnit.MINUTE))).apply(new > SomeJoinFunction) > > > On Thu, Apr 14, 2016 at 10:02 AM, Henry Cai <h...@pinterest.com> wrote: > >> Hi, >> >> We are evaluating different streaming platforms. For a typical join >> between

streaming join implementation

2016-04-13 Thread Henry Cai
Hi, We are evaluating different streaming platforms. For a typical join between two streams select a.*, b.* FROM a, b ON a.id == b.id How does flink implement the join? The matching record from either stream can come late, we consider it's a valid join as long as the event time for record a

Re: Powered by Flink

2016-04-06 Thread Henry Saputra
Thanks, Slim. I have just updated the wiki page with this entries. On Tue, Apr 5, 2016 at 10:20 AM, Slim Baltagi wrote: > Hi > > The following are missing in the ‘Powered by Flink’ list: > >- *king.com * > >

Re: FYI: Added Documentation on Basic Concepts

2016-04-04 Thread Henry Saputra
This is great. This will open up the concepts in Flink that kind of "magic" from external users. - Henry On Mon, Apr 4, 2016 at 2:39 AM, Ufuk Celebi <u...@apache.org> wrote: > Dear Flink community, > > I'm happy to announce that we have added a long overdue section on

Re: [ANNOUNCE] Introducing Apache Flink Taiwan User Group - Flink.tw

2016-01-03 Thread Henry Saputra
Awesome news! Thanks for sharing! On Fri, Jan 1, 2016 at 10:24 AM, tzulitai wrote: > Hi Flink community, > > We are very excited to announce a new local Flink user group / meetup based > in Taiwan: > > Facebook group: http://www.facebook.com/groups/flink.tw >

Re: [VOTE] Release Apache Flink 0.10.1 (release-0.10.0-rc1)

2015-11-25 Thread Henry Saputra
+1 LICENSE file looks good in source artifact NOTICE file looks good in source artifact Signature file looks good in source artifact Hash files looks good in source artifact No 3rd party executables in source artifact Source compiled All tests are passed Run standalone mode test app - Henry

Re: Error trying to access JM through proxy

2015-10-03 Thread Henry Saputra
Hi Emmanuel, Could you tell a bit how the proxy being setup? - Henry On Fri, Oct 2, 2015 at 1:55 PM, Emmanuel <ele...@msn.com> wrote: > When trying to access the JM through a proxy I get: > > > 19:26:23,113 ERROR akka.remote.EndpointWriter > - dr

Re: Gelly ran out of memory

2015-08-21 Thread Henry Saputra
by either spilling or compacting. The solution set cannot spill at this point, so if compaction does not help, it gives up. On Thu, Aug 20, 2015 at 8:50 PM, Henry Saputra henry.sapu...@gmail.com javascript:_e(%7B%7D,'cvml','henry.sapu...@gmail.com'); wrote: Hi Stephan, this looks like a bug to me

Re: Gelly ran out of memory

2015-08-20 Thread Henry Saputra
Hi Stephan, this looks like a bug to me. Shouldn't the memory manager switch to out of managed area if it is out of memory space? - Henry On Thu, Aug 20, 2015 at 3:09 AM, Stephan Ewen se...@apache.org wrote: Actually, you ran out of Flink Managed Memory, not user memory. User memory shortage

[ANNOUNCEMENT] Please add more Description and information to JIRA issues

2015-08-16 Thread Henry Saputra
. Thanks, - Henry [1] https://flink.apache.org/how-to-contribute.html

[ANNOUNCE] Introducing Bay Area Apache Flink meetup

2015-05-28 Thread Henry Saputra
about the upcoming events. If anyone in bay area would like to do a talk about Apache Flink please do let us know. Thanks, - Henry

Re: Flink 0.9.0-milestone1 released

2015-04-13 Thread Henry Saputra
Woot! Great news! On Monday, April 13, 2015, Kostas Tzoumas ktzou...@apache.org wrote: We are very excited to announce Flink 0.9.0-milestone1, a preview release to give users early access to some Flink 0.9.0 features, including: - A Table API for SQL-like queries embedded in Java and Scala

Re: Flink meetup group in Stockholm

2015-04-08 Thread Henry Saputra
Nice, congrats! On Wed, Apr 8, 2015 at 7:39 AM, Gyula Fóra gyf...@apache.org wrote: Hey Everyone! We our proud to announce the first Apache Flink meetup group in Stockholm. Join us at http://www.meetup.com/Apache-Flink-Stockholm/ We are looking forward to organise our first event in May!

Re: Flink cluster dev environment in Docker

2015-03-24 Thread Henry Saputra
but if you would try it it would be great =) Thanks, Henry [1] https://github.com/apache/flink [2] https://help.github.com/articles/using-pull-requests On Tue, Mar 24, 2015 at 5:33 PM, Emmanuel ele...@msn.com wrote: I'm new to Docker too, but I find it to be a great tool to setup a dev environment

Re: Community vote for Hadoop Summit result

2015-01-29 Thread Henry Saputra
W00t! Congrats guys! On Thu, Jan 29, 2015 at 4:06 PM, Márton Balassi mbala...@apache.org wrote: Hi everyone, Thanks for your support for the Flink talks at the community choice for the next Hadoop Summit Europe. The results are out. [1] Our submission Real-Time Stream Processing with Apache