Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Peter Huang
Congratulations Best Regards Peter Huang On Wed, Mar 20, 2024 at 6:56 AM Huajie Wang wrote: > > Congratulations > > > > Best, > Huajie Wang > > > > Leonard Xu 于2024年3月20日周三 21:36写道: > >> Hi devs and users, >> >> We are thrilled to annou

Re: Flink K8S operator does not support IPv6

2023-08-07 Thread Peter Huang
We will handle it asap. Please check the status of this jira https://issues.apache.org/jira/browse/FLINK-32777 On Mon, Aug 7, 2023 at 8:08 PM Xiaolong Wang wrote: > Hi, > > I was testing flink-kubernetes-operator in an IPv6 cluster and found out > the below issues: > > *Caused by:

Re: Add control mode for flink

2021-06-04 Thread Peter Huang
I agree with Steven. This logic can be added in a dynamic config framework that can bind into Flink operators. We probably don't need to let Flink runtime handle it. On Fri, Jun 4, 2021 at 8:11 AM Steven Wu wrote: > I am not sure if we should solve this problem in Flink. This is more like > a

Re: [ANNOUNCE] Apache Flink 1.12.1 released

2021-01-18 Thread Peter Huang
Thanks for the great effort to make this happen. It paves us from using 1.12 soon. Best Regards Peter Huang On Mon, Jan 18, 2021 at 8:16 PM Yang Wang wrote: > Thanks Xintong for the great work as our release manager! > > > Best, > Yang > > Xintong Song 于2021年1月19日周二 上午11:

Re: Question about processing a 3-level List data type in parquet

2020-11-06 Thread Peter Huang
Hi Naehee, Thanks for reporting the issue. Yes, it is a bug in the ParquetInputFormat. Would you please create a jira ticket and assign to me. I will try to fix it by the end of this weekend. My Jira account name Zhenqiu Huang. Thanks Best Regards Peter Huang On Wed, Nov 4, 2020 at 11:57 PM

Re: Question about RocksDB performance tunning

2020-07-03 Thread Peter Huang
Hi Yun, Thanks for the info. These materials help a lot. Best Regards Peter Huang On Thu, Jul 2, 2020 at 11:36 PM Yun Tang wrote: > Hi Peter > > This is a general problem and you could refer to RocksDB's tuning > guides[1][2], you could also refer to Flink built-in Predefined

Question about RocksDB performance tunning

2020-07-02 Thread Peter Huang
Kafka lag even about memory tunning. The QPS is also growing very fast. I am wondering whether we have good guidance for performance tunning of RocksDB state backend for such kind of large QPS jobs. Best Regards Peter Huang

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-21 Thread Peter Huang
Congrats Jingsong! On Fri, Feb 21, 2020 at 8:49 AM Rong Rong wrote: > Congratulations Jingsong!! > > Cheers, > Rong > > On Fri, Feb 21, 2020 at 8:45 AM Bowen Li wrote: > >> Congrats, Jingsong! >> >> On Fri, Feb 21, 2020 at 7:28 AM Till Rohrmann >> wrote: >> >>> Congratulations Jingsong! >>>

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

2020-01-16 Thread Peter Huang
Congratulations, Dian! Best Regards Peter Huang On Thu, Jan 16, 2020 at 11:04 AM Yun Tang wrote: > Congratulations, Dian! > > Best > Yun Tang > -- > *From:* Benchao Li > *Sent:* Thursday, January 16, 2020 22:27 > *To:* Congxian Qiu >

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-13 Thread Peter Huang
Congratulations!:) On Fri, Dec 13, 2019 at 9:45 AM Piotr Nowojski wrote: > Congratulations! :) > > > On 13 Dec 2019, at 18:05, Fabian Hueske wrote: > > > > Congrats Zhu Zhu and welcome on board! > > > > Best, Fabian > > > > Am Fr., 13. Dez. 2019 um 17:51 Uhr schrieb Till Rohrmann < > >

Re: SQL for Avro GenericRecords on Parquet

2019-12-09 Thread Peter Huang
Hi Hanan, I created a fix for the problem. Would you please try it from your side? https://github.com/apache/flink/pull/10371 Best Regards Peter Huang On Tue, Nov 26, 2019 at 8:07 AM Peter Huang wrote: > Hi Hanan, > > After investigating the issue by using the test case you provided

Re: SQL for Avro GenericRecords on Parquet

2019-11-26 Thread Peter Huang
wse/FLINK-14953. Please also add more insight by comment directly on it. Best Regards Peter Huang On Mon, Nov 18, 2019 at 12:40 PM Hanan Yehudai wrote: > HI Peter. Thanks. > > This is my code . I used one of the parquet / avro tests as a reference. > > > > The code will fa

Re: SQL for Avro GenericRecords on Parquet

2019-11-18 Thread Peter Huang
Hi Hanan, Thanks for reporting the issue. Would you please attach your test code here? I may help to investigate. Best Regards Peter Huang On Mon, Nov 18, 2019 at 2:51 AM Hanan Yehudai wrote: > I have tried to persist Generic Avro records in a parquet file and then > read

Re: [DISCUSS] Semantic and implementation of per-job mode

2019-10-31 Thread Peter Huang
-0CHbgv16Me-vjaaDMCfhX7TzVVTuifYM/edit?ts=5da1f4d7#heading=h.be92q3uiam4t Best Regards Peter Huang On Thu, Oct 31, 2019 at 8:17 PM bupt_ljy wrote: > Hi all, > > > Firstly thanks @tison for bring this up and strongly +1 for the overall > design. > > > I’d like

Re: Setting environment variables of the taskmanagers (yarn)

2019-09-25 Thread Peter Huang
Hi Richard, Good suggestion. I just created a Jira ticket. I will find a time this week to update docs. Best Regards Peter Huang On Wed, Sep 25, 2019 at 8:05 AM Richard Deurwaarder wrote: > Hi Peter and Jiayi, > > Thanks for the answers this worked perfectly, I j

Re: Setting environment variables of the taskmanagers (yarn)

2019-09-24 Thread Peter Huang
). */ public static final String CONTAINERIZED_TASK_MANAGER_ENV_PREFIX = "containerized.taskmanager.env."; Best Regards Peter Huang On Tue, Sep 24, 2019 at 8:02 AM Richard Deurwaarder wrote: > Hello, > > We have our flink job (1.8.0) running on our hadoop 2.7 cluster wi

Re: suggestion of FLINK-10868

2019-09-12 Thread Peter Huang
Hi Anyang and Till, I think we agreed on making the interval configurable in this case. Let me revise the current PR. You can review it after that. Best Regards Peter Huang On Thu, Sep 12, 2019 at 12:53 AM Anyang Hu wrote: > Thanks Till, I will continue to follow this issue and see what

Re: suggestion of FLINK-10868

2019-09-08 Thread Peter Huang
implementation, the MaximumFailedTaskManagerExceedingException is SuppressRestartsException. It will exit immediately. Best Regards Peter Huang On Sun, Sep 8, 2019 at 1:27 AM Anyang Hu wrote: > Hi Till, > Thank you for the reply. > > 1. The batch processing may be customized according

Re: suggestion of FLINK-10868

2019-09-05 Thread Peter Huang
Hi Anyang, Thanks for raising it up. I think it is reasonable as what you requested is needed for batch. Let's wait for Till to give some more input. Best Regards Peter Huang On Thu, Sep 5, 2019 at 7:02 AM Anyang Hu wrote: > Hi Peter: > > As commented in the issue

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-22 Thread Peter Huang
It is great news for the community. Thanks to everyone who contributed to the release management. Congratulations! On Thu, Aug 22, 2019 at 9:14 PM Haibo Sun wrote: > Great news! Thanks Gordon and Kurt! > > Best, > Haibo > > > At 2019-08-22 20:03:26, "Tzu-Li (Gordon) Tai" wrote: > >The Apache

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

2019-07-11 Thread Peter Huang
Congrats Rong! On Thu, Jul 11, 2019 at 10:40 AM Becket Qin wrote: > Congrats, Rong! > > On Fri, Jul 12, 2019 at 1:13 AM Xingcan Cui wrote: > >> Congrats Rong! >> >> Best, >> Xingcan >> >> On Jul 11, 2019, at 1:08 PM, Shuyi Chen wrote: >> >> Congratulations, Rong! >> >> On Thu, Jul 11, 2019 at

Re: [FLINK-10868] job cannot be exited immediately if job manager is timed out for some reason

2019-07-01 Thread Peter Huang
job in per job cluster or session cluster? To temporarily mitigate the issue you are facing, you probable can tune the heartbeat.timecout (default 50s) to a larger value. Best Regards Peter Huang On Mon, Jul 1, 2019 at 7:50 AM Till Rohrmann wrote: > Hi Anyang, > > as far as I can te

Re: Infinitely requesting for Yarn container in Flink 1.5

2019-03-30 Thread Peter Huang
Hi Qi, The current version of PR is runnable in production. But according to Till's suggestion, It needs one more round of change. Best Regards Peter Huang On Fri, Mar 29, 2019 at 3:42 PM Rong Rong wrote: > Hi Qi, > > I think the problem may be related to another similar problem

Re: Subscribe Mail list

2019-03-22 Thread Peter Huang
It is a mistake. Thank you :) On Fri, Mar 22, 2019 at 10:26 AM Pablo Estrada wrote: > Hi Peter, > You'll have to email user-subscr...@flink.apache.org to be able to > subscribe : ) > Best > -P. > > On Fri, Mar 22, 2019 at 10:22 AM Peter Huang > wrote: > >> >>

Subscribe Mail list

2019-03-22 Thread Peter Huang