kirankumarkathe...@gmail.com-unsubscribe
Kindly un subscribe for this gmail account kirankumarkathe...@gmail.com
Unsubscribe
Re: unsubscribe
Hi, Ralph, Please send an email to user-unsubscr...@flink.apache.org to unsubscribe the user mailing list. [1] [1] https://flink.apache.org/what-is-flink/community/ Best, Yuxin Ralph Matthias Debusmann 于2023年11月15日周三 06:18写道： > >
Re: unsubscribe
Hi, Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org. Ralph Matthias Debusmann 于2023年11月15日周三 07:29写道： > >
unsubscribe
Re: Unsubscribe from user list.
Hi, Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. Best, Hang [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists bharghavi vajrala 于2023年10月21日周六 19:03写道： > Team, > > Please unsubscribe my email id. > > On Thu, Oct 19, 2023 at 6:25 AM jihe18717838093 <18717838...@126.com> > wrote: > >> Hi team, >> >> >> >> Could you please remove this email from the subscription list? >> >> >> >> Thank you! >> >> >> >> Best, >> >> Minglei >> >
Re: Unsubscribe from user list.
Team, Please unsubscribe my email id. On Thu, Oct 19, 2023 at 6:25 AM jihe18717838093 <18717838...@126.com> wrote: > Hi team, > > > > Could you please remove this email from the subscription list? > > > > Thank you! > > > > Best, > > Minglei >
Re: Unsubscribe from user list.
Hi Lijuan, Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org. Best, Zakelly On Thu, Oct 19, 2023 at 6:23 AM Hou, Lijuan via user wrote: > > Hi team, > > > > Could you please remove this email from the subscription list? I have another > email (juliehou...@gmail.com) subscribed as well. I can use that email to > receive flink emails. > > > > Thank you! > > > > Best, > > Lijuan
Unsubscribe from user list.
Hi team, Could you please remove this email from the subscription list? Thank you! Best, Minglei
Unsubscribe from user list.
Hi team, Could you please remove this email from the subscription list? I have another email (juliehou...@gmail.com) subscribed as well. I can use that email to receive flink emails. Thank you! Best, Lijuan
Re: Unsubscribe
Hi, Please send an email to user-unsubscr...@flink.apache.org in order to be removed from the User mailing list. Best, Ron yunchao li 于2023年7月17日周一 09:14写道： > Unsubscribe -- > >>
Re: Unsubscribe
Hi, wang Please send an email to user-unsubscr...@flink.apache.org in order to be removed from the User mailing list. Best, Ron wang <24248...@163.com> 于2023年7月17日周一 23:10写道： > Unsubscribe >
Re: Unsubscribe
Hi, William Please send an email to user-unsubscr...@flink.apache.org in order to be removed from the User mailing list. Best, Ron William Wang 于2023年7月17日周一 14:59写道： > >
Re: Unsubscribe
Hi, Please send an email to user-unsubscr...@flink.apache.org in order to be removed from the User mailing list. Best regards, Martijn On Wed, Jul 26, 2023 at 3:44 AM Lu Weizheng wrote: > Unsubscribe >
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe
Re: Unsubscribe
Unsubscribe -- >
Unsubscribe
Unsubscribe--
Unsubscribe
Unsubscribe
Re: Unsubscribe
Hi, As Hang say, please send an email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, Best, Ron Ragini Manjaiah 于2023年7月5日周三 13:36写道： > Unsubscribe > > On Tue, Jul 4, 2023 at 1:33 PM Bauddhik Anand wrote: > >> Unsubscribe >> >
Re: Unsubscribe
Unsubscribe On Tue, Jul 4, 2023 at 1:33 PM Bauddhik Anand wrote: > Unsubscribe >
Re: Unsubscribe
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists Ajinkya Pathrudkar 于2023年7月4日周二 20:22写道： > Unsubscribe -- > Thanks & Regards, > Ajinkya Pathrudkar >
Re: Unsubscribe
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists tan yao 于2023年7月4日周二 15:51写道： > Unsubscribe > > 获取 Outlook for iOS <https://aka.ms/o0ukef> >
Re: Unsubscribe
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists Victor Villa Dev 于2023年7月5日周三 07:15写道： >
Re: Unsubscribe
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists liyuhang 于2023年7月5日周三 10:51写道： > Unsubscribe > >
Re: Unsubscribe
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists Bauddhik Anand 于2023年7月4日周二 16:02写道： > Unsubscribe >
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe -- Thanks & Regards, Ajinkya Pathrudkar
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe 获取 Outlook for iOS<https://aka.ms/o0ukef>
Re: Unsubscribe
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists 于2023年6月23日周五 14:18写道： >
Unsubscribe
Unsubscribe
Re: Unsubscribe
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Leonard [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-lists > On Jun 15, 2023, at 10:40 AM, yanglele via user wrote: > > > > Unsubscribe > > > > > > > > > - 原始邮件 - > > > > 发件人：Robin Cassan via user > > 发送时间：2023-06-14 23:13:09 > > 收件人：Gyula Fóra > > 抄送：user > > 主 题：Re: Kubernetes operator: config for taskmanager.memory.process.size > ignored > > Thanks again, maybe the jvm overhead param will act as the margin I want, > I'll try that :) > Robin > > > Le mer. 14 juin 2023 à 15:28, Gyula Fóra <mailto:gyula.f...@gmail.com>> a écrit : > Again, this has absolutely nothing to do with the Kubernetes Operator, but > simply how Flink Kubernetes Memory configs work: > https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/memory/mem_tuning/#configure-memory-for-containers > > <https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/memory/mem_tuning/#configure-memory-for-containers> > > > > You can probably play around with: jobmanager.memory.jvm-overhead.fraction > > > You can set a larger memory size in the TM spec and increase the jvm overhead > fraction. > > > Gyula > > > On Wed, Jun 14, 2023 at 2:46 PM Robin Cassan <mailto:robin.cas...@contentsquare.com>> wrote: > > Thanks Gyula for your answer! I'm wondering about your claim: > > In Flink kubernetes the process is the pod so pod memory is always > equal to process memory > Why should the flink TM process use the whole container (and so, the whole > pod) memory? > > > Before migrating to the k8s operator, we still used Flink on kubernetes > (without the operator) and left a little bit of margin between the process > memory and the pod memory, which helped stability. It looks like it cannot be > done with the k8s operator though and I wonder why the choice of removing > this granularity in the settings > > > Robin > > > Le mer. 14 juin 2023 à 12:20, Gyula Fóra <mailto:gyula.f...@gmail.com>> a écrit : > > Basically what happens is that whatever you set to the > spec.taskManager.resource.memory will be set in the config as process memory. > In Flink kubernetes the process is the pod so pod memory is always equal to > process memory. > > > So basically the spec is a config shorthand, there is no reason to override > it as you won't get a different behaviour at the end of the day. > > > Gyula > > > On Wed, Jun 14, 2023 at 11:55 AM Robin Cassan via user <mailto:user@flink.apache.org>> wrote: > > Hello all! > > > I am using the flink kubernetes operator and I would like to set the value > for `taskmanager.memory.process.size`. I set the desired value in the > flinkdeployment resource specs (here, I want 55gb), however it looks like the > value that is effectively passed to the taskmanager is the same as the pod > memory setting (which is set to 59gb). > > > For example, this flinkdeployment configuration: > > ``` > Spec: > Flink Configuration: > > taskmanager.memory.process.size: 55gb > > Task Manager: >Resource: > Cpu: 6 > Memory: 59Gb > > ``` > will create a pod with 59Gb total memory (as expected) but will also give > 59Gb to the memory.process.size instead of 55Gb, as seen in this TM log: > `Loading configuration property: taskmanager.memory.process.size, 59Gb` > > > Maybe this part of the flink k8s operator code is responsible: > > https://github.com/apache/flink-kubernetes-operator/blob/d43e1ca9050e83b492b2e16b0220afdba4ffa646/flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/config/FlinkConfigBuilder.java#L393 > > <https://github.com/apache/flink-kubernetes-operator/blob/d43e1ca9050e83b492b2e16b0220afdba4ffa646/flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/config/FlinkConfigBuilder.java#L393> > > > > If so, I wonder what is the rationale for forcing the flink process memory to > be the same as the pod memory? >Is there a way to bypass that, for example by setting the desired > process.memory configuration differently? > > > Thanks! > > > > <https://a.app.qq.com/o/simple.jsp?pkgname=com.sohu.mail.client.cordova> > >
Unsubscribe
Unsubscribe- 原始邮件 -发件人：Robin Cassan via user发送时间：2023-06-14 23:13:09收件人：Gyula Fóra抄送：user主 题：Re: Kubernetes operator: config for taskmanager.memory.process.size ignoredThanks again, maybe the jvm overhead param will act as the margin I want, I'll try that :)RobinLe mer. 14 juin 2023 à 15:28, Gyula Fóra <gyula.f...@gmail.com> a écrit :Again, this has absolutely nothing to do with the Kubernetes Operator, but simply how Flink Kubernetes Memory configs work:https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/memory/mem_tuning/#configure-memory-for-containers You can probably play around with: jobmanager.memory.jvm-overhead.fraction You can set a larger memory size in the TM spec and increase the jvm overhead fraction. Gyula On Wed, Jun 14, 2023 at 2:46 PM Robin Cassan <robin.cas...@contentsquare.com> wrote: Thanks Gyula for your answer! I'm wondering about your claim: > In Flink kubernetes the process is the pod so pod memory is always equal to process memoryWhy should the flink TM process use the whole container (and so, the whole pod) memory? Before migrating to the k8s operator, we still used Flink on kubernetes (without the operator) and left a little bit of margin between the process memory and the pod memory, which helped stability. It looks like it cannot be done with the k8s operator though and I wonder why the choice of removing this granularity in the settings Robin Le mer. 14 juin 2023 à 12:20, Gyula Fóra <gyula.f...@gmail.com> a écrit : Basically what happens is that whatever you set to the spec.taskManager.resource.memory will be set in the config as process memory.In Flink kubernetes the process is the pod so pod memory is always equal to process memory. So basically the spec is a config shorthand, there is no reason to override it as you won't get a different behaviour at the end of the day. Gyula On Wed, Jun 14, 2023 at 11:55 AM Robin Cassan via user <user@flink.apache.org> wrote: Hello all! I am using the flink kubernetes operator and I would like to set the value for `taskmanager.memory.process.size`. I set the desired value in the flinkdeployment resource specs (here, I want 55gb), however it looks like the value that is effectively passed to the taskmanager is the same as the pod memory setting (which is set to 59gb). For example, this flinkdeployment configuration: ```Spec: Flink Configuration: taskmanager.memory.process.size: 55gb Task Manager: Resource: Cpu: 6 Memory: 59Gb ```will create a pod with 59Gb total memory (as expected) but will also give 59Gb to the memory.process.size instead of 55Gb, as seen in this TM log: `Loading configuration property: taskmanager.memory.process.size, 59Gb` Maybe this part of the flink k8s operator code is responsible: https://github.com/apache/flink-kubernetes-operator/blob/d43e1ca9050e83b492b2e16b0220afdba4ffa646/flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/config/FlinkConfigBuilder.java#L393 If so, I wonder what is the rationale for forcing the flink process memory to be the same as the pod memory? Is there a way to bypass that, for example by setting the desired process.memory configuration differently? Thanks!
Unsubscribe
Unsubscribe- 原始邮件 -发件人：Lu Niu发送时间：2023-06-15 07:26:34收件人：Teoh, Hong抄送：d...@flink.apache.org;user主 题：Re: AsyncFunction vs Async SinkThanks, Hong!I understand that if the user case is to simply write sth to an external service, Async Sink is a good option that provides features like batching, state management and rate limiting. I have some follow up questions:1. Is there any problem if we use Async Function for such a user case? We can simply drop the output and use Unordered mode.2. For AsyncFunction and Async Sink. does it make sense that both could share the same underlying implementation and the features like batching and rate limiting can benefit both?BestLu On Wed, Jun 14, 2023 at 2:20 PM Teoh, Hong <lian...@amazon.co.uk> wrote:Hi Lu, Thanks for your question. See below for my understanding. I would recommend using the Async Sink if you are writing to the external service as the final output of your job graph, and if you don’t have the ordered requirement that updates to the external system must be done before updates to some other external system within the same job graph. (More explained later). The abstraction of the Async Sink is a sink, meaning it is a terminal operator in the job graph. The abstraction is intended to simplify the writing of a sink - meaning the base implementation will handle batching, state management and rate limiting. You only need to provide the client and request structure to be used to interact with the external service. This makes writing and maintaining the sink easier (if you simply want to write to a destination with at least once processing). The AsyncFunction, as I understand it is more used for data enrichment, and is not a terminal operator in the job graph. This means the return value from the external service will continue to be passed on down the Flink Job graph. This is useful for data enrichment using the external service, or if we want to ensure the system being called in the AsyncFunction is updated BEFORE any data is written to the sinks further down the job graph. For example: Kinesis Source -> Map -> AsyncFunction (Updates DynamoDB) -> Kinesis Sink We can be sure that the updates to DynamoDB for a particular record happens before the record is written to the Kinesis Sink. Hope the above clarifies your question! Regards,Hong On 14 Jun 2023, at 19:27, Lu Niu <qqib...@gmail.com> wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Hi, Flink dev and usersIf I want to async write to an external service, which API shall I use, AsyncFunction or Async Sink?My understanding after checking the code are:Both APIs guarantee at least once write to external service. As both API internally stores in-flight requests in the checkpoint.Async Sink provides a batching request feature. This can be implemented with Map + AsyncFunction. Map function groups requests in batches and pass it to AsyncFunction.The batching implementation can refer to AbstractMapBundleOperator if don’t want to use state.Async Sink supports retry on failed requests. AsyncFunction also supports retry in latest flink version.Async Sink supports rate limiting, AsyncFunction doesn’t.AsyncFunction can be used to implement read-update-write. Async Sink cannot.BestLu
Re: Unsubscribe
Please send an email to user-unsubscr...@flink.apache.org to unsubscribe Best, Hang Yu voidy 于2023年6月12日周一 11:39写道： > >
Unsubscribe
Re: Unsubscribe
Hi, please send an email to user-unsubscr...@flink.apache.org to unsubscribe . Best, Hang laxmi narayan 于2023年3月21日周二 15:26写道： > Unsubscribe -- > Hi , > > > > Thank you. >
Unsubscribe
Unsubscribe -- Hi , Thank you.
Re: unsubscribe
Hi, please send an email to user-unsubscr...@flink.apache.org to unsubscribe. Best, Yuxin Xiangyu Su via user 于2023年3月3日周五 17:29写道： > >
unsubscribe
Re: Unsubscribe
Please send an email to user-unsubscr...@flink.apache.org to unsubscribe Best, Shammon On Wed, Mar 1, 2023 at 5:52 AM Gg Kudelska wrote: > Unsubscribe > > wt., 28 lut 2023, 17:45 użytkownik Reme Ajayi > napisał: > >> Unsubscribe > >
Unsubscribe
Unsubscribe wt., 28 lut 2023, 17:45 użytkownik Reme Ajayi napisał: > Unsubscribe
Unsubscribe
Unsubscribe
Re: unsubscribe
Hi, please send to user-unsubscr...@flink.apache.org if you want to unsubscribe user mail list. Best, Hang zhangjunjie 于2023年2月28日周二 00:11写道： > unsubscribe > > >
Re: unsubscribe
To unsubscribe, please send an email to user-unsubscr...@flink.apache.org Best regards, Weijie Natia Chachkhiani 于2023年2月28日周二 01:21写道： >
unsubscribe
unsubscribe
unsubscribe
unsubscribe
unsubscribe -- Thanks & Regards Sandeep Sharat Kumar
Re: Unsubscribe
Hi. To unsubscribe, you should send email to user-unsubscr...@flink.apache.org with any contents or subject. Please see more in the Flink Doc[1] [1] https://flink.apache.org/community.html#how-to-subscribe-to-a-mailing-list Best regards, Yuxia 发件人: "liang ji" 收件人: "User" 发送时间: 星期三, 2023年 2 月 08日 下午 2:10:03 主题: Unsubscribe
Unsubscribe
Re: Unsubscribe
Hi, All. To unsubscribe, you can send email to user-unsubscr...@flink.apache.org with any contents or subject. Please see more in the Flink Doc[1] [1] https://flink.apache.org/community.html#how-to-subscribe-to-a-mailing-list Best regards, Yuxia 发件人: "Ragini Manjaiah" 收件人: "Soumen Choudhury" 抄送: "User" 发送时间: 星期三, 2023年 2 月 08日 上午 11:06:30 主题: Re: Unsubscribe Hi Soumen, I want to unsubscribe from this mailing list. Thanks & Regards Ragini Manjaiah On Fri, Feb 3, 2023 at 4:07 PM Soumen Choudhury < [ mailto:sou@gmail.com | sou@gmail.com ] > wrote: -- Regards Soumen Choudhury Cell : +91865316168 mail to : [ mailto:sou@gmail.com | sou@gmail.com ]
Re: Unsubscribe
Hi Soumen, I want to unsubscribe from this mailing list. Thanks & Regards Ragini Manjaiah On Fri, Feb 3, 2023 at 4:07 PM Soumen Choudhury wrote: > > > -- > Regards > Soumen Choudhury > Cell : +91865316168 > mail to : sou@gmail.com >
Unsubscribe
-- Regards Soumen Choudhury Cell : +91865316168 mail to : sou@gmail.com
Re: unsubscribe
Please email user-unsubscr...@flink.apache.org as described here: https://flink.apache.org/community.html On Sun, Jan 15, 2023 at 4:31 AM Saver Chia wrote: > unsubscribe >
Re: unsubscribe
Please email user-unsubscr...@flink.apache.org as describe here: https://flink.apache.org/community.html On Sun, Jan 15, 2023 at 8:55 AM jay green wrote: > unsubscribe >
unsubscribe
unsubscribe
unsubscribe
unsubscribe
Re: unsubscribe
Hi, You'll need to send an email to user-unsubscr...@flink.apache.org to unsubscribe yourself. Best Regards, Martijn On Sun, Dec 11, 2022 at 5:50 AM Saver Chia wrote: > unsubscribe >
Re: unsubscribe
Hi, You'll need to send an email to user-unsubscr...@flink.apache.org to unsubscribe yourself. Best Regards, Martijn On Sun, Dec 11, 2022 at 4:22 AM ganlute wrote: > unsubscribe >
Re: unsubscribe
To unsubscribe, you should send an email to user-unsubscr...@flink.apache.org, which has been documented in Flink offical website[1]. [1] https://flink.apache.org/community.html#mailing-lists Best regards, Yuxia 发件人: "Ayush" 收件人: "User" 发送时间: 星期日, 2022年 12 月 11日 下午 9:41:02 主题: unsubscribe unsubscribe
unsubscribe
unsubscribe
unsubscribe
unsubscribe
unsubscribe
unsubscribe
Unsubscribe
Unsubscribe
unsubscribe
unsubscribe jester_jim jester_...@sina.com 签名由 网易邮箱大师 定制
unsubscribe
Re: unsubscribe
Hi, To remove your address from the list, send a message to: On Sun, 21 Aug 2022 at 9:55 PM, Venkatesh kalyan wrote: > want to unsubscribe . >
Re: unsubscribe
Hi，To remove your address from the list, send a message to: On Mon, 22 Aug 2022 at 4:08 PM, Sijun Yang wrote: >
Re: unsubscribe
Hi， To remove your address from the list, send a message to: On Mon, 22 Aug 2022 at 1:42 PM, Alex Drobinsky wrote: > Please unsubscribe me >
unsubscribe
Please unsubscribe me
unsubscribe
want to unsubscribe .
Re: unsubscribe
Hi, you can send any content to user-unsubscr...@flink.apache.org to unsubscribe. Best Regards Yuxin Alex Drobinsky 于2022年7月17日周日 14:23写道： > >
Re: 退订/unsubscribe
退订请发送任意消息至user-unsubscr...@flink.apache.org In order to unsubscribe, please send an email to user-unsubscr...@flink.apache.org Thanks Best regards, Jing From: liangzai Date: Sun, Jun 19, 2022 at 4:37 AM Subject: Re: New KafkaSource API: Change in default behavior regarding starting offset To: bastien dine Cc: Martijn Visser , Jing Ge , user 请问这个邮件咋退订？ Replied Message >From bastien dine Date 06/15/2022 17:50 To Martijn Visser Cc Jing Ge , user Subject Re: New KafkaSource API : Change in default behavior regarding starting offset Hello Martijn, Thanks for the link to the release note, especially : "When resuming from the savepoint, please use setStartingOffsets(OffsetsInitializer.committedOffsets()) in the new KafkaSourceBuilder to transfer the offsets to the new source." So earliest is the new default We use for sure .committedOffsets - we have it by default in our custom KafkaSource builder to be sure we do not read all the previous data (earliest) What bother me is just this change in starting offset default behavior from FlinkKafkaConsumer to KafkaSource (this can lead to mistake) In fact it happens that we drop some of our kafka source state to read again from kafka committed offset, but maybe nodoby does that ^^ Anyway thanks for the focus on the release note ! Best Regards, -- Bastien DINE Data Architect / Software Engineer / Sysadmin bastiendine.io Le mer. 15 juin 2022 à 10:58, Martijn Visser a écrit : > Hi Bastien, > > When the FlinkKafkaConsumer was deprecated in 1.14.0, the release notes > included the instruction how to migrate from FlinkKafkaConsumer to > KafkaConsumer [1]. Looking at the Kafka documentation [2], there is a > section on how to upgrade to the latest connector version that I think is > outdated. I'm leaning towards copying the migration instructions to the > generic documentation. Do you think that would have sufficed? > > Best regards, > > Martijn > > [1] > https://nightlies.apache.org/flink/flink-docs-master/release-notes/flink-1.14/#deprecate-flinkkafkaconsumer > [2] > https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kafka/#upgrading-to-the-latest-connector-version > > Op wo 15 jun. 2022 om 09:22 schreef bastien dine : > >> Hello jing, >> >> This was the previous method in old Kafka consumer API, it has been >> removed in 1.15, so source code is not in master anymore, >> Yes I know for the new Offset initializer, committed offset + earliest as >> fallback can be used to have the same behavior as before >> I just wanted to know whether this is a changed behavior or I am missing >> something >> >> >> >> Bastien DINE >> Freelance >> Data Architect / Software Engineer / Sysadmin >> http://bastiendine.io >> >> >> >> Le mar. 14 juin 2022 à 23:08, Jing Ge a écrit : >> >>> Hi Bastien, >>> >>> Thanks for asking. I didn't find any call of setStartFromGroupOffsets() >>> within >>> Flink in the master branch. Could you please point out the code that >>> committed offset is used as default? >>> >>> W.r.t. the new KafkaSource, if OffsetsInitializer.committedOffsets() >>> is used, an exception will be thrown at runtime in case there is no >>> committed offset, which is useful if the user is intended to read from the >>> committed offset but something is wrong. It might feel weird if it is used >>> as default, because an exception will be thrown when users start new jobs >>> with default settings. >>> >>> Best regards, >>> Jing >>> >>> On Tue, Jun 14, 2022 at 4:15 PM bastien dine >>> wrote: >>> >>>> Hello everyone, >>>> >>>> Does someone know why the starting offset behaviour has changed in the >>>> new Kafka Source ? >>>> >>>> This is now from earliest (code in KafkaSourceBuilder), doc says : >>>> "If offsets initializer is not specified, OffsetsInitializer.earliest() >>>> will >>>> be used by default." from : >>>> https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kafka/#starting-offset >>>> >>>> Before in old FlinkKafkaConsumer it was from committed offset (i.e : >>>> setStartFromGroupOffsets() >>>> method) >>>> >>>> which match with this behaviour in new KafkaSource : : >>>> OffsetsInitializer.committedOffsets(OffsetResetStrategy.EARLIEST >>>> >>>> This change can lead to big troubles if user pay no attention to this >>>> point when migrating from old KafkaConsumer to new KafkaSource, >>>> >>>> Regards, >>>> Bastien >>>> >>>> -- >>>> >>>> Bastien DINE >>>> Data Architect / Software Engineer / Sysadmin >>>> bastiendine.io >>>> >>>
Re: Unsubscribe
Hi, In order to unsubscribe, please send an email to user-unsubscr...@flink.apache.org Best regards, Martijn Op vr 10 jun. 2022 om 17:23 schreef : > Unsubscribe >
Re: Unsubscribe
Hi, In order to unsubscribe, please send an email to user-unsubscr...@flink.apache.org Best regards, Martijn Op za 11 jun. 2022 om 19:46 schreef tarun joshi <1985.ta...@gmail.com>: > Unsubscribe >
Re: unsubscribe; 退订
你好， 退订请发送任意消息至 user-zh-unsubscr...@flink.apache.org。 Best, Zhanghao Chen From: chenshu...@foxmail.com Sent: Sunday, June 12, 2022 11:44 To: user-zh Subject: unsubscribe; 退订 unsubscribe 退订 chenshu...@foxmail.com
unsubscribe; 退订
unsubscribe 退订 chenshu...@foxmail.com
unsubscribe
unsubscribe 退订 chenshu...@foxmail.com
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe
Unsubscribe
Re: unsubscribe
I did this, but I am still getting emails from the flink user group. On Wed, May 11, 2022 at 6:30 PM yuxia wrote: > To unsubscribe, you can send email to user-unsubscr...@flink.apache.org > with any object. > > Best regards, > Yuxia > > -- > *发件人: *"Henry Cai" > *收件人: *"User" > *发送时间: *星期四, 2022年 5 月 12日 上午 1:14:43 > *主题: *unsubscribe > > unsubscribe > >
Re: unsubscribe
To unsubscribe, you can send email to user-unsubscr...@flink.apache.org with any object. Best regards, Yuxia 发件人: "Henry Cai" 收件人: "User" 发送时间: 星期四, 2022年 5 月 12日 上午 1:14:43 主题: unsubscribe unsubscribe
unsubscribe
unsubscribe
Re: confirm unsubscribe from user-zh@flink.apache.org
user-zh-uc.1651815931.fkdjmabebcamkifpifpd-zhaoy=greatld@flink.apache.org zh...@greatld.com From: user-zh-help Date: 2022-05-06 13:45 To: zhaoy Subject: confirm unsubscribe from user-zh@flink.apache.org Hi! This is the ezmlm program. I'm managing the user-zh@flink.apache.org mailing list. I'm working for my owner, who can be reached at user-zh-ow...@flink.apache.org. To confirm that you would like zh...@greatld.com removed from the user-zh mailing list, please send a short reply to this address: user-zh-uc.1651815931.fkdjmabebcamkifpifpd-zhaoy=greatld@flink.apache.org Usually, this happens when you just hit the "reply" button. If this does not work, simply copy the address and paste it into the "To:" field of a new message. or click here: mailto:user-zh-uc.1651815931.fkdjmabebcamkifpifpd-zhaoy=greatld@flink.apache.org I haven't checked whether your address is currently on the mailing list. To see what address you used to subscribe, look at the messages you are receiving from the mailing list. Each message has your address hidden inside its return path; for example, m...@xdd.ff.com receives messages with return path: -mary=xdd.ff@flink.apache.org. Some mail programs are broken and cannot handle long addresses. If you cannot reply to this request, instead send a message to and put the entire address listed above into the "Subject:" line. --- Administrative commands for the user-zh list --- I can handle administrative requests automatically. Please do not send them to the list address! Instead, send your message to the correct command address: To subscribe to the list, send a message to: To remove your address from the list, send a message to: Send mail to the following for info and FAQ for this list: Similar addresses exist for the digest list: To get messages 123 through 145 (a maximum of 100 per request), mail: To get an index with subject and author for messages 123-456 , mail: They are always returned as sets of 100, max 2000 per request, so you'll actually get 100-499. To receive all messages with the same subject as message 12345, send a short message to: The messages should contain one line or word of text to avoid being treated as sp@m, but I will ignore their content. Only the ADDRESS you send to is important. You can start a subscription for an alternate address, for example "john@host.domain", just add a hyphen and your address (with '=' instead of '@') after the command word: To stop subscription for this address, mail: In both cases, I'll send a confirmation message to that address. When you receive it, simply reply to it to complete your subscription. If despite following these instructions, you do not get the desired results, please contact my owner at user-zh-ow...@flink.apache.org. Please be patient, my owner is a lot slower than I am ;-) --- Enclosed is a copy of the request I received. Return-Path: Received: (qmail 76884 invoked by uid 99); 6 May 2022 05:45:31 - Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org) (95.217.134.168) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 May 2022 05:45:31 + Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org) with ESMTP id EC510C0373 for ; Fri, 6 May 2022 05:45:30 + (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org X-Spam-Flag: NO X-Spam-Score: 0.2 X-Spam-Level: X-Spam-Status: No, score=0.2 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=0.2, SPF_PASS=-0.001, UNPARSEABLE_RELAY=0.001] autolearn=disabled Received: from mx1-ec2-va.apache.org ([116.203.227.195]) by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new, port 10024) with ESMTP id yO6UpNeB6ORe for ; Fri, 6 May 2022 05:45:26 + (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=115.124.28.195; helo=out28-195.mail.aliyun.com; envelope-from=zh...@greatld.com; receiver= Received: from out28-195.mail.aliyun.com (out28-195.mail.aliyun.com [115.124.28.195]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 699BEBB91B for ; Fri, 6 May 2022 05:45:24 + (UTC) X-Alimail-AntiSpam:AC=CONTINUE;BC=0.4954692|-1;CH=green;DM=|CONTINUE|false|;DS=CONTINUE|ham_enroll_verification|0.104371-0.141241-0.754388;FP=0|0|0|0|0|-1|-1|-1;HT=ay29a033018047198;MF=zh...@greatld.com;NM=1;PH=DS;RN=1;RT=1;SR=0;TI=SMTPD_---.NeUj7dV_1651815916; Received: from DESKTOP-66K4SEM(mailfrom:zh...@greatld.com fp:SMTPD_---.NeUj7dV_1651815916) by smtp.aliyun-inc.com(33.13.245.115); Fri, 06 May 2022 13:45:16 +0800 Date: Fri, 6 May 2022 13:45:16 +0800 From: "zh...@greatld.com" To: user-zh-unsubscribe Subject: =?UTF-8?B?6YCA6K6i?= References: , X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7.2.23.121[cn] Mime-Version:
Re: Unsubscribe
Hi, In order to unsubscribe, please send an email to user-unsubscr...@flink.apache.org as documented on the Flink community page [1]. Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser [1] https://flink.apache.org/community.html On Thu, 5 May 2022 at 08:44, Henry Cai wrote: > unsubscribe > > On Wed, May 4, 2022 at 4:27 AM Nishant Gupta > wrote: > >> Unsubscribe >> >
Re: Unsubscribe
unsubscribe On Wed, May 4, 2022 at 4:27 AM Nishant Gupta wrote: > Unsubscribe >
Unsubscribe
Unsubscribe
Re: Unsubscribe
To unsubscribe you need to send a mail to user-unsubscr...@flink.apache.org <mailto:user-unsubscr...@flink.apache.org>. > 2022年4月27日 下午12:03，Amit Bhatia 写道： > > Unsubscribe > > Regards, > Amit Bhatia
Re: Unsubscribe
To unsubscribe you need to send a mail to user-unsubscr...@flink.apache.org <mailto:user-unsubscr...@flink.apache.org>. > 2022年4月28日 下午6:45，bhawana gupta 写道： > > Unsubscribe > > Regards, > Bhawana
Unsubscribe
Unsubscribe Regards, Bhawana
Unsubscribe
Unsubscribe Regards, Amit Bhatia
Unsubscribe
Unsubscribe
Re: Unsubscribe
To unsubscribe you need to send a mail to user-unsubscr...@flink.apache.org.
