Flink - problem with removing checkpoint _metadata from google cloud storage when encrypting

2023-10-03 Thread Simon
Hi, I deploy flink job in Google Kubernetes Engine(GKE) with enabled checkpointing on google cloud storage (GS). I configure GS filesystem with configuration described here https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/deployment/filesystems/gcs/ I also want to encrypt data

Re: Flink problem

2021-02-19 Thread Guanghui Zhang
Can you tell what to do when the record is reported again by userId:001 within 10 minutes, for example buffer it or keep the only one ? ゞ野蠻遊戲χ 于2021年2月19日周五 下午7:35写道: > hi all > > For example, if A user message A (uerId: 001) is reported, and no > record is reported again by userId: 001 wit

Re: Flink problem

2021-02-19 Thread Xintong Song
What you're looking for might be Session Window[1]. Thank you~ Xintong Song [1] https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/stream/operators/windows.html#session-windows On Fri, Feb 19, 2021 at 7:35 PM ゞ野蠻遊戲χ wrote: > hi all > > For example, if A user message A (uer

Flink problem

2021-02-19 Thread ゞ野蠻遊戲χ
hi all      For example, if A user message A (uerId: 001) is reported, and no record is reported again by userId: 001 within 10 minutes, record A will be sent out. How can this be achieved in Flink? Thanks Jiazhi 发自我的iPhone