Hi team,
We have a streaming job running with 1 JM + 4 TM in our k8s cluster.
Recently one of the TMs encountered some failure, and the job can't be
recovered from the lastest state from the checkpoint. From the log we found
something suspicious -
2022-01-21T13:38:41.296Z | FlinkStreamJob |
Hi team,
We're running flink jobs in application mode. Pre Flink 1.7, the job id by
default is ``. However, in Flink 1.11, we
found the job id is random. Is there a way to set job id or we can only
retrieve the job id by ourselves each time? Thanks.
- Li
Can I get any suggestion? Thanks a lot.
- Li
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi Team,
I have a Flink application reading from Kafka. Each payload is a request
sent by a user containing a list of queries. What I would like to do is use
Flink to process the queries parallelly and aggregate results and send back
to the user.
For example, let's say we have two messages in
m the second input which
> arrive between the checkpoint barrier on the first input and the
> corresponding barrier on the second input. We might change this
> implementation in the future, though.
>
> Cheers,
> Till
>
>> On Tue, Nov 1, 2016 at 8:05 AM, Li Wang <
Hi all,
I have a question regarding to the state checkpoint mechanism in Flink. I find
the statement "Once the last stream has received barrier n, the operator emits
all pending outgoing records, and then emits snapshot n barriers itself” on the
document
s a copy of the snapshot state that’s
> checkpointed.
>
> Regards,
> Gordon
>
>
> On October 17, 2016 at 10:28:34 AM, Li Wang (wangli1...@gmail.com
> <mailto:wangli1...@gmail.com>) wrote:
>
>> Hi All,
>>
>> Any feedback is highly appreciated
Hi all,
As far as I know, a stateful operator will checkpoint its current state to a
persistent storage when it receives all the barrier from all of its upstream
operators. My question is that does the operator doing the checkpoint need to
pause processing the input tuples for the next batch
