implementations.
-Original Message-
From: Maximilian Michels
Sent: Monday, July 27, 2020 3:04 PM
To: user@beam.apache.org; Sunny, Mani Kolbe
Subject: Re: Unbounded sources unable to recover from checkpointMark when
withMaxReadTime() is used
CAUTION: This email originated from outside of D
: Monday, July 27, 2020 3:04 PM
To: user@beam.apache.org; Sunny, Mani Kolbe
Subject: Re: Unbounded sources unable to recover from checkpointMark when
withMaxReadTime() is used
CAUTION: This email originated from outside of D Please do not click links
or open attachments unless you recognize
Regards,
Mani
*From:* Alexey Romanenko
*Sent:* Tuesday, July 21, 2020 2:01 PM
*To:* user@beam.apache.org
*Subject:* Re: Unbounded sources unable to recover from checkpointMark
when withMaxReadTime() is used
*CAUTION:*This email originated from outside of D Please do not click
links or open
, July 21, 2020 2:01 PM
To: user@beam.apache.org
Subject: Re: Unbounded sources unable to recover from checkpointMark when
withMaxReadTime() is used
CAUTION: This email originated from outside of D Please do not click links
or open attachments unless you recognize the sender and know the content
ani Kolbe mailto:sun...@dnb.com>>
> Subject: Re: Unbounded sources unable to recover from checkpointMark when
> withMaxReadTime() is used
>
> CAUTION: This email originated from outside of D Please do not click links
> or open attachments unless you recognize the sende
, it will be reading entire stream
every time.
Regards,
Mani
-Original Message-
From: Maximilian Michels
Sent: Tuesday, July 21, 2020 11:38 AM
To: user@beam.apache.org
Cc: Sunny, Mani Kolbe
Subject: Re: Unbounded sources unable to recover from checkpointMark when
withMaxReadTime() is used
Hi Mani,
BoundedReadFromUnboundedSource was originally intended to be used in
batch pipelines. In batch, runners typically do not perform
checkpointing. In case of failures, they re-run the entire pipeline.
Keep in mind that, even with checkpointing, reading for a finite time in
the
