Hey Flavio,
it's unlikely that the counters skip a record.
For the webUI these metrics are transported in 2 different ways:
For running tasks they are fetched through the metric system; this
provides no guarantee that the final count is ever displayed.
For finished tasks the final count is stored in the ExecutionGraph and
should show an accurate final count.
So, the question is in which state your task is.
Regards,
Chesnay
On 05.04.2017 09:55, Flavio Pompermaier wrote:
Hi to all,
I'm using Flink 1.2.0 and I have a job that (at some point) calls
dataset.first(1M).
Sometimes the records sent displayed by the UI are less than 1M (lik
999709).
Is it possible that the UI (or the internal Flink counters) miss some
record?
Best,
Flavio
--
Flavio Pompermaier
Development Department
OKKAM S.r.l.
Tel. +(39) 0461 1823908
