Hi Hang,
Thanks for reply.
I tried using SplitEnumeratorContext passed in
AbstractFileSource#createEnumerator but resulted as NullPointerException.
As SplitEnumeratorContext provides its implementation as
SourceCoordinatorContext having metricGroup() as below-
@Override
public SplitEnumeratorMetricGroup metricGroup() {
return null;
}
Am I doing any mistake?
Regards,
Kirti Dhar
From: Hang Ruan <[email protected]>
Sent: 06 June 2023 08:12
To: Kirti Dhar Upadhyay K <[email protected]>
Cc: [email protected]
Subject: Re: Custom Counter on Flink File Source
Hi, Kirti Dhar Upadhyay K.
We could get the metric group from the context, like `SourceReaderContext` and
`SplitEnumeratorContext`. These contexts could be found when creating readers
and enumerators. See `AbstractFileSource#createReader` and
`AbstractFileSource#createEnumerator`.
Best,
Hang
Kirti Dhar Upadhyay K via user
<[email protected]<mailto:[email protected]>> 于2023年6月5日周一 22:57写道:
Hi Community,
I am trying to add a new counter for number of files collected on Flink File
Source.
Referring the doc
https://nightlies.apache.org/flink/flink-docs-master/docs/ops/metrics/ I
understand how to add a new counter on any operator.
this.counter = getRuntimeContext().getMetricGroup().counter("myCounter");
But not able to get this RuntimeContext on FileSource.
Can someone give some clue on this?
Regards,
Kirti Dhar