Thank you for the feedback! *Re: opentelemetry-collector configuration* I will split the answer about potential changes in collector configuration needed to adopt the change in 3 parts.
1. Open telemetry collector can work with `gzip` compression or without it out of the box and this doesn't require any additional configuration. 2. Configuring batch size allows control payload of a single gRPC call. I would estimate the average payload contribution of a MetricData instance collected by OpenTelemetryMetricReporter[1] as 2-3Kb. Assuming batch size around 1000, max payload size[2] could be configured around 4MB with some contingency. 3. Open telemetry collector can be used to limit property values through transformations, however it is better to perform truncation in Flink to avoid submitting large payloads. This is especially important for attributes like "task_name" which can get very large with extensive operator chaining. I will include these details in the FLIP [1] https://github.com/apache/flink/blob/master/flink-metrics/flink-metrics-otel/src/main/java/org/apache/flink/metrics/otel/OpenTelemetryMetricReporter.java#L214 [2] https://github.com/open-telemetry/opentelemetry-collector/blob/c480657097695250c5c0b5117fb32c9d2bb5a039/receiver/otlpreceiver/config.md?plain=1#L26 Kind regards, Alex On Wed, 22 Oct 2025 at 12:56, Efrat Levitan <[email protected]> wrote: > Hey Aleksandr, > These are really necessary enhancements to the grpc exporter, > thank you for driving the proposal. > Perhaps you could elaborate on how the opentelemetry-collector[1] > should be configured to benefit from the improvements? > > Regards, > Efrat > > [1] https://github.com/open-telemetry/opentelemetry-collector > > On Wed, 22 Oct 2025 at 12:39, Rui Fan <[email protected]> wrote: > > > Thanks for driving this proposal! > > > > It looks like a good addition for OTel Reporter, +1 for this. > > > > Best, > > Rui > > > > On Tue, Oct 21, 2025 at 4:59 PM Piotr Nowojski <[email protected]> > > wrote: > > > > > Thanks for proposing this Aleksandr, I think it will be a good > > improvement. > > > > > > +1 > > > > > > best, > > > Piotrek > > > > > > czw., 16 paź 2025 o 16:59 Aleksandr Iushmanov <[email protected]> > > > napisał(a): > > > > > > > Hi All, > > > > > > > > I would like to start a discussion about FLIP 553: Robust OTel gRPC > > > metric > > > > exporter [1] > > > > > > > > Existing gRPC metric exporter is not sufficiently configurable to > > handle > > > > export of jobs with complex job graphs. Complicated jobs often result > > in > > > > significant request payload size and there could be more flexibility > to > > > > control it on the flink side. > > > > > > > > Looking forward to your feedback and suggestions. > > > > > > > > [1] > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-553%3A+Robust+OTel+gRPC+metric+exporter > > > > > > > > Kind regards, > > > > Aleksandr Iushmanov > > > > > > > > > >
