J-HowHuang opened a new pull request, #16624: URL: https://github.com/apache/pinot/pull/16624
## Description Current `ComplexTypeTranformer` keeps original values of all unnest fields (see https://github.com/apache/pinot/pull/13490). It introduced issue: https://github.com/apache/pinot/issues/15665, where resources were eaten up by keeping these original values. This PR adds a method ``` default void withInputColumnsOfDownStreamTransformers(Collection<String> inputColumnsOfDownstream) { } ``` in `org.apache.pinot.spi.recordtransformer.RecordTransformer` It provides hint to the transformer that which columns are required as input across all the downstream transformers in the `TransformPipeline`. In `ComplexTypeTranformer`, if a unnest field is not needed as input in any downstream transformer, we don't keep its original value. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
