npawar commented on issue #8604: URL: https://github.com/apache/pinot/issues/8604#issuecomment-1125569145
@saumya2700 You don't need to add the transform configs for every field. As i've pasted in my message above, all you need to do is remove the non-array fields from the fieldsToUnnest. Regarding the transform functions you're trying out, it will not work for the existing rows, because those rows don't have any way of knowing what "header" is. That information was only in the source data. To make it work in a backward compatible manner, you'll have to provide a "defaultValue" to the JSONPATHSTRING function as, JSONPATHSTRING(header, '$.trId', '<default value>'). It would be best to 1) try with the complex config or 2) reingest the data -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
