clintropolis commented on issue #16543: URL: https://github.com/apache/druid/issues/16543#issuecomment-2148490842
thanks for the report, this is a bug caused by an odd interaction between the underlying array column and unnest functionality when used with a string expression on the unnested value. The problem only occurs with string functions with a single input column, which internally tries to use a caching expression selector, which must be used with a dictionary encoded column. The underlying array column is actually dictionary encoded, but after unnesting it isn't really directly usable anymore (currently at least), but the column metadata is still marked as such, so the expression planning thinks it can use the caching selector because it thinks its dealing with a regular string column, resulting in this error. In the future i think unnest will be improved to take advantage of the underlying dictionary encoded nature of the array column, but for now I will probably make a simpler fix to just not take that code path (dictionary encoded selectors are for historical reasons pretty coupled with string types at the moment, so its a bit of effort to make that not be the case). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
