clintropolis commented on PR #18176: URL: https://github.com/apache/druid/pull/18176#issuecomment-3076053864
>@clintropolis - how do segment metadata queries work that touch lots of segments and are system-generated? We wouldn't want to fetch all the segments to build sql schema on broker. Yea, there is a bit of ugly special handling for segment metadata queries right now https://github.com/apache/druid/pull/18176/files#diff-3d43c1b27316a889f58c28a3373b157f38f633d40d6ab4495d350dece7ce7a44R293 that doesn't allow it to download segments for this reason. This means that to use SQL you currently either need a non-virtual tier, or if only using a virtual storage mode tier then either the catalog or centralized schema stuff must be relied on to supply the SQL schema. In the future, I have some segment format changes in mind to support partial downloads that would also allow us to have the schema available without downloading the whole segment, so I think this can be a temporary problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
