GitHub user Alena0704 added a comment to the discussion: [Ideas] Better parallel scans for AO and AOCS tables
This looks promising, especially for tables with a single large segment file. Could you explain how a worker reaches its assigned row chunk without an index or additional metadata? Does it retain its position and skip block headers, and can multiple workers end up reading or decompressing the same blocks? Could you also share the patch and benchmark setup—table size, compression, projected columns, worker count, and whether the data was cached? That would help assess the tradeoff between better balancing and extra scan work. GitHub link: https://github.com/apache/cloudberry/discussions/2186#discussioncomment-19193088 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
