avamingli commented on PR #1571: URL: https://github.com/apache/cloudberry/pull/1571#issuecomment-3950034578
> Are the variables ParallelWorkerNumberOfSlice and TotalParallelWorkerNumberOfSlice stable and reliable under the current CBDB parallel framework? Yes, they are stable and reliable under the current CBDB parallel framework. But I'm not sure how you plan to use them. > During execution, the FDW calculates the virtual segment ID based on these two values, modifies the HTTP header sent to PXF, and allows PXF's round-robin sharding mechanism to automatically distribute data evenly among all gang workers. I'm not entirely sure I follow — isn't this essentially how MPP PXF works today? except `the virtual segment ID based on these two values` -- not sure, off the hand I think it's not enough, different Slice on same Segment could have same parallel workers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
