ege-st opened a new pull request, #11776: URL: https://github.com/apache/pinot/pull/11776
This PR updates the Realtime Segment Builder to remove an unnecessary and costly transformation: Pinot would transpose the column major table to a row major table and then transform it back to a column oriented table. This PR updates the segment builder to use column oriented entirely for the construction. This change improves the performance of segment building, especially for very wide tables. In order to minimize disruption and risk, this change is kept behind a table level configuration flag (`realtime.segment.flush.enable_column_major`), which is `false` by default. If this flag is `true` then the table's segments will be built with the column oriented process. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
