taiyang-li opened a new pull request, #12587: URL: https://github.com/apache/gluten/pull/12587
### Background One of a small series of common-code changes to introduce a new backend — **Bolt** (ByteDance’s unified lakehouse analytics acceleration engine) — into the Gluten community. The series minimizes the delta to Gluten common code so Bolt can plug in cleanly, while leaving Velox and ClickHouse backends unaffected. It is part of plan in https://github.com/apache/gluten/issues/12456, close https://github.com/apache/gluten/issues/12462 ### This PR Refactor the anonymous `map` inside `ShuffledColumnarBatchRDD.compute` into a named class `ShuffleReaderWithMetricsIterator` that exposes the underlying shuffle-read iterator via a public `delegate` field. Per-batch semantics are preserved: for every batch we still call `SQLColumnarShuffleReadMetricsReporter.incBatchesRecordsRead(numRows)` and return the batch. The Bolt backend needs to unwrap the underlying `Iterator[Product2[Int, ColumnarBatch]]` for additional post-processing after the shuffle read. Giving the wrapper a stable name and a `delegate` accessor lets that be done without duplicating the entire `compute()` path. ** Note: the same patch I created before(https://github.com/apache/gluten/pull/12432) had been deleted by https://github.com/apache/gluten/pull/12511 cc @marin-ma. ** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
