viirya commented on code in PR #11276:
URL: https://github.com/apache/datafusion/pull/11276#discussion_r1667615783
##########
datafusion/physical-plan/src/joins/utils.rs:
##########
@@ -1411,6 +1424,63 @@ where
.collect::<PrimitiveArray<T>>()
}
+/// Appends probe indices in order by considering the given build indices.
+///
+/// This function constructs new build and probe indices by iterating through
+/// the provided indices, and appends any missing values between previous and
+/// current probe index with a corresponding null build index. It handles
various
+/// edge cases and returns an error if either index is `None`.
+///
+/// # Parameters
+/// - `build_indices`: `PrimitiveArray` of `UInt64Type` containing build
indices.
+/// - `probe_indices`: `PrimitiveArray` of `UInt32Type` containing probe
indices.
+/// - `count_probe_batch`: The number of elements in the probe batch, used for
+/// filling in any remaining indices.
+///
+/// # Returns
+/// A `Result` containing a tuple of two arrays:
+/// - A `PrimitiveArray` of `UInt64Type` with the newly constructed build
indices.
+/// - A `PrimitiveArray` of `UInt32Type` with the newly constructed probe
indices.
+///
+/// # Errors
+/// Returns an error if there is a failure in calculating probe indices.
Review Comment:
```suggestion
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
