korowa commented on code in PR #8020:
URL: https://github.com/apache/arrow-datafusion/pull/8020#discussion_r1385360219
##########
datafusion/physical-plan/src/joins/hash_join.rs:
##########
@@ -747,6 +753,97 @@ where
Ok(())
}
+// State for storing left/right side indices used for partial batch output
+// & producing ranges for adjusting indices
+#[derive(Debug, Default)]
+pub(crate) struct HashJoinStreamState {
+ // total rows in current probe batch
+ probe_rows: usize,
+ // saved probe-build indices to resume matching from
+ last_matched_indices: Option<(usize, usize)>,
+ // current iteration has been updated
+ matched_indices_updated: bool,
+ // tracking last joined probe side index seen for further indices
adjustment
+ last_joined_probe_index: Option<usize>,
+ // tracking last joined probe side index seen for further indices
adjustment
Review Comment:
Comment has been updated
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
