GitHub user gitmodimo added a comment to the discussion: Future plans for Acero

I did another attempt on `asofjoin` and `sortedmerge` nodes. With new AI tools 
prototyping and validation is much easier and faster. I came to conclusion that 
`asofjoin` and `sortedmerge` need deep refactor not yet another patch. Current 
implementations use dedicated thread that is always present and this alone 
violates  query `use_threads=false`. On top of that non threaded build follow 
different execution path that make debugging and validation cost double. 
Furthermore several unresolved issues (especially in `asofjoin`) cannot be 
simply fixed by yet another patch, so I did thorough analysis of all opened 
(and closed unresolved) issues and did clean slate design solving all of them. 
All that while expanding legal types set and boosting performance in all 
benchmarks.
`asofjoin` - #51094
`sortedmerge` - #51141
I have tested it heavily and I believe they are both merge worthy.
@zanmato1984 @pitrou I home you will find some time to review them. They follow 
same control flow concept.

GitHub link: 
https://github.com/apache/arrow/discussions/47331#discussioncomment-18251640

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to