rtpsw commented on PR #34392: URL: https://github.com/apache/arrow/pull/34392#issuecomment-1520420508
> @rtpsw I don't have a good idea where the problem might be. But if AsofJoin is producing the right batches then I think we can add debug information in the downstream node of AsofJoin (I think it's a sink node) and trace where did the output batch value change. Right. I designed the code here to support adding on-failure-only debug messages to other nodes., so what you're describing is convenient to do. > Also, in the failed case, is all the column in the second row/batch wrong or just a single column is wrong? The debug messages do not have this information, because only info about the failed column is printed. However, given these messages and that the columns are checked in order, we know that (1) the failed column has index 4, (2) all columns with lower indices were checked and passed, and (3) there is only one more column with index 5 which wasn't checked. I can add debug messages to show the check result for each column. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
