YjyJeff opened a new issue, #12641:
URL: https://github.com/apache/datafusion/issues/12641

   ### Is your feature request related to a problem or challenge?
   
   Currently, most of the `RecordBatchStream` generated by the `PhysicalPlan` 
could propagate the errors polled from the input and continue polling. However, 
some streams will stop polling the input stream when an error is encountered.  
The behavior is inconsistent
   
   
   ### Describe the solution you'd like
   
   Unify the error handling for all of the `RecordBatchStream`: Continue 
polling the input stream when the input stream produces the error and only the 
stream that encounters the error can stop itself.
   
   The advantage of this solution is that: We could decide whether to continue 
execution based on the type of error fetched from the root stream. For example, 
we may want to get the partial query result when data corruption happens in the 
`TableScan`. In this case, the error generated by the `TableScan` will be 
passed through all of the streams. As long as this `TableScan` could recover it 
self to produce the next `RecordBatch`, we could get the error and the partial 
query result
   
   ### Describe alternatives you've considered
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to