vivek1729 commented on issue #41683:
URL: https://github.com/apache/arrow/issues/41683#issuecomment-2174550401

   @trxcllnt, thanks a lot for your response. In our case, since we receive 
multiple sequences of record batches in a single http response stream, it looks 
like each result set i.e. sequence of record batches is separated by an EOS 
marker. So, our record batch structure looks something like this:
   
   ```
   ResultSet 1
        RB1
        RB2
        EOS
   Result Set 2
        RB3
        RB4
        EOS
   Physical EOS
   ```
   
   Since our response stream can have multiple EOS markers, can we use the 
`RecordBatchReader.readAll()` pattern you've highlighted above to continue 
reading record batches after an EOS has been encountered so that it can move 
onto the next result set?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to