GitHub user drin added a comment to the discussion: Safe way to periodically add arrow RecordBatch to a file
you can make epoch a column of your record batch or put some index-like structure in the schema metadata that you can use to identify record batch index from epoch. GitHub link: https://github.com/apache/arrow/discussions/48124#discussioncomment-14961205 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
