GitHub user RayZ0rr added a comment to the discussion: Safe way to periodically add arrow RecordBatch to a file
Hey @drin , I forgot to mention in my top post but after saving the record batches I would like to get random access reads to the data at specific epoch. For eg: after training the model and doing further analysis, I'll have a list of epoch number with best performance. So, I would like to only get data at these best epoch numbers or single best epoch number GitHub link: https://github.com/apache/arrow/discussions/48124#discussioncomment-14960894 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
