fallintoplace opened a new pull request, #1393:
URL: https://github.com/apache/arrow-go/pull/1393
### What
- Stream `WithChunk(-1)` CSV rows into Arrow builders as records arrive.
### Why
- `ReadAll` keeps every parsed row in memory before building Arrow arrays.
### Implementation
- Reuse the existing parser and builder path one record at a time.
- Preserve pending rows and conversion behavior.
### Benchmark
- `BenchmarkCSVReadAllStreaming`, 100,000 rows and 3 columns, median of
seven on Go 1.26.3 / Apple M1 Pro:
- Time: 24.57 ms -> 14.55 ms (1.69x faster)
- Allocated bytes: 28.38 MB -> 8.21 MB (71% fewer)
- Allocations: 200,166 -> 100,138 (50% fewer)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
