[ 
https://issues.apache.org/jira/browse/ARROW-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anson Qian updated ARROW-4736:
------------------------------
    Component/s: Go

> [Go] Optimize memory usage for CSV writer
> -----------------------------------------
>
>                 Key: ARROW-4736
>                 URL: https://issues.apache.org/jira/browse/ARROW-4736
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Go
>            Reporter: Anson Qian
>            Priority: Major
>
> perhaps not for this PR, but, depending on the number of rows and cols this 
> record contains, this may be a very large allocation, and very big memory 
> chunk.
> it could be more interesting performance wise to write n rows instead of 
> everything in one big chunk.
> also, to reduce the memory pressure on the GC, we should probably (re)use 
> this slice-of-slice of strings.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to