zeroshade commented on issue #14007: URL: https://github.com/apache/arrow/issues/14007#issuecomment-1232143165
I'm trying to replicate your issue from that Jira card and I'm having difficulty. Your main seems to only take about 1 - 2 minutes to run to completion and, at least on my laptop, I can't get it to use more than 2GB of virtual memory so I don't see the 16GB you mentioned in the JIRA card. Also, since you're using the default allocator (which is just Go's allocator) it's also possible that the memory you're building up is from the reallocations of continuously expanding the string builder's buffers (since you're not reserving the memory) and then the Garbage collector hasn't run to clean it up yet depending on your options. There's a couple other ideas I can think of, but as I can't currently replicate the 16GB of RAM usage you're seeing it's hard to speculate. Can you give me any more information about the machine you're running this on? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
