Re: [Oorexx-devel] High memory usage in ooRexx

Greetings Rick, Rick McGuire wrote: Rewrite the garbage collector so to use a compacting algorithm (a MAJOR effort with a lot of portability concerns). Were I still handling this, I would answer this as "won't fix". I've spent many, many hours on trying various tweaks on this situation and it

Re: [Oorexx-devel] High memory usage in ooRexx

> > I don't see any issue when I run the mutable buffer program on 64-bit My fault: the MutableBuffer code I posted had a typo .. MutableBuffer~new(1e9) should have read new(, 1e9) No issue, if the buffer length is correctly given at initialization. I've removed the Mutable buffer case from the b

Re: [Oorexx-devel] High memory usage in ooRexx

I don't see any issue when I run the mutable buffer program on 64-bit. It slows down greatly once the buffer gets larger than 1e9, but does complete without error. Set and breakpoint on reportException and see where the problem is coming from. Rick On Fri, Jun 30, 2017 at 9:00 AM, Erich Steinböck

Re: [Oorexx-devel] High memory usage in ooRexx

OK, thanks. What about the MutableBuffer scenario? How is that becoming fragmented? Aren't we fully allocating a MutableBuffer with the given size at creation time? Should we? Adding s[1e9] = "x"; s~delete(1) after buffer creation will allow the appends to successfully complete. On Fri, Jun 30

Re: [Oorexx-devel] High memory usage in ooRexx

Rewrite the garbage collector so to use a compacting algorithm (a MAJOR effort with a lot of portability concerns). Were I still handling this, I would answer this as "won't fix". I've spent many, many hours on trying various tweaks on this situation and it is a hard problem to solve with out some

Re: [Oorexx-devel] High memory usage in ooRexx

Rick, I've opened [bugs:#1465] which shows a (memory fragmentation?) issue with both String and MutableBuffer appends. Any ideas welcome if/how this can be fixed. -- Check out

Re: [Oorexx-devel] High memory usage in ooRexx

On Fri, Jun 30, 2017 at 1:22 PM, Rick McGuire wrote: > That's not true. A GC operation is triggered any time the memory manager > is unable satisfy a request. Rick, thanks for clarifying this :) M -- Moritz Hoffmann; http://antiguru.de/ ---

Re: [Oorexx-devel] High memory usage in ooRexx

On Fri, Jun 30, 2017 at 7:08 AM, Moritz Hoffmann wrote: > Hi P.O., > I think the optimizations suggested by others are very relevant to your > use case. Looking at your you perform many operations that are linear and > are performed for every input word so roughly quadratic in runtime. Here > are

Re: [Oorexx-devel] High memory usage in ooRexx

Hi P.O., I think the optimizations suggested by others are very relevant to your use case. Looking at your you perform many operations that are linear and are performed for every input word so roughly quadratic in runtime. Here are some examples: Position = LeftWordsMB~WordPos(LeftWordMB) The r

[Oorexx-devel] High memory usage in ooRexx

Dear all, Just for the record: I did NOT ask anyone to debug my code, I volunteered a test case that could systematically exhaust the memory of my machine for a certain configuration whereas for all other data it performed well. Had I desired to be ridiculed I would have turned to Facebook or T

Re: [Oorexx-devel] High memory usage in ooRexx

Not in any way to assert that ooRexx does not have scaling issues, when I hear hoof-beats I think "horses" not "reindeer". ;-) I would want to be very sure that the long execution times and random anomalies were not caused by my code before asking volunteers to debug it. -Chip- On 6/29/2017

Re: [Oorexx-devel] High memory usage in ooRexx

Erich: On 29.06.2017 17:11, Erich Steinböck wrote: > > executing other peoples code .. please give it a try > > I can run code if you provide it as a platform-independent test case. I have > no Mac, and the Mac > binaries you provide won't run on Ubuntu or Windows, the platforms I can test

Re: [Oorexx-devel] High memory usage in ooRexx

Hi P.O., executing other peoples code .. please give it a try I can run code if you provide it as a platform-independent test case. I have no Mac, and the Mac binaries you provide won't run on Ubuntu or Windows, the platforms I can test on. tr.rex gets stuck in the routine split_data > The code

Re: [Oorexx-devel] High memory usage in ooRexx

The class method will return the class of the object, or you can use the isA method to check if the object is of a specific class. Rick On Wed, Jun 28, 2017 at 5:46 PM, P.O. Jonsson wrote: > > Hälsningar/Regards/Grüsse, > P.O. Jonsson > oor...@jonases.se > > Hello again Erich, > > I know execut

Re: [Oorexx-devel] High memory usage in ooRexx

Hälsningar/Regards/Grüsse, P.O. Jonsson oor...@jonases.se Hello again Erich, I know executing other peoples code can be a p.i.t.a. but please give it a try. Se it as a golden opportunity to stress test ooRexx :-) > Am 28.06.2017 um 21:21 schrieb Erich Steinböck : > > Please download the compl

Re: [Oorexx-devel] High memory usage in ooRexx

> Please download the complete test set and let it run and > I neither have a Mac nor do I have 50 GB of memory I had a REPRODUCIBLE scenario where this problem occurs > Out of 1200 or so runs it was only this single run that produced memory > bloating > see if you can reproduce the memory problem

Re: [Oorexx-devel] High memory usage in ooRexx

"maybe it is just bad programming“ I guess I had it coming… Thanks Erich for your advice, I will consider it all, but my intention with this report was another one; for the first time I had a REPRODUCIBLE scenario where this problem occurs. Out of 1200 or so runs it was only this single run th

Re: [Oorexx-devel] High memory usage in ooRexx

> > maybe it is just bad programming Hi P.O., I had a look at Split_data and as far as I can see there are a lot of things which can be improved. 1) You may want to re-read how to work with a MutableBuffer. E. g. tempMB = .mutablebuffer~new('') do while .. tempMB = qfileIn~lin

[Oorexx-devel] High memory usage in ooRexx

Dear developers,I have had the memory bloating problem again, this time I reached 48 GB (the maximum for one CPU in my machine) and the process only ended after some 13 CPU hours with 100% CPU the whole time.From the logging info I could confirm that the program was stuck somewhere here most of the

Re: [Oorexx-devel] High memory usage in ooRexx

Dear P.O., as this is a problem of ooRexx and not of BSF4ooRexx, I redirect further postings to the appropriate oorexx-devel@lists.sourceforge.net (the ooRexx developer list). Your problem might have to do with ("Performance drops suddenly (once eve