<<try throwing a sys(1104) in>> This is why you are my hero, Alan! With just a casual reply, you gave me information about a command I didn't know existed, and when I threw in a sys(1104) my memory issue disappeared! After replacing my FLUSH command with a sys(1104), I ran a new test and the memory usage never exceeded 50Mb total! Plus while I expected some improvement in performance, I never dreamed I could possibly achieve a 93% reduction in the time it takes to import 250 million records over my initial tests. HOLY CRAP!
My process involves opening a table, opening two IDX files for that table, importing text from a 3GB file, parsing the text into area code 3byte character values and converting 7 digit text telephone number into an integer value, posting 145,000 rows at time to my table which automatically updates the IDX files, while summarizing a count of records in each area code AND providing a progress bar update for the user. AND on my first full test it completed the process in only 36.18 minutes which is down from the 531.08 minutes it took when I started this experiment. Un-freaking-believable! Never bet against the Fox! Never doubt the power of ProFoxTech! And, never, ever doubt Alan Bourke!!! Thank you, Thank You, THANK YOU! Paul H. Tarver Tarver Program Consultants, Inc. -----Original Message----- From: ProfoxTech [mailto:profoxtech-boun...@leafe.com] On Behalf Of Alan Bourke Sent: Wednesday, March 06, 2024 2:50 AM To: profoxt...@leafe.com Subject: Re: VFPAdvanced - My Problem, My Tests & Some Results WRT large memory allocation, try throwing a sys(1104) in maybe. "Purges memory cached by programs and data, and clears and refreshes buffers for open tables. You can improve performance by calling SYS(1104) after executing commands that make extensive use of memory buffers. This function also clears internal buffers for open tables, forcing the tables to be refreshed, which is useful with large tables and in multiuser environments." -- Alan Bourke alanpbourke (at) fastmail (dot) fm [excessive quoting removed by server] _______________________________________________ Post Messages to: ProFox@leafe.com Subscription Maintenance: https://mail.leafe.com/mailman/listinfo/profox OT-free version of this list: https://mail.leafe.com/mailman/listinfo/profoxtech Searchable Archive: https://leafe.com/archives This message: https://leafe.com/archives/byMID/012801da7095$7eeed3f0$7ccc7bd0$@tpcqpc.com ** All postings, unless explicitly stated otherwise, are the opinions of the author, and do not constitute legal or medical advice. This statement is added to the messages for those lawyers who are too stupid to see the obvious.