Just a WAG: Maybe the file is actually being written to the harddisk during the "freeze"?
Frank. Frank Cazabon Samaan Systems Ltd. - Developing Solutions www.SamaanSystems.com Referrals are important to us. If you know of anyone who would benefit from our services, please contact me. We would appreciate the opportunity to work with them. On 15/07/2010 02:27 PM, Peter Hart wrote: > Hi > > > > I hope someone can help me. > > I do some work for a charitable organisation. To keep their > subscription low, they sell the names of members to reputable > organisations to send advertising material. (Junk Mail). The member > can opt out when joining and also opt out later. In the U, we have a > Mailing Preference Service which people can notify if they don't want to > receive any Junk Mail. Our law states that if one of the members > notifies MPS, but forgets to notify the charity. The charity are > breaking the law selling their names. As you can imagine the database > they keep has some 2 million names. The data can be downloaded as > csv's, the original set of data, a set of data by household (When all > inhabitants don't want to receive Junk Mail ) and a personal set of data > when an individual in the house doesn't. > > I decided to give them a form with an IE object set to the login screen > of MPS and allow them to download the three files. A separate form > picked up the Csv's and imported them into a separate table, and then > compared them with a master table and appended any new data. A button > then processed the membership and set a flag in each record were a match > was found. Nears could then be manually processed. > > > > My problem is that in the past knowing that the process took over 3 > hours the Records Secretary, who worked from home would start it before > going to bed. The process is now performed at head office and has to be > done during working hours. So I was asked to try and speed it up. I > investigated and the biggest time waster was the import process > comparing the data with the master data. So I thought why compare, just > zap the master and import all the data each time. I wrote a test > program and now it takes 15 to 16 minutes. But: after the process > finishes FoxPro freezes and cannot be accessed for at least 10 minutes, > if you try it just crashes. The main screen and the debugger, if open, > show "not responding" , I know the program has finished as I put a > message box at the last line to show the time taken. > > > > The Csv's are 92, 146 and 373 Megabyte approximately and the master > table is 1.133 Gigabyte. > > I have run the program on two machines, one a quad core with 4Gig and > windows 7 ultimate VFP SP2 and a Pentium four with 1 gig and XP, both > are reasonable near in the time the freeze takes. > > > > Any ideas why the freeze, it goes back to the command window OK if you > just leave it. Also any Ideas of a different approach to the problem. > > > > TIA > > > > Peter > > Peter Hart Computers > > > > P.S. can you Google for peter hart computers and shop at peter hart > computers to try and get me nearer the top. (with and without the > spaces.) > > The actual sites are www.peterhartcomputers.biz which is a test bed and > will be moving to .co.uk shortly and www.shopatpeterhartcomputers.co.uk > > Which is my web store. Tanks > > > > --- StripMime Report -- processed MIME parts --- > multipart/alternative > text/plain (text body -- kept) > text/html > --- > [excessive quoting removed by server] _______________________________________________ Post Messages to: [email protected] Subscription Maintenance: http://leafe.com/mailman/listinfo/profox OT-free version of this list: http://leafe.com/mailman/listinfo/profoxtech Searchable Archive: http://leafe.com/archives/search/profox This message: http://leafe.com/archives/byMID/profox/[email protected] ** All postings, unless explicitly stated otherwise, are the opinions of the author, and do not constitute legal or medical advice. This statement is added to the messages for those lawyers who are too stupid to see the obvious.
