Something that strikes me with this question is:
How do you check that the stack is doing what you want it to; once it is running and
seems to be working. It is not practical to check by hand. It does not seem quite as
simple as doing a search for "//" in BBEdit on the original data and counting the
number of matches compared to the number returned by your stack.
Perhaps write alternative stacks to do the same task; see if they produce identical
results, debug till they do; compare running times + reliability and use the best. Two
birds with one stone.
I hope this was a useful question to ask?
George
On November 28 2000, Kevin Miller <[EMAIL PROTECTED]> wrote:
>
>On 27/11/00 4:03 pm, Gregory Lypny <[EMAIL PROTECTED]> wrote:
>
>> I'm writing a simple stack to filter data from big text files (more
>> than 150 MB), and export tab-delimited subsets to text files that can be
>> used in spreadsheets and statistical packages.
>> Here's some questions I hope you can help me with.
>>
>> 1. Because of the size of the raw data files, I want to read in
>> one record at a time into a temporary variable, process it, and then
>> empty it before proceeding to the next record.
Archives: http://www.mail-archive.com/[email protected]/
Info: http://www.xworlds.com/metacard/mailinglist.htm
Please send bug reports to <[EMAIL PROTECTED]>, not this list.
