Ryan, Validation - on the whole set of data taken together
Regards, Girish Jain
From: Ryan Heath <[EMAIL PROTECTED]> Reply-To: "Discussion of advanced .NET topics." <ADVANCED-DOTNET@DISCUSS.DEVELOP.COM> To: ADVANCED-DOTNET@DISCUSS.DEVELOP.COM Subject: Re: [ADVANCED-DOTNET] New Type decision Criterias Date: Fri, 13 Jan 2006 09:33:49 +0100 Are those validations working on the whole set of just on one "record"? I have read Google MapReduce [1] recently and it is making so much sense, how things can be (relatively) easy and still performant ;) // Ryan [1] http://labs.google.com/papers/mapreduce.html On 1/13/06, Girish Jain <[EMAIL PROTECTED]> wrote: > Ryan, > > Yes, I do need to read the entire file into the memory first as I have > certain business validations to be performed on the data read from a file. > After these validations, I can dump the data into database > > Regards, > Girish Jain > > > >From: Ryan Heath <[EMAIL PROTECTED]> > >Reply-To: "Discussion of advanced .NET topics." > ><ADVANCED-DOTNET@DISCUSS.DEVELOP.COM> > >To: ADVANCED-DOTNET@DISCUSS.DEVELOP.COM > >Subject: Re: [ADVANCED-DOTNET] New Type decision Criterias > >Date: Fri, 13 Jan 2006 08:22:09 +0100 > > > >Interesting... > >Do you really need to read all file information into memory before > >inserting it into the database? > > > >If not, you could implement your *collection class* as an enumerable, > >that is, it will actively read the file for one record/class/struct > >(whatever you want to call it). and there for using one and only one > >instance of a record/class/struct, making the discussing > >struct-or-class irrelevant... > >This approach will *kick-ass* in a performance perspective. > > > >// Ryan > > > >=================================== > >This list is hosted by DevelopMentor(r) http://www.develop.com > > > >View archives and manage your subscription(s) at http://discuss.develop.com > > =================================== > This list is hosted by DevelopMentor(r) http://www.develop.com > > View archives and manage your subscription(s) at http://discuss.develop.com > =================================== This list is hosted by DevelopMentor® http://www.develop.com View archives and manage your subscription(s) at http://discuss.develop.com
=================================== This list is hosted by DevelopMentor® http://www.develop.com View archives and manage your subscription(s) at http://discuss.develop.com
