My suggestion is that you point your developer towards SQL Server's bulk import functionality: http://msdn2.microsoft.com/en-us/library/ms191184.aspx.
> -----Original Message----- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On > Behalf Of Seth Soffer > Sent: Friday, September 15, 2006 9:40 AM > To: castleproject-users@lists.sourceforge.net > Subject: Re: [Castle-users] Importing Data via XML > > Its being done through a Windows service. > > On 9/14/06, Andre John Cruz <[EMAIL PROTECTED]> wrote: > > hi, > > > > are you sure you want to do such a massive operation in a web page? > > > > i suggest you do this in the background...a service > perhaps? or even a > > scheduled task that runs periodically will do. the web page > will only > > trigger the service and/or tell it where to look for the > XML and where > > to dump the data. web page accesses should complete > quickly...they are > > no place for long-running operations such as this one. > > > > /andre > > > > > > On 9/15/06, Ayende Rahien <[EMAIL PROTECTED]> wrote: > > > Wow, talk about using the worst tool for the job. > > > A 300MB file is going to result in several hundreds of > thousands of > > > rows, isn't it? That being the case, it means a SQL call per each > > > call. AR is > > not > > > going to perform well on batch inserts (at least until I get some > > > stuff > > into > > > NHib first :-)). > > > The best tool for the job in those conditions is going to be > > > SqlBulkCopy, which can handle such things in far more grace. > > > > > > > > > > > > > -----Original Message----- > > > > From: [EMAIL PROTECTED] > > > > > > [mailto:[EMAIL PROTECTED] > > On Behalf Of > > > > Seth Soffer > > > > Sent: Thursday, September 14, 2006 3:44 PM > > > > To: castleproject-users@lists.sourceforge.net > > > > Subject: [Castle-users] Importing Data via XML > > > > > > > > I'm managing a project where a developer is importing > data from a > > > > huge XML file (300 mb) into a SQL 2005 db. However, > the imported > > > > records are a subset of the xml. We have active record object > > > > which he is using to load the data into and persist into the > > > > database. The import is taking a long time. Its > wrapped up in one big transaction. > > > > > > > > I feel that Active Record may not be the way to go with > this task, > > > > but the developer is resistant to trying another > methodology. Any advice? > > > > > > > > > > > ---------------------------------------------------------------------- > > - > > > > -- > > > > Using Tomcat but need to do more? Need to support web services, > > > > security? > > > > Get stuff done quickly with pre-integrated technology > to make your > > > > job easier Download IBM WebSphere Application Server > v.1.0.1 based > > > > on Apache Geronimo > > > > http://sel.as- > > > > > > us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > > > > _______________________________________________ > > > > CastleProject-users mailing list > > > > CastleProject-users@lists.sourceforge.net > > > > > > https://lists.sourceforge.net/lists/listinfo/castleproject-users > > > > > > > > > > > > ---------------------------------------------------------------------- > > --- > > > Using Tomcat but need to do more? Need to support web > services, security? > > > Get stuff done quickly with pre-integrated technology to > make your > > > job > > easier > > > Download IBM WebSphere Application Server v.1.0.1 based on Apache > > > Geronimo > > > > > > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=1216 > > 42 > > > _______________________________________________ > > > CastleProject-users mailing list > > > CastleProject-users@lists.sourceforge.net > > > > > https://lists.sourceforge.net/lists/listinfo/castleproject-users > > > > > > > > > > ---------------------------------------------------------------------- > > --- Using Tomcat but need to do more? Need to support web services, > > security? > > Get stuff done quickly with pre-integrated technology to > make your job > > easier Download IBM WebSphere Application Server v.1.0.1 based on > > Apache Geronimo > > > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=1216 > > 42 > > > > _______________________________________________ > > CastleProject-users mailing list > > CastleProject-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/castleproject-users > > > > > > > > -------------------------------------------------------------- > ----------- > Using Tomcat but need to do more? Need to support web > services, security? > Get stuff done quickly with pre-integrated technology to make > your job easier Download IBM WebSphere Application Server > v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&; dat=121642 > _______________________________________________ > CastleProject-users mailing list > CastleProject-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/castleproject-users > ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ CastleProject-users mailing list CastleProject-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/castleproject-users
