Its being done through a Windows service. On 9/14/06, Andre John Cruz <[EMAIL PROTECTED]> wrote: > hi, > > are you sure you want to do such a massive operation in a web page? > > i suggest you do this in the background...a service perhaps? or even a > scheduled task that runs periodically will do. the web page will only > trigger the service and/or tell it where to look for the XML and where to > dump the data. web page accesses should complete quickly...they are no place > for long-running operations such as this one. > > /andre > > > On 9/15/06, Ayende Rahien <[EMAIL PROTECTED]> wrote: > > Wow, talk about using the worst tool for the job. > > A 300MB file is going to result in several hundreds of thousands of rows, > > isn't it? That being the case, it means a SQL call per each call. AR is > not > > going to perform well on batch inserts (at least until I get some stuff > into > > NHib first :-)). > > The best tool for the job in those conditions is going to be SqlBulkCopy, > > which can handle such things in far more grace. > > > > > > > > > -----Original Message----- > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] > On Behalf Of > > > Seth Soffer > > > Sent: Thursday, September 14, 2006 3:44 PM > > > To: castleproject-users@lists.sourceforge.net > > > Subject: [Castle-users] Importing Data via XML > > > > > > I'm managing a project where a developer is importing data from a huge > > > XML file (300 mb) into a SQL 2005 db. However, the imported records > > > are a subset of the xml. We have active record object which he is > > > using to load the data into and persist into the database. The import > > > is taking a long time. Its wrapped up in one big transaction. > > > > > > I feel that Active Record may not be the way to go with this task, but > > > the developer is resistant to trying another methodology. Any advice? > > > > > > > ----------------------------------------------------------------------- > > > -- > > > Using Tomcat but need to do more? Need to support web services, > > > security? > > > Get stuff done quickly with pre-integrated technology to make your job > > > easier Download IBM WebSphere Application Server v.1.0.1 based on > > > Apache Geronimo > > > http://sel.as- > > > > us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > > > _______________________________________________ > > > CastleProject-users mailing list > > > CastleProject-users@lists.sourceforge.net > > > > https://lists.sourceforge.net/lists/listinfo/castleproject-users > > > > > > > ------------------------------------------------------------------------- > > Using Tomcat but need to do more? Need to support web services, security? > > Get stuff done quickly with pre-integrated technology to make your job > easier > > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > > > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > > _______________________________________________ > > CastleProject-users mailing list > > CastleProject-users@lists.sourceforge.net > > > https://lists.sourceforge.net/lists/listinfo/castleproject-users > > > > > ------------------------------------------------------------------------- > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job > easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > > _______________________________________________ > CastleProject-users mailing list > CastleProject-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/castleproject-users > > >
------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ CastleProject-users mailing list CastleProject-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/castleproject-users
