are you sure you want to do such a massive operation in a web page?
i suggest you do this in the background...a service perhaps? or even a scheduled task that runs periodically will do. the web page will only trigger the service and/or tell it where to look for the XML and where to dump the data. web page accesses should complete quickly...they are no place for long-running operations such as this one.
/andre
On 9/15/06, Ayende Rahien <[EMAIL PROTECTED]> wrote:
Wow, talk about using the worst tool for the job.
A 300MB file is going to result in several hundreds of thousands of rows,
isn't it? That being the case, it means a SQL call per each call. AR is not
going to perform well on batch inserts (at least until I get some stuff into
NHib first :-)).
The best tool for the job in those conditions is going to be SqlBulkCopy,
which can handle such things in far more grace.
> -----Original Message-----
> From: [EMAIL PROTECTED]
> [mailto:[EMAIL PROTECTED]] On Behalf Of
> Seth Soffer
> Sent: Thursday, September 14, 2006 3:44 PM
> To: castleproject-users@lists.sourceforge.net
> Subject: [Castle-users] Importing Data via XML
>
> I'm managing a project where a developer is importing data from a huge
> XML file (300 mb) into a SQL 2005 db. However, the imported records
> are a subset of the xml. We have active record object which he is
> using to load the data into and persist into the database. The import
> is taking a long time. Its wrapped up in one big transaction.
>
> I feel that Active Record may not be the way to go with this task, but
> the developer is resistant to trying another methodology. Any advice?
>
> -----------------------------------------------------------------------
> --
> Using Tomcat but need to do more? Need to support web services,
> security?
> Get stuff done quickly with pre-integrated technology to make your job
> easier Download IBM WebSphere Application Server v.1.0.1 based on
> Apache Geronimo
> http://sel.as-
> us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> CastleProject-users mailing list
> CastleProject-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/castleproject-users
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
CastleProject-users mailing list
CastleProject-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/castleproject-users
------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________ CastleProject-users mailing list CastleProject-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/castleproject-users
