Patrick, I don't really understand your scenario. What format will the data be coming in in? And it will be coming in over a TCP or HTTP socket? You then need to parse through that data to validate it? How will you chunk that data? It needs to be sent out as XML after validation? Will you send each chunk as a discrete XML document or all as one document? How big is each chunk? Does 1 chunk relate to the next for validation purposes? Ie will you have to check chunk 6 for data from chunk 4, etc?
If you are really streaming 30-40 billion records then I think you'll need to break up your process in to separate sub processes. The first to read the data in and store it (a database?), the second to validate the data in the DB, and the third to send it back out. Greg C# MVP -----Original Message----- From: patrickekenney [mailto:[EMAIL PROTECTED] Sent: Friday, May 07, 2004 1:37 PM To: [EMAIL PROTECTED] Subject: [AspNetAnyQuestionIsOk] Re: Max Number of Elements in a C# Dynamic Array I can't send it down the line until I have the various xml documents built, from the xml stream so basically iterate one hierarchal xml record at a time, with various one-many and many to many relationships and start building the dynamic struct(s) (Arrays?) to build the xml documents from. Maybe I am missing an easier way. Yahoo! Groups Links ------------------------ Yahoo! Groups Sponsor ---------------------~--> Make a clean sweep of pop-up ads. Yahoo! Companion Toolbar. Now with Pop-Up Blocker. Get it for free! http://us.click.yahoo.com/L5YrjA/eSIIAA/yQLSAA/saFolB/TM ---------------------------------------------------------------------~-> Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/AspNetAnyQuestionIsOk/ <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
