> Even with SAX or Stream source I could not achieve much performance gain > but it was better than other sources which I managed to transform my data > file > within 31 min on a dual processor machine with 1GB physical memory & > 2 GB of virtual memory. > I'll take a look at "pruning" and "filtering" as a alternate approach if > applicable for my task.
Hi, I haven't checked it out myself, but I think STX may be what you need here (http://stx.sourceforge.net/). Also, I believe DOM implementations can be nearer 10 times the size of the input XML, making 5 quite a conservative estimate (initial estimates were 3-5, but now the majority think 10). When questions like this come up, the usual response is to look at your data. Data of this size is usually repetitive, so you could break it up into chunks that don’t rely on each other for processing (using SAX), then pass each chunk through your transformation and rebuild the output the other side. cheers andrew --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com). Version: 6.0.495 / Virus Database: 294 - Release Date: 30/06/2003
