Regarding the SAX2Count memory usage problem:
Try using the following program to generate testfiles:
#include <stdio.h>
#define WITH_ATTRIBUTES #define ELEM_COUNT 3000000
int main() {
FILE *fp;if(!(fp=fopen("test.xml","wt")))
return -1;fprintf(fp,"<?xml version=\"1.0\"?>\n<root>\n");
for(int i=0;i<ELEM_COUNT;++i)
#ifdef WITH_ATTRIBUTES
fprintf(fp,"<element attribute1=\"value1\" attribute2=\"value2\" attribute3=\"value3\"/>\n");
#endif
#ifndef WITH_ATTRIBUTES
fprintf(fp,"<element/>\n");
#endif
fprintf(fp,"</root>\n");
fclose(fp);
return 0; }
If attributes are used, SAX2Count's memory usage reaches ~38mb (input file size: 210mb). If the testfile is generated without attributes (size: 35mb), the memory usage remains constant at 1780k.
Best regards,
Florian Brugger
----- Original Message ----- From: "Alberto Massari" <[EMAIL PROTECTED]>
To: <xerces-c-dev@xml.apache.org>
Sent: Thursday, December 23, 2004 2:31 PM
Subject: Re: Problem with SAX2XMLReader Memory Usage
Hi Florian,
I tried the SAX2Count sample on the XML files generated by XMark (both the 115Mb and the 232Mb versions); in both cases the memory consumption was under 5Mb. Can you post the XML you are using?
Alberto
At 10.40 13/12/2004 +0100, [EMAIL PROTECTED] wrote:I have noticed a problem using SAX2XMLReader in an application dealing with large XML files: memory consumption does not remain at the same level but rises at a constant rate. This can be easily reproduced using a large XML file with a sample application such as SAX2Count. SAX2Count memory consumption rose from ~3 mb to ~30 mb parsing a ~120 mb XML document (on win32). The document I used for testing purposes did not contain deeply nested elements.
I have validation turned off in my application and still encounter this problem so using validation should not cause the increasing memory consumption.
I would appreciate any advice on how to keep memory usage at a constant level using a Xerces SAX parser as my application is expected to handle arbitrarily large XML files.
Thank you,
Florian Brugger
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
