[ 
https://issues.apache.org/jira/browse/SOLR-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruben Jimenez updated SOLR-857:
-------------------------------

    Attachment: schema.xml.dup

The minimum number of files that seem to be able to reproduce this issue by 
duplicating them is 20.  Here are the steps to reproduce.

1 - Extract Dup_files1.zip - Dup_files10.zip to a directory and copy each file 
twice such that you have 60 files in the folder.
2 - Delete solr data directly completely 
(C:\dev\apache-solr-1.3.0\example\solr\data)
3 - Overwrite schema.xml in C:\dev\apache-solr-1.3.0\example\solr\conf with 
schema.xml.dup attached here.
4 - Open up command prompt,  go to folder c:\dev\apache-solr-1.3.0\example and 
start solr with the following command: 
java -XX:+HeapDumpOnOutOfMemoryError -Xmx256m -XX:MaxPermSize=128m -jar 
start.jar
5 - open up command prompt, go to folder from 1 above and execute the following 
command:
java -Xmx128m -jar c:\dev\apache-solr-1.3.0\example\exampledocs\post.jar *.xml

The application should run out of memory after about the 26th file.

> Memory Leak during the indexing of large xml files
> --------------------------------------------------
>
>                 Key: SOLR-857
>                 URL: https://issues.apache.org/jira/browse/SOLR-857
>             Project: Solr
>          Issue Type: Bug
>    Affects Versions: 1.3
>         Environment: Verified on Ubuntu 8.0.4 (1.7GB RAM, 2.4GHz dual core) 
> and Windows XP (2GB RAM, 2GHz pentium) both with a Java5 SDK
>            Reporter: Ruben Jimenez
>         Attachments: OQ_SOLR_00001.xml.zip, schema.xml, schema.xml.dup, 
> solr.zip, solr256MBHeap.jpg
>
>
> While indexing a set of SOLR xml files that contain 5000 document adds within 
> them and are about 30MB each, SOLR 1.3 seems to continually use more and more 
> memory until the heap is exhausted, while the same files are indexed without 
> issue with SOLR 1.2.
> Steps used to reproduce.
> 1 - Download SOLR 1.3
> 2 - Modify example schema.xml to match fields required
> 3 - start example server with following command java -Xms512m -Xmx1024m 
> -XX:MaxPermSize=128m -jar start.jar
> 4 - Index files as follow java -Xmx128m -jar 
> .../examples/exampledocs/post.jar *.xml
> Directory with xml files contains about 100 xml files each of about 30MB 
> each.  While indexing after about the 25th file SOLR 1.3 runs out of memory, 
> while SOLR 1.2 is able to index the entire set of files without any problems.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to