[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution|--- |MOVED

--- Comment #9 from Dominik Stadler  ---
The current remainder of this bug needs to be handled over at XMLBeans via
https://issues.apache.org/jira/browse/XMLBEANS-502, so closing this one for
now. 

We are running huge regression tests where millions of documents are processed
in one application, so a simple memory like indicated here is unlikely to be
present in recent versions of Apache POI. Please report a new bug if you have a
more detailed result of checking for memory leaks.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEEDINFO|NEW

--- Comment #8 from Dominik Stadler  ---
We never got more detailed information, so it is hard to "fix" anything for
this specific report. 

We should however try to make it possible to clear thread locals so no memory
leaks are caused by accumulating content in threads in an application which
uses web-container or thread-pools.

There is an issue for XMLBeans to allow to free the threadlocals at 
https://issues.apache.org/jira/browse/XMLBEANS-502

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

--- Comment #7 from Javen O'Neal  ---
Allow the workbook and anything it references to be garbage collected
> wb = null
or just let wb fall out of scope.

Are you able to get a refcount on POI objects?

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

Dejian Tu  changed:

   What|Removed |Added

 Blocks|60567   |


Referenced Bugs:

https://bz.apache.org/bugzilla/show_bug.cgi?id=60567
[Bug 60567] XSSFReader caused OutOfMemoryError when reading a lerge excel file
in HDFS as inputStream
-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

--- Comment #6 from pcl...@gmail.com ---
Test-case-1:

Configuration:
Apache Tomcat 7.0.61
JDK 1.7.0_79
POI-3.12-beta1
Code: 
// open a 6.2MB xlsx file containg 910,000 rows data 
Workbook wb = new XSSFWorkbook(new File(file_name)); 
wb.close(); 

Test-case-1 result: memory-use: 1.9GB (doesn't release after closing workbook).
On subsequently re-opening the same workbook the memory use remains at 1.9GB,
and tomcat stderr logs the following severe messages:
Apr 23, 2015 1:12:24 PM org.apache.catalina.loader.WebappClassLoader
checkThreadLocalMapForLeaks
SEVERE: The web application [/ProVista] created a ThreadLocal with key of type
[org.apache.xmlbeans.XmlBeans$1] (value
[org.apache.xmlbeans.XmlBeans$1@3c59c852]) and a value of type
[java.lang.ref.SoftReference] (value [java.lang.ref.SoftReference@2b19a30e])
but failed to remove it when the web application was stopped. Threads are going
to be renewed over time to try and avoid a probable memory leak.


Test-case2:

Configuration:
Apache Tomcat 7.0.61
JDK 1.7.0_79
POI-3.11
Code: 
// open a 6.2MB xlsx file containg 910,000 rows data 
Workbook wb = new XSSFWorkbook(new File(file_name)); 
wb.close(); 

Test-case-2 result: memory-use: 1.8GB (doesn't release after closing workbook).
On subsequently re-opening the same workbook the memory use remains at 1.8GB

-- 
You are receiving this mail because:
You are the assignee for the bug.

-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

--- Comment #3 from pcl...@gmail.com ---
To clarify, I have confirmed that I am experiencing the same memory leak issue
for POI versions 3.9, 3.11, 3.12-beta1. After calling new XSSFWorkbook(file),
the consumed memory is not released back to the operating system

-- 
You are receiving this mail because:
You are the assignee for the bug.

-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

--- Comment #4 from pcl...@gmail.com ---
My Apache Tomcat server stderr logs the following issue below which may be
closely linked to an existing bugzilla issue
https://issues.apache.org/jira/browse/XMLBEANS-502

Apr 22, 2015 3:58:12 PM org.apache.catalina.loader.WebappClassLoader
checkThreadLocalMapForLeaks
SEVERE: The web application [/ProVista] created a ThreadLocal with key of type
[org.apache.xmlbeans.XmlBeans$1] (value
[org.apache.xmlbeans.XmlBeans$1@29c9fb0e]) and a value of type
[java.lang.ref.SoftReference] (value [java.lang.ref.SoftReference@56d53bd3])
but failed to remove it when the web application was stopped. Threads are going
to be renewed over time to try and avoid a probable memory leak.

-- 
You are receiving this mail because:
You are the assignee for the bug.

-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

--- Comment #5 from Nick Burch apa...@gagravarr.org ---
Try calling close on the workbook, and also ensure that no references to the
workbook or sheets within it remain when you're done processing

-- 
You are receiving this mail because:
You are the assignee for the bug.

-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

--- Comment #2 from pcl...@gmail.com ---
Failed test case information below:

Used following to read xlsx spreadsheet files:

  // XSSFWorkbook, File
  OPCPackage pkg = OPCPackage.open(new File(file.xlsx));
  XSSFWorkbook wb = new XSSFWorkbook(pkg);
  
  pkg.close();
  // XSSFWorkbook, InputStream, needs more memory
  OPCPackage pkg = OPCPackage.open(myInputStream);
  XSSFWorkbook wb = new XSSFWorkbook(pkg);
  
  pkg.close();

Versions POI tested on:

3.9
3.11
3.12-beta1

Webserver: Apache Tomcat 7.0.61
JDK: 1.7.0_79

-- 
You are receiving this mail because:
You are the assignee for the bug.

-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org

[Bug 57842] Using POI 3.9 API memory consumed reading an xlsx file is not released back to the operating system after completion

[bugzilla]

https://bz.apache.org/bugzilla/show_bug.cgi?id=57842

Nick Burch apa...@gagravarr.org changed:

   What|Removed |Added

 OS||All
 Status|NEW |NEEDINFO

--- Comment #1 from Nick Burch apa...@gagravarr.org ---
Please re-test with at least 3.12 beta 1, or ideally a build from svn / nightly
build. There have been lots of bugs fixed (including memory related ones) since
3.9 came out in 2012

-- 
You are receiving this mail because:
You are the assignee for the bug.

-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org