[
https://issues.apache.org/jira/browse/TS-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13452553#comment-13452553
]
Leif Hedstrom commented on TS-1457:
-----------------------------------
Hmmm, I tested v3.0.2 and v3.0.0 as well, and still see this "problem". My test
setup is basically this:
1) Turn off caching:
CONFIG proxy.config.http.cache.http INT 0
2) Reverse proxy with remap.config:
map http://loki.ogre.com/local82 http://localhost:82
3) localhost:82 is lighttpd, serving a 10M file (named 10M).
4) Run ab with
ab -c 900 -n 10000 http://loki.ogre.com/local82/10M
This will consume roughly 4GB of RAM of 32KB buffers with 3.0.2. It's a little
better than trunk, but not noticeably so. The amount of memory used is directly
linear to the number of connections.
{code}
allocated | in-use | type size | free list name
--------------------|--------------------|------------|----------------------------------
0 | 0 | 2097152 |
memory/ioBufAllocator[14]
0 | 0 | 1048576 |
memory/ioBufAllocator[13]
0 | 0 | 524288 |
memory/ioBufAllocator[12]
0 | 0 | 262144 |
memory/ioBufAllocator[11]
0 | 0 | 131072 |
memory/ioBufAllocator[10]
0 | 0 | 65536 | memory/ioBufAllocator[9]
4042260480 | 0 | 32768 | memory/ioBufAllocator[8]
0 | 0 | 16384 | memory/ioBufAllocator[7]
8388608 | 0 | 8192 | memory/ioBufAllocator[6]
4194304 | 0 | 4096 | memory/ioBufAllocator[5]
1310720 | 0 | 2048 | memory/ioBufAllocator[4]
{code}
> transforms during video requests cause massive memory growth
> ------------------------------------------------------------
>
> Key: TS-1457
> URL: https://issues.apache.org/jira/browse/TS-1457
> Project: Traffic Server
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2.0
> Environment: Linux RHEL6.2
> Reporter: Aidan McGurn
> Priority: Critical
> Attachments: no-null-3.2.0-massif.txt, null-3.0.2-massif.txt,
> null-3.2.0-massif.txt
>
>
> Running the null-transform example object over 3.2.0, shows massive memory
> growth -
> This could be seen on our system since using 3.2.0 with custom plugin which
> invokes transforms - under load ~6K and with video content (only Video -
> small files are ok), a huge growth was seen (GB's) such that it crashes the
> load test machine.
> heap profiles are attached for comparison:
> -null transform example so over 3.2.0
> -NO null transform over 3.2.0
> -null transform example so over 3.0.2
> As can be seen no issue in 3.0.2 -
> The profiles show clearly the call chain is different for both releases
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira