Hi Anis, To me it seems more like a bot attack then a leak of memory, do you have a strategy to deal with malicious bots?
Best Luiz On Friday, November 4, 2016, Anis <[email protected]> wrote: > Hi! > > > Our busiest repository was crashing between every 15-30 minutes and it > seems it was related to out of memory problems and the amount of requests > DSpace is getting. We captured the heap dump from one of our crashes, and > as you can see from the image, 78% (3.12GB) of the heap space is populated > by byte arrays. A lot of these byte arrays are buffered 1MB arrays that are > part of an outputstream from HttpServletResponseBufferingWrapper, and to > my understanding this class should send the 404 response and if you > actually check the contents of the arrays, they have the 404 HTML code. It > also seems that the HttpServletResponseBufferingWrappers, that are in the > memory are never sent, as their response bytesWritten are all 0. > > We resolved the problem by letting Apache handle most of the 404, cleaning > our theme files from references, that are not found anymore, capping out > maxdb connections to 50 and maxidle to 30. It is possible, that we just had > way too many 404 responses to serve, but it would be nice to hear if > someone else has had or is having this problem and if it happens because of > the amount of requests, it would be nice to know why. > > > - Anis > > > > > <https://lh3.googleusercontent.com/-6wbDPcg8vmA/WBxkRWhH0vI/AAAAAAAABb0/MlSZNTtzKO4YvgUI97FYfGmFsOnu1pY0gCLcB/s1600/Screen%2BShot%2B2016-11-04%2Bat%2B12.00.52.png> > > > <https://lh3.googleusercontent.com/-gXnStN9z8EE/WBxkWKq94EI/AAAAAAAABb4/WsBFZI-JxBQpHNMn21IBLY49yVshIxaNgCLcB/s1600/Screen%2BShot%2B2016-11-04%2Bat%2B12.01.12.png> > > > > <https://lh3.googleusercontent.com/-Ah_IQ4sWPxg/WBxkpB0ModI/AAAAAAAABb8/LA5PpCDhebIINgBxSY6Aj5AjGEpFV6IyQCLcB/s1600/Screen%2BShot%2B2016-11-04%2Bat%2B12.12.05.png> > > > <https://lh3.googleusercontent.com/-kcffJx_9HQY/WBxo7ypMrgI/AAAAAAAABcM/w8DSsqhop9kZgk9p31mxQHHgnDLTXKPsQCLcB/s1600/Screen%2BShot%2B2016-11-04%2Bat%2B12.53.12.png> > > > > -- > You received this message because you are subscribed to the Google Groups > "DSpace Technical Support" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] > <javascript:_e(%7B%7D,'cvml','dspace-tech%[email protected]');> > . > To post to this group, send email to [email protected] > <javascript:_e(%7B%7D,'cvml','[email protected]');>. > Visit this group at https://groups.google.com/group/dspace-tech. > For more options, visit https://groups.google.com/d/optout. > -- Luiz Claudio Santos http://luizclaudiosantos.me/ -- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/dspace-tech. For more options, visit https://groups.google.com/d/optout.
