Can you run a mirror instance and swap traffic, performing reindexing on an online system, and then bring it online when complete?
On Sun, Jul 8, 2018, 7:46 PM changchun huang (JIRA) <j...@apache.org> wrote: > > [ > https://issues.apache.org/jira/browse/LUCENE-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel > ] > > changchun huang reopened LUCENE-8389: > ------------------------------------- > > Thanks for quickly reply. > > Definitely I am not talking about the JAVA Heap. > > When we were triggering background re-index from Jira, we can see during > the re-indexing, the physical memory was reserved by the Lucene. 16 Heap, > 64 Physical Memory allocated. we could see the all Physical memory got > reserved during the re-indexing(Jira background re-index, single thread). > > The problem is, we could not even set memory limit only for Lucene as the > typical situation is, Lucence is not a standalone application, and it > is embedded as JAVA application, so in a heavy load JAVA Application server > which really care about performance and downtime, re-index with only 1 > singe thread still reserves all free physical memory left, and this has > conflicts with JAVA application even we configure the same Xms and Xmx. > > So, I am asking a help like workaround, suggestion . We have JAVA 1.8 with > G1GC, there is no OOME, but during re-index, the chance of (GC pause (G1 > Evacuation Pause) (young) (to-space exhausted) increased a lot. During that > time, we were having performance issue. > > > Could not limit Lucene's memory consumption > > ------------------------------------------- > > > > Key: LUCENE-8389 > > URL: https://issues.apache.org/jira/browse/LUCENE-8389 > > Project: Lucene - Core > > Issue Type: Bug > > Components: core/index > > Affects Versions: 3.3 > > Environment: |Java Version|1.8.0_102| > > |Operating System|Linux 3.12.48-52.27-default| > > |Application Server Container|Apache Tomcat/8.5.6| > > |atabase JNDI address|mysql > jdbc:mysql://mo-15e744225:3306/jira?useUnicode=true&characterEncoding=UTF8&sessionVariables=default_storage_engine=InnoDB| > > |Database version|5.6.27| > > |abase driver|MySQL Connector Java mysql-connector-java-5.1.34 ( > Revision: jess.bal...@oracle.com-20141014163213-wqbwpf1ok2kvo1om )| > > |Version|7.6.1| > > Reporter: changchun huang > > Assignee: Uwe Schindler > > Priority: Major > > > > We are running Jira 7.6.1 with Lucene 3.3 on SLES 12 SP1 > > We configured 16GB Jira heap on 64GB server > > However, each time, when we run background re-index, the memory will be > used out by Lucene and we could not only limit its memory consumption. > > This definitely will cause overall performance issue on a system with > heavy load. > > We have around 500 concurrent users, 400K issues. > > Could you please help to advice if there were workaround or fix for > this? > > Thanks. > > > > BTW: I did check a lot and found a blog introducing the new behavior of > Lucene 3.3 > > [http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html > ] > > > > > > -- > This message was sent by Atlassian JIRA > (v7.6.3#76005) > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > >
