Tlogs will accumulate if you have buffers "enabled". Make sure that you explicitly disable buffering from the cdcr endpoint https://lucene.apache.org/solr/guide/7_7/cdcr-api.html#disablebuffer Make sure that they're disabled on both the source and targets
I believe that sometimes buffers get enabled on their own. We added monitoring of CDCR to check for the buffer setting This endpoint shows you the status https://lucene.apache.org/solr/guide/7_7/cdcr-api.html#cdcr-status-example I don't understand the use case for enabling buffers, or why it is enabled by default. -----Original Message----- From: Erick Erickson <erickerick...@gmail.com> Sent: Wednesday, October 23, 2019 7:23 AM To: solr-user@lucene.apache.org Subject: Re: tlogs are not deleted My first guess is that your CDCR setup isn’t running. CDCR uses tlogs as a queueing mechanism. If CDCR can’t send docs to the target collection, they’ll accumulate forever. Best, Erick > On Oct 22, 2019, at 7:48 PM, Woo Choi <richkingmyst...@gmail.com> wrote: > > Hi, > > We are using solr 7.7 cloud with CDCR(every collection has 3 replicas, > 1 shard). > > In solrconfig.xml, > > tlog configuration is super simple like : <updateLog/> > > There is also daily data import and commit is called after data import > every time. > > Indexing works fine, but the problem is that the number of tlogs keeps > growing. > > According to the documentation > here(https://lucene.apache.org/solr/guide/6_6/updatehandlers-in-solrco > nfig.html), I expected tlog will remain as many as 10(default value of > maxNumLogsToKeep=10). > > However I still have a bunch of tlogs - the oldest one is Sep 6..! > > I did an experiment by running data import with commit option from > solr admin ui, but any of tlogs were not deleted. > > tlog.0000000000000000002.1643995079881261056 > tlog.0000000000000000018.1645444642733293568 > tlog.0000000000000000034.1646803619099443200 > tlog.0000000000000000003.1644085718240198656 > tlog.0000000000000000019.1645535304072822784 > tlog.0000000000000000035.1646894195509559296 > tlog.0000000000000000004.1644176284537847808 > tlog.0000000000000000020.1645625651261079552 > tlog.0000000000000000036.1646984623121498112 > tlog.0000000000000000005.1644357373324689408 > tlog.0000000000000000021.1645625651316654083 > tlog.0000000000000000037.1647076244416626688 > tlog.0000000000000000006.1644447899616018432 > tlog.0000000000000000022.1645716477747134464 > tlog.0000000000000000038.1647165801017376768 > tlog.0000000000000000007.1644538486210953216 > tlog.0000000000000000023.1645806853961023488 > tlog.0000000000000000039.1647165801042542594 > tlog.0000000000000000008.1644629084296183808 > tlog.0000000000000000024.1645897663703416832 > tlog.0000000000000000040.1647256590865137664 > tlog.0000000000000000009.1644719895268556800 > tlog.0000000000000000025.1645988248838733824 > tlog.0000000000000000041.1647347172490870784 > tlog.0000000000000000010.1644810493331767296 > tlog.0000000000000000026.1646078905702940672 > tlog.0000000000000000042.1647437758859313152 > tlog.0000000000000000011.1644901113324896256 > tlog.0000000000000000027.1646169478772293632 > tlog.0000000000000000043.1647528345005457408 > tlog.0000000000000000012.1645031030684385280 > tlog.0000000000000000028.1646259838395613184 > tlog.0000000000000000044.1647618793025830912 > tlog.0000000000000000013.1645031030777708545 > tlog.0000000000000000029.1646350429145006080 > tlog.0000000000000000045.1647709579019026432 > tlog.0000000000000000014.1645082080252526592 > tlog.0000000000000000030.1646441456502571008 > tlog.0000000000000000046.1647890587519549440 > tlog.0000000000000000015.1645172929206419456 > tlog.0000000000000000031.1646531802044563456 > tlog.0000000000000000047.1647981403286011904 > tlog.0000000000000000016.1645263488829882368 > tlog.0000000000000000032.1646622220615680000 > tlog.0000000000000000048.1648071989042085888 > tlog.0000000000000000017.1645353861842468864 > tlog.0000000000000000033.1646712822719053824 > tlog.0000000000000000049.1648135546466205696 > > Did I miss something in the solrconfig file? > > > > -- > Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html This message and any attachment are confidential and may be privileged or otherwise protected from disclosure. If you are not the intended recipient, you must not copy this message or attachment or disclose the contents to any other person. If you have received this transmission in error, please notify the sender immediately and delete the message and any attachment from your system. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not accept liability for any omissions or errors in this message which may arise as a result of E-Mail-transmission or for damages resulting from any unauthorized changes of the content of this message and any attachment thereto. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not guarantee that this message is free of viruses and does not accept liability for any damages caused by any virus transmitted therewith. Click http://www.merckgroup.com/disclaimer to access the German, French, Spanish and Portuguese versions of this disclaimer.
