[
https://issues.apache.org/jira/browse/RANGER-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900041#comment-15900041
]
Greg Senia commented on RANGER-1429:
------------------------------------
This thread ran for over 1 million milliseconds:
"searcherExecutor-9-thread-1-processing-n:ha21t56mn.tech.hdp.example.com:6083_solr
x:ranger_audits_shard1_replica1 s:shard1 c:ranger_audits r:core_node1" #77
prio=5
os_prio=0 tid=0x00007f71d876c800 nid=0x4996 runnable [0x00007f7225077000]
java.lang.Thread.State: RUNNABLE
at org.apache.lucene.codecs.compressing.LZ4.decompress(LZ4.java:135)
at
org.apache.lucene.codecs.compressing.CompressionMode$4.decompress(CompressionMode.java:138)
at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader$BlockState.document(CompressingStoredFieldsReader.java:560)
at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.document(CompressingStoredFieldsReader.java:576)
at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.visitDocument(CompressingStoredFieldsReader.java:583)
at org.apache.lucene.index.CodecReader.document(CodecReader.java:88)
at
org.apache.lucene.index.FilterLeafReader.document(FilterLeafReader.java:411)
at
org.apache.lucene.index.FilterLeafReader.document(FilterLeafReader.java:411)
at
org.apache.lucene.index.BaseCompositeReader.document(BaseCompositeReader.java:118)
at org.apache.lucene.index.IndexReader.document(IndexReader.java:381)
at
org.apache.lucene.search.suggest.DocumentDictionary$DocumentInputIterator.next(DocumentDictionary.java:165)
at
org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:426)
at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)
at
org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:181)
at
org.apache.solr.handler.component.SuggestComponent$SuggesterListener.buildSuggesterIndex(SuggestComponent.java:524)
at
org.apache.solr.handler.component.SuggestComponent$SuggesterListener.newSearcher(SuggestComponent.java:506)
at
org.apache.solr.core.SolrCore.lambda$getSearcher$3(SolrCore.java:2168)
at org.apache.solr.core.SolrCore$$Lambda$193/1093407870.call(Unknown
Source)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$17/143100904.run(Unknown
Source)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
> Ranger Audit solrconfig.xml optimizations
> -----------------------------------------
>
> Key: RANGER-1429
> URL: https://issues.apache.org/jira/browse/RANGER-1429
> Project: Ranger
> Issue Type: Bug
> Components: audit
> Affects Versions: 0.7.0
> Reporter: Greg Senia
>
> When using SolrCloud and having a single shard single replica with a large
> number of audit records 20GB for 2 weeks. It takes Solr a very long time to
> open up the replica for work. After doing some research I determine via
> thread dumps that on the first request to the Solr Collection it kicks off a
> Suggestion thread and a SpellCheck thread. I propose removing these as it
> does not seem to impact RangerAudit and solves the issue of Solr
> ranger_audits collection being unavailable after solr startup.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
