[
https://issues.apache.org/jira/browse/SOLR-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321729#comment-14321729
]
Mark Miller commented on SOLR-7113:
-----------------------------------
Thanks Vamsee - I have a test and patch for this.
We are kind of jumping hoops to try and support the tlog location changing on a
new call to init. This is not even something we need or want to support.
So rather than try and deal with multiple Filesystem instances here (which
would require some sort of reference counting at this point), we can simply fix
the code to not accept a location change.
> Solr indexing throws errors around closing transaction log
> ----------------------------------------------------------
>
> Key: SOLR-7113
> URL: https://issues.apache.org/jira/browse/SOLR-7113
> Project: Solr
> Issue Type: Bug
> Reporter: Vamsee Yarlagadda
>
> I notice this issue while trying to do some heavy indexing into Solr. (700K
> docs per minute)
> Solr log errors
> {code}
> 15:42:47
> ERROR
> HdfsTransactionLog
> Exception closing tlog.
> java.io.IOException: Filesystem closed
> at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:765)
> at
> org.apache.hadoop.hdfs.DFSOutputStream.flushOrSync(DFSOutputStream.java:1898)
> at
> org.apache.hadoop.hdfs.DFSOutputStream.hflush(DFSOutputStream.java:1859)
> at
> org.apache.hadoop.fs.FSDataOutputStream.hflush(FSDataOutputStream.java:130)
> at
> org.apache.solr.update.HdfsTransactionLog.close(HdfsTransactionLog.java:303)
> at org.apache.solr.update.TransactionLog.decref(TransactionLog.java:504)
> at org.apache.solr.update.UpdateLog.addOldLog(UpdateLog.java:335)
> at org.apache.solr.update.UpdateLog.postCommit(UpdateLog.java:628)
> at
> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:600)
> at org.apache.solr.update.CommitTracker.run(CommitTracker.java:216)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 15:42:47
> ERROR
> CommitTracker
> auto commit error...:org.apache.solr.common.SolrException:
> java.io.IOException: Filesystem closed
> auto commit error...:org.apache.solr.common.SolrException:
> java.io.IOException: Filesystem closed
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
