[ 
https://issues.apache.org/jira/browse/SOLR-4188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated SOLR-4188:
--------------------------------

    Description: 
We've updates the 10 node test cluster with today's check out. Just like some 
of my other recent issues this one is also restricted to a single node, the 
same node that's throwing SOLR-4187 but i'm not very sure both are the same 
issue. This one seems to be caused only when the node is trying to replicate.

Tomcat has never died ungracefully and restart is graceful.

{code}
2012-12-14 10:35:23,789 ERROR [solr.cloud.RecoveryStrategy] - [RecoveryThread] 
- : Corrupt tlog - ignoring. core=shard_f:org.apache.solr.common.SolrException: 
incref on a closed log: 
tlog{file=/opt/solr/cores/shard_f/data/tlog/tlog.0000000000000000084 refcount=1}
        at org.apache.solr.update.TransactionLog.incref(TransactionLog.java:492)
        at org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:989)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:259)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
{code}

The trace below seems to accompany the one above. This one is being logged some 
10 times in a row, exactly the same timestamp.

{code}
2012-12-14 10:40:36,152 ERROR [solr.update.UpdateLog] - [RecoveryThread] - : 
Exception reading versions from log
java.nio.channels.ClosedChannelException
        at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:88)
        at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:603)
        at 
org.apache.solr.update.ChannelFastInputStream.readWrappedStream(TransactionLog.java:752)
        at 
org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:89)
        at 
org.apache.solr.common.util.FastInputStream.readUnsignedByte(FastInputStream.java:71)
        at 
org.apache.solr.common.util.FastInputStream.readInt(FastInputStream.java:216)
        at 
org.apache.solr.update.TransactionLog$ReverseReader.<init>(TransactionLog.java:670)
        at 
org.apache.solr.update.TransactionLog.getReverseReader(TransactionLog.java:573)
        at 
org.apache.solr.update.UpdateLog$RecentUpdates.update(UpdateLog.java:912)
        at 
org.apache.solr.update.UpdateLog$RecentUpdates.access$000(UpdateLog.java:855)
        at 
org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:1005)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:259)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
{code}

  was:
We've updates the 10 node test cluster with today's check out. Just like some 
of my other recent issues this one is also restricted to a single node, the 
same node that's throwing SOLR-4187 but i'm not very sure both are the same 
issue. This one seems to be caused only when the node is trying to replicate.

Tomcat has never died ungracefully and restart is graceful.

{code}
2012-12-14 10:35:23,789 ERROR [solr.cloud.RecoveryStrategy] - [RecoveryThread] 
- : Corrupt tlog - ignoring. core=shard_f:org.apache.solr.common.SolrException: 
incref on a closed log: 
tlog{file=/opt/solr/cores/shard_f/data/tlog/tlog.0000000000000000084 refcount=1}
        at org.apache.solr.update.TransactionLog.incref(TransactionLog.java:492)
        at org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:989)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:259)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
{code}

The trace below seems to accompany the one above.

{code}
2012-12-14 10:40:36,152 ERROR [solr.update.UpdateLog] - [RecoveryThread] - : 
Exception reading versions from log
java.nio.channels.ClosedChannelException
        at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:88)
        at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:603)
        at 
org.apache.solr.update.ChannelFastInputStream.readWrappedStream(TransactionLog.java:752)
        at 
org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:89)
        at 
org.apache.solr.common.util.FastInputStream.readUnsignedByte(FastInputStream.java:71)
        at 
org.apache.solr.common.util.FastInputStream.readInt(FastInputStream.java:216)
        at 
org.apache.solr.update.TransactionLog$ReverseReader.<init>(TransactionLog.java:670)
        at 
org.apache.solr.update.TransactionLog.getReverseReader(TransactionLog.java:573)
        at 
org.apache.solr.update.UpdateLog$RecentUpdates.update(UpdateLog.java:912)
        at 
org.apache.solr.update.UpdateLog$RecentUpdates.access$000(UpdateLog.java:855)
        at 
org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:1005)
        at 
org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:259)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
{code}

    
> Transaction log corruption
> --------------------------
>
>                 Key: SOLR-4188
>                 URL: https://issues.apache.org/jira/browse/SOLR-4188
>             Project: Solr
>          Issue Type: Bug
>          Components: SolrCloud
>    Affects Versions: 5.0
>         Environment: 5.0.0.2012.12.14.10.53.04
>            Reporter: Markus Jelsma
>             Fix For: 5.0
>
>
> We've updates the 10 node test cluster with today's check out. Just like some 
> of my other recent issues this one is also restricted to a single node, the 
> same node that's throwing SOLR-4187 but i'm not very sure both are the same 
> issue. This one seems to be caused only when the node is trying to replicate.
> Tomcat has never died ungracefully and restart is graceful.
> {code}
> 2012-12-14 10:35:23,789 ERROR [solr.cloud.RecoveryStrategy] - 
> [RecoveryThread] - : Corrupt tlog - ignoring. 
> core=shard_f:org.apache.solr.common.SolrException: incref on a closed log: 
> tlog{file=/opt/solr/cores/shard_f/data/tlog/tlog.0000000000000000084 
> refcount=1}
>         at 
> org.apache.solr.update.TransactionLog.incref(TransactionLog.java:492)
>         at 
> org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:989)
>         at 
> org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:259)
>         at 
> org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
> {code}
> The trace below seems to accompany the one above. This one is being logged 
> some 10 times in a row, exactly the same timestamp.
> {code}
> 2012-12-14 10:40:36,152 ERROR [solr.update.UpdateLog] - [RecoveryThread] - : 
> Exception reading versions from log
> java.nio.channels.ClosedChannelException
>         at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:88)
>         at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:603)
>         at 
> org.apache.solr.update.ChannelFastInputStream.readWrappedStream(TransactionLog.java:752)
>         at 
> org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:89)
>         at 
> org.apache.solr.common.util.FastInputStream.readUnsignedByte(FastInputStream.java:71)
>         at 
> org.apache.solr.common.util.FastInputStream.readInt(FastInputStream.java:216)
>         at 
> org.apache.solr.update.TransactionLog$ReverseReader.<init>(TransactionLog.java:670)
>         at 
> org.apache.solr.update.TransactionLog.getReverseReader(TransactionLog.java:573)
>         at 
> org.apache.solr.update.UpdateLog$RecentUpdates.update(UpdateLog.java:912)
>         at 
> org.apache.solr.update.UpdateLog$RecentUpdates.access$000(UpdateLog.java:855)
>         at 
> org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:1005)
>         at 
> org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:259)
>         at 
> org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to