[ 
https://issues.apache.org/jira/browse/CASSANDRA-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13971607#comment-13971607
 ] 

Ryan McGuire commented on CASSANDRA-5220:
-----------------------------------------

yourkit also listed some potential deadlocks, which apparently it doesn't save 
to the snapshot:

{code}
Frozen threads found (potential deadlock)
 
It seems that the following threads have not changed their stack for more than 
10 seconds.
These threads are possibly (but not necessarily!) in a deadlock or hung.
 
Thread-10 <--- Frozen for at least 48 sec
sun.nio.ch.FileDispatcherImpl.read0(FileDescriptor, long, int)
sun.nio.ch.SocketDispatcher.read(FileDescriptor, long, int)
sun.nio.ch.IOUtil.readIntoNativeBuffer(FileDescriptor, ByteBuffer, long, 
NativeDispatcher)
sun.nio.ch.IOUtil.read(FileDescriptor, ByteBuffer, long, NativeDispatcher)
sun.nio.ch.SocketChannelImpl.read(ByteBuffer)
sun.nio.ch.SocketAdaptor$SocketInputStream.read(ByteBuffer)
sun.nio.ch.ChannelInputStream.read(byte[], int, int)
org.xerial.snappy.SnappyInputStream.hasNextChunk()
org.xerial.snappy.SnappyInputStream.read()
java.io.DataInputStream.readInt()
org.apache.cassandra.net.IncomingTcpConnection.handleModernVersion()
org.apache.cassandra.net.IncomingTcpConnection.run()



Thread-11 <--- Frozen for at least 1m 17 sec
sun.nio.ch.FileDispatcherImpl.read0(FileDescriptor, long, int)
sun.nio.ch.SocketDispatcher.read(FileDescriptor, long, int)
sun.nio.ch.IOUtil.readIntoNativeBuffer(FileDescriptor, ByteBuffer, long, 
NativeDispatcher)
sun.nio.ch.IOUtil.read(FileDescriptor, ByteBuffer, long, NativeDispatcher)
sun.nio.ch.SocketChannelImpl.read(ByteBuffer)
sun.nio.ch.SocketAdaptor$SocketInputStream.read(ByteBuffer)
sun.nio.ch.ChannelInputStream.read(byte[], int, int)
org.xerial.snappy.SnappyInputStream.hasNextChunk()
org.xerial.snappy.SnappyInputStream.read()
java.io.DataInputStream.readInt()
org.apache.cassandra.net.IncomingTcpConnection.handleModernVersion()
org.apache.cassandra.net.IncomingTcpConnection.run()



Thread-12 <--- Frozen for at least 48 sec
sun.nio.ch.FileDispatcherImpl.read0(FileDescriptor, long, int)
sun.nio.ch.SocketDispatcher.read(FileDescriptor, long, int)
sun.nio.ch.IOUtil.readIntoNativeBuffer(FileDescriptor, ByteBuffer, long, 
NativeDispatcher)
sun.nio.ch.IOUtil.read(FileDescriptor, ByteBuffer, long, NativeDispatcher)
sun.nio.ch.SocketChannelImpl.read(ByteBuffer)
sun.nio.ch.SocketAdaptor$SocketInputStream.read(ByteBuffer)
sun.nio.ch.ChannelInputStream.read(byte[], int, int)
org.xerial.snappy.SnappyInputStream.hasNextChunk()
org.xerial.snappy.SnappyInputStream.read()
java.io.DataInputStream.readInt()
org.apache.cassandra.net.IncomingTcpConnection.handleModernVersion()
org.apache.cassandra.net.IncomingTcpConnection.run()



Thread-13 <--- Frozen for at least 48 sec
sun.nio.ch.FileDispatcherImpl.read0(FileDescriptor, long, int)
sun.nio.ch.SocketDispatcher.read(FileDescriptor, long, int)
sun.nio.ch.IOUtil.readIntoNativeBuffer(FileDescriptor, ByteBuffer, long, 
NativeDispatcher)
sun.nio.ch.IOUtil.read(FileDescriptor, ByteBuffer, long, NativeDispatcher)
sun.nio.ch.SocketChannelImpl.read(ByteBuffer)
sun.nio.ch.SocketAdaptor$SocketInputStream.read(ByteBuffer)
sun.nio.ch.ChannelInputStream.read(byte[], int, int)
org.xerial.snappy.SnappyInputStream.hasNextChunk()
org.xerial.snappy.SnappyInputStream.read()
java.io.DataInputStream.readInt()
org.apache.cassandra.net.IncomingTcpConnection.handleModernVersion()
org.apache.cassandra.net.IncomingTcpConnection.run()



Thread-3 <--- Frozen for at least 1m 21 sec
sun.nio.ch.FileDispatcherImpl.read0(FileDescriptor, long, int)
sun.nio.ch.SocketDispatcher.read(FileDescriptor, long, int)
sun.nio.ch.IOUtil.readIntoNativeBuffer(FileDescriptor, ByteBuffer, long, 
NativeDispatcher)
sun.nio.ch.IOUtil.read(FileDescriptor, ByteBuffer, long, NativeDispatcher)
sun.nio.ch.SocketChannelImpl.read(ByteBuffer)
sun.nio.ch.SocketAdaptor$SocketInputStream.read(ByteBuffer)
sun.nio.ch.ChannelInputStream.read(byte[], int, int)
org.xerial.snappy.SnappyInputStream.hasNextChunk()
org.xerial.snappy.SnappyInputStream.read()
java.io.DataInputStream.readInt()
org.apache.cassandra.net.IncomingTcpConnection.handleModernVersion()
org.apache.cassandra.net.IncomingTcpConnection.run()



Thread-7 <--- Frozen for at least 1m 21 sec
sun.nio.ch.FileDispatcherImpl.read0(FileDescriptor, long, int)
sun.nio.ch.SocketDispatcher.read(FileDescriptor, long, int)
sun.nio.ch.IOUtil.readIntoNativeBuffer(FileDescriptor, ByteBuffer, long, 
NativeDispatcher)
sun.nio.ch.IOUtil.read(FileDescriptor, ByteBuffer, long, NativeDispatcher)
sun.nio.ch.SocketChannelImpl.read(ByteBuffer)
sun.nio.ch.SocketAdaptor$SocketInputStream.read(ByteBuffer)
sun.nio.ch.ChannelInputStream.read(byte[], int, int)
org.xerial.snappy.SnappyInputStream.hasNextChunk()
org.xerial.snappy.SnappyInputStream.read()
java.io.DataInputStream.readInt()
org.apache.cassandra.net.IncomingTcpConnection.handleModernVersion()
org.apache.cassandra.net.IncomingTcpConnection.run()
{code}

> Repair improvements when using vnodes
> -------------------------------------
>
>                 Key: CASSANDRA-5220
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5220
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 1.2.0 beta 1
>            Reporter: Brandon Williams
>            Assignee: Yuki Morishita
>              Labels: performance, repair
>             Fix For: 2.1 beta2
>
>         Attachments: 5220-yourkit.png, 5220-yourkit.tar.bz2
>
>
> Currently when using vnodes, repair takes much longer to complete than 
> without them.  This appears at least in part because it's using a session per 
> range and processing them sequentially.  This generates a lot of log spam 
> with vnodes, and while being gentler and lighter on hard disk deployments, 
> ssd-based deployments would often prefer that repair be as fast as possible.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to