[jira] [Updated] (CASSANDRA-13757) Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running

2017-09-19 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13757:
---
Priority: Major  (was: Critical)

> Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running
> 
>
> Key: CASSANDRA-13757
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13757
> Project: Cassandra
>  Issue Type: Bug
> Environment: Operation System: Debian Jessie
> Java: Oracle JDK 1.8.0_131
> Cassandra: 3.5.0
>Reporter: Serhat Rıfat Demircan
>
> We got following error while repair job running on our cluster. One of the 
> nodes stop due to segmantation fault in JVM and repair job fails.
> We could not reproduce this problem on our test and staging enviroment (main 
> difference is data size).
> {code:java}
> #
> #  SIGSEGV (0xb) at pc=0x7fd80a399e70, pid=1305, tid=0x7fd7ee7c4700
> #
> # JRE version: Java(TM) SE Runtime Environment (8.0_131-b11) (build 
> 1.8.0_131-b11)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode 
> linux-amd64 compressed oops)
> # Problematic frame:
> # C  [liblz4-java3580121503903465201.so+0x5e70]  LZ4_decompress_fast+0xd0
> #
> # Failed to write core dump. Core dumps have been disabled. To enable core 
> dumping, try "ulimit -c unlimited" before starting Java again
> #
> # If you would like to submit a bug report, please visit:
> #   http://bugreport.java.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> ---  T H R E A D  ---
> Current thread (0x7fce32dad1b0):  JavaThread "CompactionExecutor:9798" 
> daemon [_thread_in_native, id=16879, 
> stack(0x7fd7ee784000,0x7fd7ee7c5000)]
> siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 
> 0x7fd450c4d000
> Registers:
> RAX=0x7fcde6560d32, RBX=0x7fd450c4cff9, RCX=0x7fcde6560c7a, 
> RDX=0x7fcde6560d3e
> RSP=0x7fd7ee7c3160, RBP=0x7fd450c44ae6, RSI=0x7fcde6562ff8, 
> RDI=0x00c2
> R8 =0x7fcde6562ff4, R9 =0x7fcde6563000, R10=0x, 
> R11=0x
> R12=0x000c, R13=0x7fd4501cd000, R14=0x7fcde6562ff7, 
> R15=0x7fcde6562ffb
> RIP=0x7fd80a399e70, EFLAGS=0x00010283, CSGSFS=0x0033, 
> ERR=0x0004
>   TRAPNO=0x000e
> Top of Stack: (sp=0x7fd7ee7c3160)
> 0x7fd7ee7c3160:   0008 7fd81e21c3d0
> 0x7fd7ee7c3170:   0004 0001
> 0x7fd7ee7c3180:   0002 0001
> 0x7fd7ee7c3190:   0004 0004
> 0x7fd7ee7c31a0:   0004 0004
> 0x7fd7ee7c31b0:    
> 0x7fd7ee7c31c0:    
> 0x7fd7ee7c31d0:    0001
> 0x7fd7ee7c31e0:   0002 0003
> 0x7fd7ee7c31f0:   7fd7ee7c32b8 7fce32dad3a8
> 0x7fd7ee7c3200:    
> 0x7fd7ee7c3210:   7fd4501cd000 7fcde6553000
> 0x7fd7ee7c3220:   00a77ae6 7fd80a39659d
> 0x7fd7ee7c3230:    dcb8fc9b
> 0x7fd7ee7c3240:   7fd7ee7c32d0 
> 0x7fd7ee7c3250:   0006e5c7e4d8 7fd7ee7c32b8
> 0x7fd7ee7c3260:   7fce32dad1b0 7fd81df2099d
> 0x7fd7ee7c3270:   7fd7ee7c32a8 
> 0x7fd7ee7c3280:   0001 
> 0x7fd7ee7c3290:   0006e5c7e528 7fd81d74df10
> 0x7fd7ee7c32a0:    0006e5c7e4d8
> 0x7fd7ee7c32b0:   0006f6c7fbf8 0006f6e957f0
> 0x7fd7ee7c32c0:   0006e5c7e350 7fd87fff
> 0x7fd7ee7c32d0:   0006e5c7e528 7fd81fa867e0
> 0x7fd7ee7c32e0:   00a77ae20001 00a77ae2
> 0x7fd7ee7c32f0:   0006e5c7e488 0112d5f1
> 0x7fd7ee7c3300:   dcb8fc9b99ce 000100a77ae6
> 0x7fd7ee7c3310:   00a814b000a814b4 0006e5c7e4d8
> 0x7fd7ee7c3320:   0006e5c7e4d8 0006f6a4df38
> 0x7fd7ee7c3330:   00060001 00067fff
> 0x7fd7ee7c3340:   008971582c8a 0006189d87852057
> 0x7fd7ee7c3350:    e5244e71
> Instructions: (pc=0x7fd80a399e70)
> 0x7fd80a399e50:   e4 0f 49 83 fc 0f 0f 84 94 00 00 00 4a 8d 14 20
> 0x7fd80a399e60:   48 39 f2 0f 87 c0 00 00 00 0f 1f 80 00 00 00 00
> 0x7fd80a399e70:   48 8b 0b 48 83 c3 08 48 89 08 48 83 c0 08 48 39
> 0x7fd80a399e80:   c2 77 ed 48 29 d0 48 89 d1 48 29 c3 0f b7 03 48
> Register to memory mapping:
> RAX=0x7fcde6560d32 is an unknown value
> RBX=0x7fd450c4cff9 is an unknown value
> RCX=0x7fcde6560c7a is an unknown value
> 

[jira] [Updated] (CASSANDRA-13757) Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running

2017-08-16 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Serhat Rıfat Demircan updated CASSANDRA-13757:
--
Priority: Critical  (was: Major)

> Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running
> 
>
> Key: CASSANDRA-13757
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13757
> Project: Cassandra
>  Issue Type: Bug
> Environment: Operation System: Debian Jessie
> Java: Oracle JDK 1.8.0_131
> Cassandra: 3.5.0
>Reporter: Serhat Rıfat Demircan
>Priority: Critical
>
> We got following error while repair job running on our cluster. One of the 
> nodes stop due to segmantation fault in JVM and repair job fails.
> We could not reproduce this problem on our test and staging enviroment (main 
> difference is data size).
> {code:java}
> #
> #  SIGSEGV (0xb) at pc=0x7fd80a399e70, pid=1305, tid=0x7fd7ee7c4700
> #
> # JRE version: Java(TM) SE Runtime Environment (8.0_131-b11) (build 
> 1.8.0_131-b11)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode 
> linux-amd64 compressed oops)
> # Problematic frame:
> # C  [liblz4-java3580121503903465201.so+0x5e70]  LZ4_decompress_fast+0xd0
> #
> # Failed to write core dump. Core dumps have been disabled. To enable core 
> dumping, try "ulimit -c unlimited" before starting Java again
> #
> # If you would like to submit a bug report, please visit:
> #   http://bugreport.java.com/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> ---  T H R E A D  ---
> Current thread (0x7fce32dad1b0):  JavaThread "CompactionExecutor:9798" 
> daemon [_thread_in_native, id=16879, 
> stack(0x7fd7ee784000,0x7fd7ee7c5000)]
> siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 
> 0x7fd450c4d000
> Registers:
> RAX=0x7fcde6560d32, RBX=0x7fd450c4cff9, RCX=0x7fcde6560c7a, 
> RDX=0x7fcde6560d3e
> RSP=0x7fd7ee7c3160, RBP=0x7fd450c44ae6, RSI=0x7fcde6562ff8, 
> RDI=0x00c2
> R8 =0x7fcde6562ff4, R9 =0x7fcde6563000, R10=0x, 
> R11=0x
> R12=0x000c, R13=0x7fd4501cd000, R14=0x7fcde6562ff7, 
> R15=0x7fcde6562ffb
> RIP=0x7fd80a399e70, EFLAGS=0x00010283, CSGSFS=0x0033, 
> ERR=0x0004
>   TRAPNO=0x000e
> Top of Stack: (sp=0x7fd7ee7c3160)
> 0x7fd7ee7c3160:   0008 7fd81e21c3d0
> 0x7fd7ee7c3170:   0004 0001
> 0x7fd7ee7c3180:   0002 0001
> 0x7fd7ee7c3190:   0004 0004
> 0x7fd7ee7c31a0:   0004 0004
> 0x7fd7ee7c31b0:    
> 0x7fd7ee7c31c0:    
> 0x7fd7ee7c31d0:    0001
> 0x7fd7ee7c31e0:   0002 0003
> 0x7fd7ee7c31f0:   7fd7ee7c32b8 7fce32dad3a8
> 0x7fd7ee7c3200:    
> 0x7fd7ee7c3210:   7fd4501cd000 7fcde6553000
> 0x7fd7ee7c3220:   00a77ae6 7fd80a39659d
> 0x7fd7ee7c3230:    dcb8fc9b
> 0x7fd7ee7c3240:   7fd7ee7c32d0 
> 0x7fd7ee7c3250:   0006e5c7e4d8 7fd7ee7c32b8
> 0x7fd7ee7c3260:   7fce32dad1b0 7fd81df2099d
> 0x7fd7ee7c3270:   7fd7ee7c32a8 
> 0x7fd7ee7c3280:   0001 
> 0x7fd7ee7c3290:   0006e5c7e528 7fd81d74df10
> 0x7fd7ee7c32a0:    0006e5c7e4d8
> 0x7fd7ee7c32b0:   0006f6c7fbf8 0006f6e957f0
> 0x7fd7ee7c32c0:   0006e5c7e350 7fd87fff
> 0x7fd7ee7c32d0:   0006e5c7e528 7fd81fa867e0
> 0x7fd7ee7c32e0:   00a77ae20001 00a77ae2
> 0x7fd7ee7c32f0:   0006e5c7e488 0112d5f1
> 0x7fd7ee7c3300:   dcb8fc9b99ce 000100a77ae6
> 0x7fd7ee7c3310:   00a814b000a814b4 0006e5c7e4d8
> 0x7fd7ee7c3320:   0006e5c7e4d8 0006f6a4df38
> 0x7fd7ee7c3330:   00060001 00067fff
> 0x7fd7ee7c3340:   008971582c8a 0006189d87852057
> 0x7fd7ee7c3350:    e5244e71
> Instructions: (pc=0x7fd80a399e70)
> 0x7fd80a399e50:   e4 0f 49 83 fc 0f 0f 84 94 00 00 00 4a 8d 14 20
> 0x7fd80a399e60:   48 39 f2 0f 87 c0 00 00 00 0f 1f 80 00 00 00 00
> 0x7fd80a399e70:   48 8b 0b 48 83 c3 08 48 89 08 48 83 c0 08 48 39
> 0x7fd80a399e80:   c2 77 ed 48 29 d0 48 89 d1 48 29 c3 0f b7 03 48
> Register to memory mapping:
> RAX=0x7fcde6560d32 is an unknown value
> RBX=0x7fd450c4cff9 is an unknown value
> 

[jira] [Updated] (CASSANDRA-13757) Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running

2017-08-11 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Serhat Rıfat Demircan updated CASSANDRA-13757:
--
Description: 
We got following error while repair job running on our cluster. One of the 
nodes stop due to segmantation fault in JVM and repair job fails.

We could not reproduce this problem on our test and staging enviroment (main 
difference is data size).

{code:java}
#
#  SIGSEGV (0xb) at pc=0x7fd80a399e70, pid=1305, tid=0x7fd7ee7c4700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_131-b11) (build 
1.8.0_131-b11)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode linux-amd64 
compressed oops)
# Problematic frame:
# C  [liblz4-java3580121503903465201.so+0x5e70]  LZ4_decompress_fast+0xd0
#
# Failed to write core dump. Core dumps have been disabled. To enable core 
dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---  T H R E A D  ---

Current thread (0x7fce32dad1b0):  JavaThread "CompactionExecutor:9798" 
daemon [_thread_in_native, id=16879, 
stack(0x7fd7ee784000,0x7fd7ee7c5000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 
0x7fd450c4d000

Registers:
RAX=0x7fcde6560d32, RBX=0x7fd450c4cff9, RCX=0x7fcde6560c7a, 
RDX=0x7fcde6560d3e
RSP=0x7fd7ee7c3160, RBP=0x7fd450c44ae6, RSI=0x7fcde6562ff8, 
RDI=0x00c2
R8 =0x7fcde6562ff4, R9 =0x7fcde6563000, R10=0x, 
R11=0x
R12=0x000c, R13=0x7fd4501cd000, R14=0x7fcde6562ff7, 
R15=0x7fcde6562ffb
RIP=0x7fd80a399e70, EFLAGS=0x00010283, CSGSFS=0x0033, 
ERR=0x0004
  TRAPNO=0x000e

Top of Stack: (sp=0x7fd7ee7c3160)
0x7fd7ee7c3160:   0008 7fd81e21c3d0
0x7fd7ee7c3170:   0004 0001
0x7fd7ee7c3180:   0002 0001
0x7fd7ee7c3190:   0004 0004
0x7fd7ee7c31a0:   0004 0004
0x7fd7ee7c31b0:    
0x7fd7ee7c31c0:    
0x7fd7ee7c31d0:    0001
0x7fd7ee7c31e0:   0002 0003
0x7fd7ee7c31f0:   7fd7ee7c32b8 7fce32dad3a8
0x7fd7ee7c3200:    
0x7fd7ee7c3210:   7fd4501cd000 7fcde6553000
0x7fd7ee7c3220:   00a77ae6 7fd80a39659d
0x7fd7ee7c3230:    dcb8fc9b
0x7fd7ee7c3240:   7fd7ee7c32d0 
0x7fd7ee7c3250:   0006e5c7e4d8 7fd7ee7c32b8
0x7fd7ee7c3260:   7fce32dad1b0 7fd81df2099d
0x7fd7ee7c3270:   7fd7ee7c32a8 
0x7fd7ee7c3280:   0001 
0x7fd7ee7c3290:   0006e5c7e528 7fd81d74df10
0x7fd7ee7c32a0:    0006e5c7e4d8
0x7fd7ee7c32b0:   0006f6c7fbf8 0006f6e957f0
0x7fd7ee7c32c0:   0006e5c7e350 7fd87fff
0x7fd7ee7c32d0:   0006e5c7e528 7fd81fa867e0
0x7fd7ee7c32e0:   00a77ae20001 00a77ae2
0x7fd7ee7c32f0:   0006e5c7e488 0112d5f1
0x7fd7ee7c3300:   dcb8fc9b99ce 000100a77ae6
0x7fd7ee7c3310:   00a814b000a814b4 0006e5c7e4d8
0x7fd7ee7c3320:   0006e5c7e4d8 0006f6a4df38
0x7fd7ee7c3330:   00060001 00067fff
0x7fd7ee7c3340:   008971582c8a 0006189d87852057
0x7fd7ee7c3350:    e5244e71
Instructions: (pc=0x7fd80a399e70)
0x7fd80a399e50:   e4 0f 49 83 fc 0f 0f 84 94 00 00 00 4a 8d 14 20
0x7fd80a399e60:   48 39 f2 0f 87 c0 00 00 00 0f 1f 80 00 00 00 00
0x7fd80a399e70:   48 8b 0b 48 83 c3 08 48 89 08 48 83 c0 08 48 39
0x7fd80a399e80:   c2 77 ed 48 29 d0 48 89 d1 48 29 c3 0f b7 03 48

Register to memory mapping:

RAX=0x7fcde6560d32 is an unknown value
RBX=0x7fd450c4cff9 is an unknown value
RCX=0x7fcde6560c7a is an unknown value
RDX=0x7fcde6560d3e is an unknown value
RSP=0x7fd7ee7c3160 is pointing into the stack for thread: 0x7fce32dad1b0
RBP=0x7fd450c44ae6 is an unknown value
RSI=0x7fcde6562ff8 is an unknown value
RDI=0x00c2 is an unknown value
R8 =0x7fcde6562ff4 is an unknown value
R9 =0x7fcde6563000 is an unknown value
R10=0x is an unknown value
R11=0x is an unknown value
R12=0x000c is an unknown value
R13=0x7fd4501cd000 is an unknown value
R14=0x7fcde6562ff7 is an unknown value
R15=0x7fcde6562ffb is an unknown value


Stack: 

[jira] [Updated] (CASSANDRA-13757) Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running

2017-08-11 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Serhat Rıfat Demircan updated CASSANDRA-13757:
--
Description: 
We got following error while repair job running on our cluster. One of the 
nodes stop due to segmantation fault in JVM and repair job fails.

We could not reproduce this problem(main difference is data size) on our test 
and staging enviroment.

{code:java}
#
#  SIGSEGV (0xb) at pc=0x7fd80a399e70, pid=1305, tid=0x7fd7ee7c4700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_131-b11) (build 
1.8.0_131-b11)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode linux-amd64 
compressed oops)
# Problematic frame:
# C  [liblz4-java3580121503903465201.so+0x5e70]  LZ4_decompress_fast+0xd0
#
# Failed to write core dump. Core dumps have been disabled. To enable core 
dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---  T H R E A D  ---

Current thread (0x7fce32dad1b0):  JavaThread "CompactionExecutor:9798" 
daemon [_thread_in_native, id=16879, 
stack(0x7fd7ee784000,0x7fd7ee7c5000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 
0x7fd450c4d000

Registers:
RAX=0x7fcde6560d32, RBX=0x7fd450c4cff9, RCX=0x7fcde6560c7a, 
RDX=0x7fcde6560d3e
RSP=0x7fd7ee7c3160, RBP=0x7fd450c44ae6, RSI=0x7fcde6562ff8, 
RDI=0x00c2
R8 =0x7fcde6562ff4, R9 =0x7fcde6563000, R10=0x, 
R11=0x
R12=0x000c, R13=0x7fd4501cd000, R14=0x7fcde6562ff7, 
R15=0x7fcde6562ffb
RIP=0x7fd80a399e70, EFLAGS=0x00010283, CSGSFS=0x0033, 
ERR=0x0004
  TRAPNO=0x000e

Top of Stack: (sp=0x7fd7ee7c3160)
0x7fd7ee7c3160:   0008 7fd81e21c3d0
0x7fd7ee7c3170:   0004 0001
0x7fd7ee7c3180:   0002 0001
0x7fd7ee7c3190:   0004 0004
0x7fd7ee7c31a0:   0004 0004
0x7fd7ee7c31b0:    
0x7fd7ee7c31c0:    
0x7fd7ee7c31d0:    0001
0x7fd7ee7c31e0:   0002 0003
0x7fd7ee7c31f0:   7fd7ee7c32b8 7fce32dad3a8
0x7fd7ee7c3200:    
0x7fd7ee7c3210:   7fd4501cd000 7fcde6553000
0x7fd7ee7c3220:   00a77ae6 7fd80a39659d
0x7fd7ee7c3230:    dcb8fc9b
0x7fd7ee7c3240:   7fd7ee7c32d0 
0x7fd7ee7c3250:   0006e5c7e4d8 7fd7ee7c32b8
0x7fd7ee7c3260:   7fce32dad1b0 7fd81df2099d
0x7fd7ee7c3270:   7fd7ee7c32a8 
0x7fd7ee7c3280:   0001 
0x7fd7ee7c3290:   0006e5c7e528 7fd81d74df10
0x7fd7ee7c32a0:    0006e5c7e4d8
0x7fd7ee7c32b0:   0006f6c7fbf8 0006f6e957f0
0x7fd7ee7c32c0:   0006e5c7e350 7fd87fff
0x7fd7ee7c32d0:   0006e5c7e528 7fd81fa867e0
0x7fd7ee7c32e0:   00a77ae20001 00a77ae2
0x7fd7ee7c32f0:   0006e5c7e488 0112d5f1
0x7fd7ee7c3300:   dcb8fc9b99ce 000100a77ae6
0x7fd7ee7c3310:   00a814b000a814b4 0006e5c7e4d8
0x7fd7ee7c3320:   0006e5c7e4d8 0006f6a4df38
0x7fd7ee7c3330:   00060001 00067fff
0x7fd7ee7c3340:   008971582c8a 0006189d87852057
0x7fd7ee7c3350:    e5244e71
Instructions: (pc=0x7fd80a399e70)
0x7fd80a399e50:   e4 0f 49 83 fc 0f 0f 84 94 00 00 00 4a 8d 14 20
0x7fd80a399e60:   48 39 f2 0f 87 c0 00 00 00 0f 1f 80 00 00 00 00
0x7fd80a399e70:   48 8b 0b 48 83 c3 08 48 89 08 48 83 c0 08 48 39
0x7fd80a399e80:   c2 77 ed 48 29 d0 48 89 d1 48 29 c3 0f b7 03 48

Register to memory mapping:

RAX=0x7fcde6560d32 is an unknown value
RBX=0x7fd450c4cff9 is an unknown value
RCX=0x7fcde6560c7a is an unknown value
RDX=0x7fcde6560d3e is an unknown value
RSP=0x7fd7ee7c3160 is pointing into the stack for thread: 0x7fce32dad1b0
RBP=0x7fd450c44ae6 is an unknown value
RSI=0x7fcde6562ff8 is an unknown value
RDI=0x00c2 is an unknown value
R8 =0x7fcde6562ff4 is an unknown value
R9 =0x7fcde6563000 is an unknown value
R10=0x is an unknown value
R11=0x is an unknown value
R12=0x000c is an unknown value
R13=0x7fd4501cd000 is an unknown value
R14=0x7fcde6562ff7 is an unknown value
R15=0x7fcde6562ffb is an unknown value


Stack: 

[jira] [Updated] (CASSANDRA-13757) Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running

2017-08-11 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Serhat Rıfat Demircan updated CASSANDRA-13757:
--
Description: 
We got following error while repair job running on our cluster. One of the 
nodes stop due to segmantation fault in JVM and repair job fails.


{code:java}
#
#  SIGSEGV (0xb) at pc=0x7fd80a399e70, pid=1305, tid=0x7fd7ee7c4700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_131-b11) (build 
1.8.0_131-b11)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode linux-amd64 
compressed oops)
# Problematic frame:
# C  [liblz4-java3580121503903465201.so+0x5e70]  LZ4_decompress_fast+0xd0
#
# Failed to write core dump. Core dumps have been disabled. To enable core 
dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---  T H R E A D  ---

Current thread (0x7fce32dad1b0):  JavaThread "CompactionExecutor:9798" 
daemon [_thread_in_native, id=16879, 
stack(0x7fd7ee784000,0x7fd7ee7c5000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 
0x7fd450c4d000

Registers:
RAX=0x7fcde6560d32, RBX=0x7fd450c4cff9, RCX=0x7fcde6560c7a, 
RDX=0x7fcde6560d3e
RSP=0x7fd7ee7c3160, RBP=0x7fd450c44ae6, RSI=0x7fcde6562ff8, 
RDI=0x00c2
R8 =0x7fcde6562ff4, R9 =0x7fcde6563000, R10=0x, 
R11=0x
R12=0x000c, R13=0x7fd4501cd000, R14=0x7fcde6562ff7, 
R15=0x7fcde6562ffb
RIP=0x7fd80a399e70, EFLAGS=0x00010283, CSGSFS=0x0033, 
ERR=0x0004
  TRAPNO=0x000e

Top of Stack: (sp=0x7fd7ee7c3160)
0x7fd7ee7c3160:   0008 7fd81e21c3d0
0x7fd7ee7c3170:   0004 0001
0x7fd7ee7c3180:   0002 0001
0x7fd7ee7c3190:   0004 0004
0x7fd7ee7c31a0:   0004 0004
0x7fd7ee7c31b0:    
0x7fd7ee7c31c0:    
0x7fd7ee7c31d0:    0001
0x7fd7ee7c31e0:   0002 0003
0x7fd7ee7c31f0:   7fd7ee7c32b8 7fce32dad3a8
0x7fd7ee7c3200:    
0x7fd7ee7c3210:   7fd4501cd000 7fcde6553000
0x7fd7ee7c3220:   00a77ae6 7fd80a39659d
0x7fd7ee7c3230:    dcb8fc9b
0x7fd7ee7c3240:   7fd7ee7c32d0 
0x7fd7ee7c3250:   0006e5c7e4d8 7fd7ee7c32b8
0x7fd7ee7c3260:   7fce32dad1b0 7fd81df2099d
0x7fd7ee7c3270:   7fd7ee7c32a8 
0x7fd7ee7c3280:   0001 
0x7fd7ee7c3290:   0006e5c7e528 7fd81d74df10
0x7fd7ee7c32a0:    0006e5c7e4d8
0x7fd7ee7c32b0:   0006f6c7fbf8 0006f6e957f0
0x7fd7ee7c32c0:   0006e5c7e350 7fd87fff
0x7fd7ee7c32d0:   0006e5c7e528 7fd81fa867e0
0x7fd7ee7c32e0:   00a77ae20001 00a77ae2
0x7fd7ee7c32f0:   0006e5c7e488 0112d5f1
0x7fd7ee7c3300:   dcb8fc9b99ce 000100a77ae6
0x7fd7ee7c3310:   00a814b000a814b4 0006e5c7e4d8
0x7fd7ee7c3320:   0006e5c7e4d8 0006f6a4df38
0x7fd7ee7c3330:   00060001 00067fff
0x7fd7ee7c3340:   008971582c8a 0006189d87852057
0x7fd7ee7c3350:    e5244e71
Instructions: (pc=0x7fd80a399e70)
0x7fd80a399e50:   e4 0f 49 83 fc 0f 0f 84 94 00 00 00 4a 8d 14 20
0x7fd80a399e60:   48 39 f2 0f 87 c0 00 00 00 0f 1f 80 00 00 00 00
0x7fd80a399e70:   48 8b 0b 48 83 c3 08 48 89 08 48 83 c0 08 48 39
0x7fd80a399e80:   c2 77 ed 48 29 d0 48 89 d1 48 29 c3 0f b7 03 48

Register to memory mapping:

RAX=0x7fcde6560d32 is an unknown value
RBX=0x7fd450c4cff9 is an unknown value
RCX=0x7fcde6560c7a is an unknown value
RDX=0x7fcde6560d3e is an unknown value
RSP=0x7fd7ee7c3160 is pointing into the stack for thread: 0x7fce32dad1b0
RBP=0x7fd450c44ae6 is an unknown value
RSI=0x7fcde6562ff8 is an unknown value
RDI=0x00c2 is an unknown value
R8 =0x7fcde6562ff4 is an unknown value
R9 =0x7fcde6563000 is an unknown value
R10=0x is an unknown value
R11=0x is an unknown value
R12=0x000c is an unknown value
R13=0x7fd4501cd000 is an unknown value
R14=0x7fcde6562ff7 is an unknown value
R15=0x7fcde6562ffb is an unknown value


Stack: [0x7fd7ee784000,0x7fd7ee7c5000],  sp=0x7fd7ee7c3160,  free 
space=252k
Native frames: (J=compiled Java code, 

[jira] [Updated] (CASSANDRA-13757) Cassandra 3.5.0 JVM Segfault Problem While Repair Job is Running

2017-08-11 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Serhat Rıfat Demircan updated CASSANDRA-13757:
--
Description: 
We got following error while repair job running on our cluster. One of the 
nodes stop due to segmantation fault in JVM.


{code:java}
#
#  SIGSEGV (0xb) at pc=0x7fd80a399e70, pid=1305, tid=0x7fd7ee7c4700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_131-b11) (build 
1.8.0_131-b11)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode linux-amd64 
compressed oops)
# Problematic frame:
# C  [liblz4-java3580121503903465201.so+0x5e70]  LZ4_decompress_fast+0xd0
#
# Failed to write core dump. Core dumps have been disabled. To enable core 
dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---  T H R E A D  ---

Current thread (0x7fce32dad1b0):  JavaThread "CompactionExecutor:9798" 
daemon [_thread_in_native, id=16879, 
stack(0x7fd7ee784000,0x7fd7ee7c5000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 
0x7fd450c4d000

Registers:
RAX=0x7fcde6560d32, RBX=0x7fd450c4cff9, RCX=0x7fcde6560c7a, 
RDX=0x7fcde6560d3e
RSP=0x7fd7ee7c3160, RBP=0x7fd450c44ae6, RSI=0x7fcde6562ff8, 
RDI=0x00c2
R8 =0x7fcde6562ff4, R9 =0x7fcde6563000, R10=0x, 
R11=0x
R12=0x000c, R13=0x7fd4501cd000, R14=0x7fcde6562ff7, 
R15=0x7fcde6562ffb
RIP=0x7fd80a399e70, EFLAGS=0x00010283, CSGSFS=0x0033, 
ERR=0x0004
  TRAPNO=0x000e

Top of Stack: (sp=0x7fd7ee7c3160)
0x7fd7ee7c3160:   0008 7fd81e21c3d0
0x7fd7ee7c3170:   0004 0001
0x7fd7ee7c3180:   0002 0001
0x7fd7ee7c3190:   0004 0004
0x7fd7ee7c31a0:   0004 0004
0x7fd7ee7c31b0:    
0x7fd7ee7c31c0:    
0x7fd7ee7c31d0:    0001
0x7fd7ee7c31e0:   0002 0003
0x7fd7ee7c31f0:   7fd7ee7c32b8 7fce32dad3a8
0x7fd7ee7c3200:    
0x7fd7ee7c3210:   7fd4501cd000 7fcde6553000
0x7fd7ee7c3220:   00a77ae6 7fd80a39659d
0x7fd7ee7c3230:    dcb8fc9b
0x7fd7ee7c3240:   7fd7ee7c32d0 
0x7fd7ee7c3250:   0006e5c7e4d8 7fd7ee7c32b8
0x7fd7ee7c3260:   7fce32dad1b0 7fd81df2099d
0x7fd7ee7c3270:   7fd7ee7c32a8 
0x7fd7ee7c3280:   0001 
0x7fd7ee7c3290:   0006e5c7e528 7fd81d74df10
0x7fd7ee7c32a0:    0006e5c7e4d8
0x7fd7ee7c32b0:   0006f6c7fbf8 0006f6e957f0
0x7fd7ee7c32c0:   0006e5c7e350 7fd87fff
0x7fd7ee7c32d0:   0006e5c7e528 7fd81fa867e0
0x7fd7ee7c32e0:   00a77ae20001 00a77ae2
0x7fd7ee7c32f0:   0006e5c7e488 0112d5f1
0x7fd7ee7c3300:   dcb8fc9b99ce 000100a77ae6
0x7fd7ee7c3310:   00a814b000a814b4 0006e5c7e4d8
0x7fd7ee7c3320:   0006e5c7e4d8 0006f6a4df38
0x7fd7ee7c3330:   00060001 00067fff
0x7fd7ee7c3340:   008971582c8a 0006189d87852057
0x7fd7ee7c3350:    e5244e71
Instructions: (pc=0x7fd80a399e70)
0x7fd80a399e50:   e4 0f 49 83 fc 0f 0f 84 94 00 00 00 4a 8d 14 20
0x7fd80a399e60:   48 39 f2 0f 87 c0 00 00 00 0f 1f 80 00 00 00 00
0x7fd80a399e70:   48 8b 0b 48 83 c3 08 48 89 08 48 83 c0 08 48 39
0x7fd80a399e80:   c2 77 ed 48 29 d0 48 89 d1 48 29 c3 0f b7 03 48

Register to memory mapping:

RAX=0x7fcde6560d32 is an unknown value
RBX=0x7fd450c4cff9 is an unknown value
RCX=0x7fcde6560c7a is an unknown value
RDX=0x7fcde6560d3e is an unknown value
RSP=0x7fd7ee7c3160 is pointing into the stack for thread: 0x7fce32dad1b0
RBP=0x7fd450c44ae6 is an unknown value
RSI=0x7fcde6562ff8 is an unknown value
RDI=0x00c2 is an unknown value
R8 =0x7fcde6562ff4 is an unknown value
R9 =0x7fcde6563000 is an unknown value
R10=0x is an unknown value
R11=0x is an unknown value
R12=0x000c is an unknown value
R13=0x7fd4501cd000 is an unknown value
R14=0x7fcde6562ff7 is an unknown value
R15=0x7fcde6562ffb is an unknown value


Stack: [0x7fd7ee784000,0x7fd7ee7c5000],  sp=0x7fd7ee7c3160,  free 
space=252k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,