[jira] [Updated] (CASSANDRA-14161) node can't start, java.nio.file.AccessDeniedException to not existent file

[Jeff Jirsa (JIRA)]

     [ 
https://issues.apache.org/jira/browse/CASSANDRA-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeff Jirsa updated CASSANDRA-14161:
-----------------------------------
    Description: 
this exception cuts the node starting:

{code}
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log

{code}

the offending file doesn't exists:

{code}
 ls -la /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/
total 160
drwxr-xr-x  3 cassandra cassandra 4096 ene  7 11:48 .
drwxr-xr-x 26 cassandra cassandra 4096 dic 18 07:30 ..
drwxr-xr-x  2 cassandra cassandra 4096 dic 18 07:30 backups
-rw-r--r--  1 cassandra cassandra   43 ene  7 03:50 
mc-100-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra   52 ene  7 03:50 mc-100-big-Data.db
-rw-r--r--  1 cassandra cassandra    8 ene  7 03:50 mc-100-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  7 03:50 mc-100-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  7 03:50 mc-100-big-Index.db
-rw-r--r--  1 cassandra cassandra 4615 ene  7 03:50 mc-100-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  7 03:50 mc-100-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  7 03:50 mc-100-big-TOC.txt
-rw-r--r--  1 cassandra cassandra   43 ene  7 11:48 
mc-101-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra   50 ene  7 11:48 mc-101-big-Data.db
-rw-r--r--  1 cassandra cassandra   10 ene  7 11:48 mc-101-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  7 11:48 mc-101-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  7 11:48 mc-101-big-Index.db
-rw-r--r--  1 cassandra cassandra 4615 ene  7 11:48 mc-101-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  7 11:48 mc-101-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  7 11:48 mc-101-big-TOC.txt
-rw-r--r--  1 cassandra cassandra   51 ene  6 17:50 mc-98-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra 5226 ene  6 17:50 mc-98-big-Data.db
-rw-r--r--  1 cassandra cassandra   10 ene  6 17:50 mc-98-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  6 17:50 mc-98-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  6 17:50 mc-98-big-Index.db
-rw-r--r--  1 cassandra cassandra 5654 ene  6 17:50 mc-98-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  6 17:50 mc-98-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  6 17:50 mc-98-big-TOC.txt
-rw-r--r--  1 cassandra cassandra   43 ene  7 02:50 mc-99-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra   50 ene  7 02:50 mc-99-big-Data.db
-rw-r--r--  1 cassandra cassandra   10 ene  7 02:50 mc-99-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  7 02:50 mc-99-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  7 02:50 mc-99-big-Index.db
-rw-r--r--  1 cassandra cassandra 4615 ene  7 02:50 mc-99-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  7 02:50 mc-99-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  7 02:50 mc-99-big-TOC.txt
{code}

permissions are ok, everything assigned to cassandra:cassandra

the system.log:

{code}
INFO  [main] 2018-01-10 10:43:29,367 YamlConfigurationLoader.java:89 - 
Configuration location: file:/etc/cassandra/cassandra.yaml
INFO  [main] 2018-01-10 10:43:29,887 Config.java:481 - Node 
configuration:[allocate_tokens_for_keyspace=null; 
authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; 
auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; 
back_pressure_strategy=null; batch_size_fail_threshold_in_kb=500; 
batch_size_warn_threshold_in_kb=50; batchlog_replay_throttle_in_kb=1024; 
broadcast_address=null; broadcast_rpc_address=null; 
buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=10000; 
cdc_enabled=false; cdc_free_space_check_interval_ms=250; 
cdc_raw_directory=null; cdc_total_space_in_mb=0; 
client_encryption_options=<REDACTED>; cluster_name=PAP Cluster; 
column_index_cache_size_in_kb=2; column_index_size_in_kb=64; 
commit_failure_policy=stop; commitlog_compression=null; 
commitlog_directory=/var/lib/cassandra/commitlog; 
commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; 
commitlog_segment_size_in_mb=32; commitlog_sync=periodic; 
commitlog_sync_batch_window_in_ms=NaN; commitlog_sync_period_in_ms=10000; 
commitlog_total_space_in_mb=null; 
compaction_large_partition_warning_threshold_mb=100; 
compaction_throughput_mb_per_sec=16; concurrent_compactors=null; 
concurrent_counter_writes=32; concurrent_materialized_view_writes=32; 
concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; 
counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; 
counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=50000; 
credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; 
credentials_validity_in_ms=2000; cross_node_timeout=false; 
data_file_directories=[Ljava.lang.String;@79ca92b9; disk_access_mode=auto; 
disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; 
disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; 
dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; 
dynamic_snitch_reset_interval_in_ms=600000; 
dynamic_snitch_update_interval_in_ms=100; 
enable_scripted_user_defined_functions=false; 
enable_user_defined_functions=false; 
enable_user_defined_functions_threads=true; encryption_options=null; 
endpoint_snitch=GossipingPropertyFileSnitch; file_cache_size_in_mb=null; 
gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; 
hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; 
hinted_handoff_throttle_in_kb=1024; hints_compression=null; 
hints_directory=null; hints_flush_period_in_ms=10000; 
incremental_backups=false; index_interval=null; 
index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; 
initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; 
inter_dc_tcp_nodelay=false; internode_authenticator=null; 
internode_compression=all; internode_recv_buff_size_in_bytes=0; 
internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; 
key_cache_save_period=14400; key_cache_size_in_mb=null; 
listen_address=192.121.166.40; listen_interface=null; 
listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; 
max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; 
max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; 
max_streaming_retries=3; max_value_size_in_mb=256; 
memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; 
memtable_flush_writers=0; memtable_heap_space_in_mb=null; 
memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; 
native_transport_max_concurrent_connections=-1; 
native_transport_max_concurrent_connections_per_ip=-1; 
native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; 
native_transport_port=9042; native_transport_port_ssl=null; num_tokens=256; 
otc_backlog_expiration_interval_ms=200; 
otc_coalescing_enough_coalesced_messages=8; otc_coalescing_strategy=DISABLED; 
otc_coalescing_window_us=200; 
partitioner=org.apache.cassandra.dht.Murmur3Partitioner; 
permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; 
permissions_validity_in_ms=2000; phi_convict_threshold=8.0; 
prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=100000; 
read_request_timeout_in_ms=100000; 
request_scheduler=org.apache.cassandra.scheduler.NoScheduler; 
request_scheduler_id=null; request_scheduler_options=null; 
request_timeout_in_ms=100000; role_manager=CassandraRoleManager; 
roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; 
roles_validity_in_ms=2000; 
row_cache_class_name=org.apache.cassandra.cache.OHCProvider; 
row_cache_keys_to_save=2147483647; row_cache_save_period=0; 
row_cache_size_in_mb=0; rpc_address=localhost; rpc_interface=null; 
rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; 
rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; 
rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; 
rpc_server_type=sync; saved_caches_directory=/var/lib/cassandra/saved_caches; 
seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=63.142.255.107,37.247.116.68};
 server_encryption_options=<REDACTED>; slow_query_log_timeout_in_ms=500; 
snapshot_before_compaction=false; ssl_storage_port=7071; 
sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; 
start_rpc=false; storage_port=7070; 
stream_throughput_outbound_megabits_per_sec=200; 
streaming_keep_alive_period_in_secs=300; 
streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; 
thrift_max_message_length_in_mb=16; 
thrift_prepared_statements_cache_size_mb=null; 
tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; 
tracetype_query_ttl=86400; tracetype_repair_ttl=604800; 
transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@1460a8c0;
 trickle_fsync=false; trickle_fsync_interval_in_kb=10240; 
truncate_request_timeout_in_ms=600000; 
unlogged_batch_across_partitions_warn_threshold=10; 
user_defined_function_fail_timeout=1500; 
user_defined_function_warn_timeout=500; user_function_timeout_policy=die; 
windows_timer_interval=1; write_request_timeout_in_ms=50000]
INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:367 - 
DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:421 - Global 
memtable on-heap threshold is enabled at 374MB
INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:425 - Global 
memtable off-heap threshold is enabled at 374MB
WARN  [main] 2018-01-10 10:43:29,897 DatabaseDescriptor.java:470 - Small 
commitlog volume detected at /var/lib/cassandra/commitlog; setting 
commitlog_total_space_in_mb to 7680.  You can override this in cassandra.yaml
WARN  [main] 2018-01-10 10:43:29,899 DatabaseDescriptor.java:497 - Small cdc 
volume detected at /var/lib/cassandra/cdc_raw; setting cdc_total_space_in_mb to 
3840.  You can override this in cassandra.yaml
WARN  [main] 2018-01-10 10:43:30,022 DatabaseDescriptor.java:546 - Only 
18.837GiB free across all data volumes. Consider adding more capacity to your 
cluster or removing obsolete snapshots
INFO  [main] 2018-01-10 10:43:30,066 RateBasedBackPressure.java:123 - 
Initialized back-pressure with high ratio: 0.9, factor: 5, flow: FAST, window 
size: 50000.
INFO  [main] 2018-01-10 10:43:30,066 DatabaseDescriptor.java:725 - 
Back-pressure is disabled with strategy null.
INFO  [main] 2018-01-10 10:43:30,250 GossipingPropertyFileSnitch.java:64 - 
Loaded cassandra-topology.properties for compatibility
INFO  [main] 2018-01-10 10:43:30,329 JMXServerUtils.java:249 - Configured JMX 
server at: service:jmx:rmi://127.0.0.1/jndi/rmi://127.0.0.1:7199/jmxrmi
INFO  [main] 2018-01-10 10:43:30,335 CassandraDaemon.java:471 - Hostname: 
uk1.plugandplay.click
INFO  [main] 2018-01-10 10:43:30,335 CassandraDaemon.java:478 - JVM 
vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.8.0_131
INFO  [main] 2018-01-10 10:43:30,336 CassandraDaemon.java:479 - Heap size: 
1.463GiB/1.463GiB
INFO  [main] 2018-01-10 10:43:30,336 CassandraDaemon.java:484 - Code Cache 
Non-heap memory: init = 2555904(2496K) used = 4545344(4438K) committed = 
4587520(4480K) max = 251658240(245760K)
INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Metaspace 
Non-heap memory: init = 0(0K) used = 19068664(18621K) committed = 
19791872(19328K) max = -1(-1K)
INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Compressed 
Class Space Non-heap memory: init = 0(0K) used = 2353456(2298K) committed = 
2490368(2432K) max = 1073741824(1048576K)
INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Par Eden Space 
Heap memory: init = 322174976(314624K) used = 109586656(107018K) committed = 
322174976(314624K) max = 322174976(314624K)
INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:484 - Par Survivor 
Space Heap memory: init = 40239104(39296K) used = 0(0K) committed = 
40239104(39296K) max = 40239104(39296K)
INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:484 - CMS Old Gen 
Heap memory: init = 1207959552(1179648K) used = 0(0K) committed = 
1207959552(1179648K) max = 1207959552(1179648K)
INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:486 - Classpath: 
/etc/cassandra:/usr/share/cassandra/lib/HdrHistogram-2.1.9.jar:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/caffeine-2.2.6.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.1-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.9.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrent-trees-2.4.0.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/hppc-0.5.4.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jctools-core-1.2.1.jar:/usr/share/cassandra/lib/jflex-1.6.0.jar:/usr/share/cassandra/lib/jna-4.2.2.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/jstackjunit-0.0.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-jvm-3.1.0.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.44.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.4.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.4.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.3.jar:/usr/share/cassandra/lib/reporter-config3-3.0.3.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/snowball-stemmer-1.3.0.581.1.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.11.1.jar:/usr/share/cassandra/apache-cassandra-thrift-3.11.1.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar::/usr/share/cassandra/lib/jamm-0.3.0.jar
INFO  [main] 2018-01-10 10:43:30,339 CassandraDaemon.java:488 - JVM Arguments: 
[-Xloggc:/var/log/cassandra/gc.log, -ea, -XX:+UseThreadPriorities, 
-XX:ThreadPriorityPolicy=42, -XX:+HeapDumpOnOutOfMemoryError, -Xss256k, 
-XX:StringTableSize=1000003, -XX:+AlwaysPreTouch, -XX:-UseBiasedLocking, 
-XX:+UseTLAB, -XX:+ResizeTLAB, -XX:+UseNUMA, -XX:+PerfDisableSharedMem, 
-Djava.net.preferIPv4Stack=true, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, 
-XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, 
-XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, 
-XX:CMSWaitDuration=10000, -XX:+CMSParallelInitialMarkEnabled, 
-XX:+CMSEdenChunksRecordAlways, -XX:+CMSClassUnloadingEnabled, 
-XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintHeapAtGC, 
-XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, 
-XX:+PrintPromotionFailure, -XX:+UseGCLogFileRotation, 
-XX:NumberOfGCLogFiles=10, -XX:GCLogFileSize=10M, -Xms1536M, -Xmx1536M, 
-Xmn384M, -XX:+UseCondCardMark, 
-XX:CompileCommandFile=/etc/cassandra/hotspot_compiler, 
-javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar, 
-Dcassandra.jmx.local.port=7199, 
-Dcom.sun.management.jmxremote.authenticate=false, 
-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password, 
-Djava.library.path=/usr/share/cassandra/lib/sigar-bin, 
-Dlogback.configurationFile=logback.xml, -Dcassandra.logdir=/var/log/cassandra, 
-Dcassandra.storagedir=/var/lib/cassandra, 
-Dcassandra-pidfile=/var/run/cassandra/cassandra.pid, 
-XX:HeapDumpPath=/var/lib/cassandra/java_1515602606.hprof, 
-XX:ErrorFile=/var/lib/cassandra/hs_err_1515602606.log]
INFO  [main] 2018-01-10 10:43:30,598 NativeLibrary.java:174 - JNA mlockall 
successful
WARN  [main] 2018-01-10 10:43:30,599 StartupChecks.java:133 - jemalloc shared 
library could not be preloaded to speed up memory allocations
WARN  [main] 2018-01-10 10:43:30,599 StartupChecks.java:166 - JMX is not 
enabled to receive remote connections. Please see cassandra-env.sh for more 
info.
INFO  [main] 2018-01-10 10:43:30,601 SigarLibrary.java:44 - Initializing SIGAR 
library
INFO  [main] 2018-01-10 10:43:30,614 SigarLibrary.java:180 - Checked OS 
settings and found them configured for optimal performance.
WARN  [main] 2018-01-10 10:43:30,619 StartupChecks.java:271 - Maximum number of 
memory map areas per process (vm.max_map_count) 65530 is too low, recommended 
value: 1048575, you can change it with sysctl.
INFO  [main] 2018-01-10 10:43:30,975 QueryProcessor.java:116 - Initialized 
prepared statement caches with 10 MB (native) and 10 MB (Thrift)
INFO  [main] 2018-01-10 10:43:31,541 ColumnFamilyStore.java:408 - Initializing 
system.IndexInfo
INFO  [SSTableBatchOpen:1] 2018-01-10 10:43:32,405 BufferPool.java:230 - Global 
buffer pool is enabled, when pool is exhausted (max is 374.000MiB) it will 
allocate on heap
INFO  [main] 2018-01-10 10:43:32,653 CacheService.java:112 - Initializing key 
cache with capacity of 74 MBs.
INFO  [main] 2018-01-10 10:43:32,662 CacheService.java:134 - Initializing row 
cache with capacity of 0 MBs
INFO  [main] 2018-01-10 10:43:32,664 CacheService.java:163 - Initializing 
counter cache with capacity of 37 MBs
INFO  [main] 2018-01-10 10:43:32,666 CacheService.java:174 - Scheduling counter 
cache save to every 7200 seconds (going to save all keys).
INFO  [main] 2018-01-10 10:43:32,720 ColumnFamilyStore.java:408 - Initializing 
system.batches
INFO  [main] 2018-01-10 10:43:32,747 ColumnFamilyStore.java:408 - Initializing 
system.paxos
INFO  [main] 2018-01-10 10:43:32,763 ColumnFamilyStore.java:408 - Initializing 
system.local
INFO  [main] 2018-01-10 10:43:32,791 ColumnFamilyStore.java:408 - Initializing 
system.peers
INFO  [main] 2018-01-10 10:43:32,814 ColumnFamilyStore.java:408 - Initializing 
system.peer_events
INFO  [main] 2018-01-10 10:43:32,821 ColumnFamilyStore.java:408 - Initializing 
system.range_xfers
INFO  [main] 2018-01-10 10:43:32,830 ColumnFamilyStore.java:408 - Initializing 
system.compaction_history
INFO  [main] 2018-01-10 10:43:32,852 ColumnFamilyStore.java:408 - Initializing 
system.sstable_activity
INFO  [main] 2018-01-10 10:43:32,977 ColumnFamilyStore.java:408 - Initializing 
system.size_estimates
INFO  [main] 2018-01-10 10:43:32,992 ColumnFamilyStore.java:408 - Initializing 
system.available_ranges
INFO  [main] 2018-01-10 10:43:33,002 ColumnFamilyStore.java:408 - Initializing 
system.transferred_ranges
INFO  [main] 2018-01-10 10:43:33,008 ColumnFamilyStore.java:408 - Initializing 
system.views_builds_in_progress
INFO  [main] 2018-01-10 10:43:33,014 ColumnFamilyStore.java:408 - Initializing 
system.built_views
INFO  [main] 2018-01-10 10:43:33,021 ColumnFamilyStore.java:408 - Initializing 
system.hints
INFO  [main] 2018-01-10 10:43:33,028 ColumnFamilyStore.java:408 - Initializing 
system.batchlog
INFO  [main] 2018-01-10 10:43:33,036 ColumnFamilyStore.java:408 - Initializing 
system.prepared_statements
INFO  [main] 2018-01-10 10:43:33,049 ColumnFamilyStore.java:408 - Initializing 
system.schema_keyspaces
INFO  [main] 2018-01-10 10:43:33,055 ColumnFamilyStore.java:408 - Initializing 
system.schema_columnfamilies
INFO  [main] 2018-01-10 10:43:33,062 ColumnFamilyStore.java:408 - Initializing 
system.schema_columns
INFO  [main] 2018-01-10 10:43:33,068 ColumnFamilyStore.java:408 - Initializing 
system.schema_triggers
INFO  [main] 2018-01-10 10:43:33,074 ColumnFamilyStore.java:408 - Initializing 
system.schema_usertypes
INFO  [main] 2018-01-10 10:43:33,081 ColumnFamilyStore.java:408 - Initializing 
system.schema_functions
INFO  [main] 2018-01-10 10:43:33,088 ColumnFamilyStore.java:408 - Initializing 
system.schema_aggregates
INFO  [main] 2018-01-10 10:43:33,090 ViewManager.java:137 - Not submitting 
build tasks for views in keyspace system as storage service is not initialized
INFO  [main] 2018-01-10 10:43:33,250 ApproximateTime.java:44 - Scheduling 
approximate time-check task with a precision of 10 milliseconds
INFO  [main] 2018-01-10 10:43:33,307 ColumnFamilyStore.java:408 - Initializing 
system_schema.keyspaces
INFO  [main] 2018-01-10 10:43:33,322 ColumnFamilyStore.java:408 - Initializing 
system_schema.tables
INFO  [main] 2018-01-10 10:43:33,336 ColumnFamilyStore.java:408 - Initializing 
system_schema.columns
INFO  [main] 2018-01-10 10:43:33,347 ColumnFamilyStore.java:408 - Initializing 
system_schema.triggers
INFO  [main] 2018-01-10 10:43:33,353 ColumnFamilyStore.java:408 - Initializing 
system_schema.dropped_columns
INFO  [main] 2018-01-10 10:43:33,359 ColumnFamilyStore.java:408 - Initializing 
system_schema.views
INFO  [main] 2018-01-10 10:43:33,364 ColumnFamilyStore.java:408 - Initializing 
system_schema.types
INFO  [main] 2018-01-10 10:43:33,370 ColumnFamilyStore.java:408 - Initializing 
system_schema.functions
INFO  [main] 2018-01-10 10:43:33,376 ColumnFamilyStore.java:408 - Initializing 
system_schema.aggregates
INFO  [main] 2018-01-10 10:43:33,382 ColumnFamilyStore.java:408 - Initializing 
system_schema.indexes
INFO  [main] 2018-01-10 10:43:33,388 ViewManager.java:137 - Not submitting 
build tasks for views in keyspace system_schema as storage service is not 
initialized
ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,507 LogTransaction.java:273 - 
Transaction log [mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log in 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377] 
indicates txn was not completed, trying to abort it now
ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,512 LogTransaction.java:276 - 
Failed to abort transaction log 
[mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log in 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377]
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction$TransactionTidier.run(LogTransaction.java:274)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction$TransactionTidier.tidy(LogTransaction.java:258)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Ref$GlobalState.release(Ref.java:321) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Ref$State.ensureReleased(Ref.java:199) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Ref.ensureReleased(Ref.java:119) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.complete(LogTransaction.java:393)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
[na:1.8.0_131]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_131]
        at 
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
 ~[na:1.8.0_131]
        at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
 ~[na:1.8.0_131]
        at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
        at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 27 common frames omitted
ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,515 LogTransaction.java:223 - 
Unable to delete 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
 as it does not exist, see debug log file for stack trace
ERROR [MemtablePostFlush:1] 2018-01-10 10:43:33,520 CassandraDaemon.java:228 - 
Exception in thread Thread[MemtablePostFlush:1,5,main]
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:285) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.trackNew(LogTransaction.java:136)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.trackNew(LifecycleTransaction.java:529)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigTableWriter.<init>(BigTableWriter.java:81)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigFormat$WriterFactory.open(BigFormat.java:92)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.SSTableWriter.create(SSTableWriter.java:102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.create(SimpleSSTableMultiWriter.java:119)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.createSSTableMultiWriter(AbstractCompactionStrategy.java:587)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.CompactionStrategyManager.createSSTableMultiWriter(CompactionStrategyManager.java:920)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.createSSTableMultiWriter(ColumnFamilyStore.java:515)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.createFlushWriter(Memtable.java:509)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:448) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:425) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.Memtable.flushRunnables(Memtable.java:303) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_131]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_131]
        at 
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
        Suppressed: java.lang.RuntimeException: 
java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                ... 5 common frames omitted
        Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
                at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
                at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
                at java.nio.file.Files.newOutputStream(Files.java:216)
                at java.nio.file.Files.write(Files.java:3351)
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583)
                ... 21 common frames omitted
Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
 ~[na:1.8.0_131]
        at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
 ~[na:1.8.0_131]
        at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
        at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 27 common frames omitted
ERROR [main] 2018-01-10 10:43:33,522 CassandraDaemon.java:706 - Exception 
encountered during startup
java.lang.RuntimeException: java.util.concurrent.ExecutionException: 
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:404) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.SystemKeyspace.forceBlockingFlush(SystemKeyspace.java:819)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.SystemKeyspace.removeTruncationRecord(SystemKeyspace.java:670)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:550)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:526)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.schema.LegacySchemaMigrator.lambda$unloadLegacySchemaTables$1(LegacySchemaMigrator.java:137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Iterable.forEach(Iterable.java:75) ~[na:1.8.0_131]
        at 
org.apache.cassandra.schema.LegacySchemaMigrator.unloadLegacySchemaTables(LegacySchemaMigrator.java:137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.schema.LegacySchemaMigrator.migrate(LegacySchemaMigrator.java:83)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:256) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:600) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:689) 
[apache-cassandra-3.11.1.jar:3.11.1]
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: 
java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at java.util.concurrent.FutureTask.report(FutureTask.java:122) 
~[na:1.8.0_131]
        at java.util.concurrent.FutureTask.get(FutureTask.java:192) 
~[na:1.8.0_131]
        at 
org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:400) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 11 common frames omitted
Caused by: java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:285) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.trackNew(LogTransaction.java:136)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.trackNew(LifecycleTransaction.java:529)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigTableWriter.<init>(BigTableWriter.java:81)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigFormat$WriterFactory.open(BigFormat.java:92)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.SSTableWriter.create(SSTableWriter.java:102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.create(SimpleSSTableMultiWriter.java:119)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.createSSTableMultiWriter(AbstractCompactionStrategy.java:587)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.CompactionStrategyManager.createSSTableMultiWriter(CompactionStrategyManager.java:920)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.createSSTableMultiWriter(ColumnFamilyStore.java:515)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.createFlushWriter(Memtable.java:509)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:448) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:425) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.Memtable.flushRunnables(Memtable.java:303) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_131]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
~[na:1.8.0_131]
        at 
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
        Suppressed: java.lang.RuntimeException: 
java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                ... 5 common frames omitted
        Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
                at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
                at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
                at java.nio.file.Files.newOutputStream(Files.java:216)
                at java.nio.file.Files.write(Files.java:3351)
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583)
                ... 21 common frames omitted
Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
 ~[na:1.8.0_131]
        at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
 ~[na:1.8.0_131]
        at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
        at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 27 common frames omitted
{code}

  was:
this exception cuts the node starting:

{code}
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
the offending file doesn't exists:
 ls -la /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/
total 160
drwxr-xr-x  3 cassandra cassandra 4096 ene  7 11:48 .
drwxr-xr-x 26 cassandra cassandra 4096 dic 18 07:30 ..
drwxr-xr-x  2 cassandra cassandra 4096 dic 18 07:30 backups
-rw-r--r--  1 cassandra cassandra   43 ene  7 03:50 
mc-100-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra   52 ene  7 03:50 mc-100-big-Data.db
-rw-r--r--  1 cassandra cassandra    8 ene  7 03:50 mc-100-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  7 03:50 mc-100-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  7 03:50 mc-100-big-Index.db
-rw-r--r--  1 cassandra cassandra 4615 ene  7 03:50 mc-100-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  7 03:50 mc-100-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  7 03:50 mc-100-big-TOC.txt
-rw-r--r--  1 cassandra cassandra   43 ene  7 11:48 
mc-101-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra   50 ene  7 11:48 mc-101-big-Data.db
-rw-r--r--  1 cassandra cassandra   10 ene  7 11:48 mc-101-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  7 11:48 mc-101-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  7 11:48 mc-101-big-Index.db
-rw-r--r--  1 cassandra cassandra 4615 ene  7 11:48 mc-101-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  7 11:48 mc-101-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  7 11:48 mc-101-big-TOC.txt
-rw-r--r--  1 cassandra cassandra   51 ene  6 17:50 mc-98-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra 5226 ene  6 17:50 mc-98-big-Data.db
-rw-r--r--  1 cassandra cassandra   10 ene  6 17:50 mc-98-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  6 17:50 mc-98-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  6 17:50 mc-98-big-Index.db
-rw-r--r--  1 cassandra cassandra 5654 ene  6 17:50 mc-98-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  6 17:50 mc-98-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  6 17:50 mc-98-big-TOC.txt
-rw-r--r--  1 cassandra cassandra   43 ene  7 02:50 mc-99-big-CompressionInfo.db
-rw-r--r--  1 cassandra cassandra   50 ene  7 02:50 mc-99-big-Data.db
-rw-r--r--  1 cassandra cassandra   10 ene  7 02:50 mc-99-big-Digest.crc32
-rw-r--r--  1 cassandra cassandra   16 ene  7 02:50 mc-99-big-Filter.db
-rw-r--r--  1 cassandra cassandra    9 ene  7 02:50 mc-99-big-Index.db
-rw-r--r--  1 cassandra cassandra 4615 ene  7 02:50 mc-99-big-Statistics.db
-rw-r--r--  1 cassandra cassandra   59 ene  7 02:50 mc-99-big-Summary.db
-rw-r--r--  1 cassandra cassandra   92 ene  7 02:50 mc-99-big-TOC.txt
{code}

permissions are ok, everything assigned to cassandra:cassandra

the system.log:

{code}
INFO  [main] 2018-01-10 10:43:29,367 YamlConfigurationLoader.java:89 - 
Configuration location: file:/etc/cassandra/cassandra.yaml
INFO  [main] 2018-01-10 10:43:29,887 Config.java:481 - Node 
configuration:[allocate_tokens_for_keyspace=null; 
authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; 
auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; 
back_pressure_strategy=null; batch_size_fail_threshold_in_kb=500; 
batch_size_warn_threshold_in_kb=50; batchlog_replay_throttle_in_kb=1024; 
broadcast_address=null; broadcast_rpc_address=null; 
buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=10000; 
cdc_enabled=false; cdc_free_space_check_interval_ms=250; 
cdc_raw_directory=null; cdc_total_space_in_mb=0; 
client_encryption_options=<REDACTED>; cluster_name=PAP Cluster; 
column_index_cache_size_in_kb=2; column_index_size_in_kb=64; 
commit_failure_policy=stop; commitlog_compression=null; 
commitlog_directory=/var/lib/cassandra/commitlog; 
commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; 
commitlog_segment_size_in_mb=32; commitlog_sync=periodic; 
commitlog_sync_batch_window_in_ms=NaN; commitlog_sync_period_in_ms=10000; 
commitlog_total_space_in_mb=null; 
compaction_large_partition_warning_threshold_mb=100; 
compaction_throughput_mb_per_sec=16; concurrent_compactors=null; 
concurrent_counter_writes=32; concurrent_materialized_view_writes=32; 
concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; 
counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; 
counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=50000; 
credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; 
credentials_validity_in_ms=2000; cross_node_timeout=false; 
data_file_directories=[Ljava.lang.String;@79ca92b9; disk_access_mode=auto; 
disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; 
disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; 
dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; 
dynamic_snitch_reset_interval_in_ms=600000; 
dynamic_snitch_update_interval_in_ms=100; 
enable_scripted_user_defined_functions=false; 
enable_user_defined_functions=false; 
enable_user_defined_functions_threads=true; encryption_options=null; 
endpoint_snitch=GossipingPropertyFileSnitch; file_cache_size_in_mb=null; 
gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; 
hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; 
hinted_handoff_throttle_in_kb=1024; hints_compression=null; 
hints_directory=null; hints_flush_period_in_ms=10000; 
incremental_backups=false; index_interval=null; 
index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; 
initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; 
inter_dc_tcp_nodelay=false; internode_authenticator=null; 
internode_compression=all; internode_recv_buff_size_in_bytes=0; 
internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; 
key_cache_save_period=14400; key_cache_size_in_mb=null; 
listen_address=192.121.166.40; listen_interface=null; 
listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; 
max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; 
max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; 
max_streaming_retries=3; max_value_size_in_mb=256; 
memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; 
memtable_flush_writers=0; memtable_heap_space_in_mb=null; 
memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; 
native_transport_max_concurrent_connections=-1; 
native_transport_max_concurrent_connections_per_ip=-1; 
native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; 
native_transport_port=9042; native_transport_port_ssl=null; num_tokens=256; 
otc_backlog_expiration_interval_ms=200; 
otc_coalescing_enough_coalesced_messages=8; otc_coalescing_strategy=DISABLED; 
otc_coalescing_window_us=200; 
partitioner=org.apache.cassandra.dht.Murmur3Partitioner; 
permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; 
permissions_validity_in_ms=2000; phi_convict_threshold=8.0; 
prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=100000; 
read_request_timeout_in_ms=100000; 
request_scheduler=org.apache.cassandra.scheduler.NoScheduler; 
request_scheduler_id=null; request_scheduler_options=null; 
request_timeout_in_ms=100000; role_manager=CassandraRoleManager; 
roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; 
roles_validity_in_ms=2000; 
row_cache_class_name=org.apache.cassandra.cache.OHCProvider; 
row_cache_keys_to_save=2147483647; row_cache_save_period=0; 
row_cache_size_in_mb=0; rpc_address=localhost; rpc_interface=null; 
rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; 
rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; 
rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; 
rpc_server_type=sync; saved_caches_directory=/var/lib/cassandra/saved_caches; 
seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=63.142.255.107,37.247.116.68};
 server_encryption_options=<REDACTED>; slow_query_log_timeout_in_ms=500; 
snapshot_before_compaction=false; ssl_storage_port=7071; 
sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; 
start_rpc=false; storage_port=7070; 
stream_throughput_outbound_megabits_per_sec=200; 
streaming_keep_alive_period_in_secs=300; 
streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; 
thrift_max_message_length_in_mb=16; 
thrift_prepared_statements_cache_size_mb=null; 
tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; 
tracetype_query_ttl=86400; tracetype_repair_ttl=604800; 
transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@1460a8c0;
 trickle_fsync=false; trickle_fsync_interval_in_kb=10240; 
truncate_request_timeout_in_ms=600000; 
unlogged_batch_across_partitions_warn_threshold=10; 
user_defined_function_fail_timeout=1500; 
user_defined_function_warn_timeout=500; user_function_timeout_policy=die; 
windows_timer_interval=1; write_request_timeout_in_ms=50000]
INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:367 - 
DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:421 - Global 
memtable on-heap threshold is enabled at 374MB
INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:425 - Global 
memtable off-heap threshold is enabled at 374MB
WARN  [main] 2018-01-10 10:43:29,897 DatabaseDescriptor.java:470 - Small 
commitlog volume detected at /var/lib/cassandra/commitlog; setting 
commitlog_total_space_in_mb to 7680.  You can override this in cassandra.yaml
WARN  [main] 2018-01-10 10:43:29,899 DatabaseDescriptor.java:497 - Small cdc 
volume detected at /var/lib/cassandra/cdc_raw; setting cdc_total_space_in_mb to 
3840.  You can override this in cassandra.yaml
WARN  [main] 2018-01-10 10:43:30,022 DatabaseDescriptor.java:546 - Only 
18.837GiB free across all data volumes. Consider adding more capacity to your 
cluster or removing obsolete snapshots
INFO  [main] 2018-01-10 10:43:30,066 RateBasedBackPressure.java:123 - 
Initialized back-pressure with high ratio: 0.9, factor: 5, flow: FAST, window 
size: 50000.
INFO  [main] 2018-01-10 10:43:30,066 DatabaseDescriptor.java:725 - 
Back-pressure is disabled with strategy null.
INFO  [main] 2018-01-10 10:43:30,250 GossipingPropertyFileSnitch.java:64 - 
Loaded cassandra-topology.properties for compatibility
INFO  [main] 2018-01-10 10:43:30,329 JMXServerUtils.java:249 - Configured JMX 
server at: service:jmx:rmi://127.0.0.1/jndi/rmi://127.0.0.1:7199/jmxrmi
INFO  [main] 2018-01-10 10:43:30,335 CassandraDaemon.java:471 - Hostname: 
uk1.plugandplay.click
INFO  [main] 2018-01-10 10:43:30,335 CassandraDaemon.java:478 - JVM 
vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.8.0_131
INFO  [main] 2018-01-10 10:43:30,336 CassandraDaemon.java:479 - Heap size: 
1.463GiB/1.463GiB
INFO  [main] 2018-01-10 10:43:30,336 CassandraDaemon.java:484 - Code Cache 
Non-heap memory: init = 2555904(2496K) used = 4545344(4438K) committed = 
4587520(4480K) max = 251658240(245760K)
INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Metaspace 
Non-heap memory: init = 0(0K) used = 19068664(18621K) committed = 
19791872(19328K) max = -1(-1K)
INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Compressed 
Class Space Non-heap memory: init = 0(0K) used = 2353456(2298K) committed = 
2490368(2432K) max = 1073741824(1048576K)
INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Par Eden Space 
Heap memory: init = 322174976(314624K) used = 109586656(107018K) committed = 
322174976(314624K) max = 322174976(314624K)
INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:484 - Par Survivor 
Space Heap memory: init = 40239104(39296K) used = 0(0K) committed = 
40239104(39296K) max = 40239104(39296K)
INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:484 - CMS Old Gen 
Heap memory: init = 1207959552(1179648K) used = 0(0K) committed = 
1207959552(1179648K) max = 1207959552(1179648K)
INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:486 - Classpath: 
/etc/cassandra:/usr/share/cassandra/lib/HdrHistogram-2.1.9.jar:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/caffeine-2.2.6.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.1-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.9.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrent-trees-2.4.0.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/hppc-0.5.4.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jctools-core-1.2.1.jar:/usr/share/cassandra/lib/jflex-1.6.0.jar:/usr/share/cassandra/lib/jna-4.2.2.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/jstackjunit-0.0.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-jvm-3.1.0.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.44.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.4.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.4.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.3.jar:/usr/share/cassandra/lib/reporter-config3-3.0.3.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/snowball-stemmer-1.3.0.581.1.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.11.1.jar:/usr/share/cassandra/apache-cassandra-thrift-3.11.1.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar::/usr/share/cassandra/lib/jamm-0.3.0.jar
INFO  [main] 2018-01-10 10:43:30,339 CassandraDaemon.java:488 - JVM Arguments: 
[-Xloggc:/var/log/cassandra/gc.log, -ea, -XX:+UseThreadPriorities, 
-XX:ThreadPriorityPolicy=42, -XX:+HeapDumpOnOutOfMemoryError, -Xss256k, 
-XX:StringTableSize=1000003, -XX:+AlwaysPreTouch, -XX:-UseBiasedLocking, 
-XX:+UseTLAB, -XX:+ResizeTLAB, -XX:+UseNUMA, -XX:+PerfDisableSharedMem, 
-Djava.net.preferIPv4Stack=true, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, 
-XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, 
-XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, 
-XX:CMSWaitDuration=10000, -XX:+CMSParallelInitialMarkEnabled, 
-XX:+CMSEdenChunksRecordAlways, -XX:+CMSClassUnloadingEnabled, 
-XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintHeapAtGC, 
-XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, 
-XX:+PrintPromotionFailure, -XX:+UseGCLogFileRotation, 
-XX:NumberOfGCLogFiles=10, -XX:GCLogFileSize=10M, -Xms1536M, -Xmx1536M, 
-Xmn384M, -XX:+UseCondCardMark, 
-XX:CompileCommandFile=/etc/cassandra/hotspot_compiler, 
-javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar, 
-Dcassandra.jmx.local.port=7199, 
-Dcom.sun.management.jmxremote.authenticate=false, 
-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password, 
-Djava.library.path=/usr/share/cassandra/lib/sigar-bin, 
-Dlogback.configurationFile=logback.xml, -Dcassandra.logdir=/var/log/cassandra, 
-Dcassandra.storagedir=/var/lib/cassandra, 
-Dcassandra-pidfile=/var/run/cassandra/cassandra.pid, 
-XX:HeapDumpPath=/var/lib/cassandra/java_1515602606.hprof, 
-XX:ErrorFile=/var/lib/cassandra/hs_err_1515602606.log]
INFO  [main] 2018-01-10 10:43:30,598 NativeLibrary.java:174 - JNA mlockall 
successful
WARN  [main] 2018-01-10 10:43:30,599 StartupChecks.java:133 - jemalloc shared 
library could not be preloaded to speed up memory allocations
WARN  [main] 2018-01-10 10:43:30,599 StartupChecks.java:166 - JMX is not 
enabled to receive remote connections. Please see cassandra-env.sh for more 
info.
INFO  [main] 2018-01-10 10:43:30,601 SigarLibrary.java:44 - Initializing SIGAR 
library
INFO  [main] 2018-01-10 10:43:30,614 SigarLibrary.java:180 - Checked OS 
settings and found them configured for optimal performance.
WARN  [main] 2018-01-10 10:43:30,619 StartupChecks.java:271 - Maximum number of 
memory map areas per process (vm.max_map_count) 65530 is too low, recommended 
value: 1048575, you can change it with sysctl.
INFO  [main] 2018-01-10 10:43:30,975 QueryProcessor.java:116 - Initialized 
prepared statement caches with 10 MB (native) and 10 MB (Thrift)
INFO  [main] 2018-01-10 10:43:31,541 ColumnFamilyStore.java:408 - Initializing 
system.IndexInfo
INFO  [SSTableBatchOpen:1] 2018-01-10 10:43:32,405 BufferPool.java:230 - Global 
buffer pool is enabled, when pool is exhausted (max is 374.000MiB) it will 
allocate on heap
INFO  [main] 2018-01-10 10:43:32,653 CacheService.java:112 - Initializing key 
cache with capacity of 74 MBs.
INFO  [main] 2018-01-10 10:43:32,662 CacheService.java:134 - Initializing row 
cache with capacity of 0 MBs
INFO  [main] 2018-01-10 10:43:32,664 CacheService.java:163 - Initializing 
counter cache with capacity of 37 MBs
INFO  [main] 2018-01-10 10:43:32,666 CacheService.java:174 - Scheduling counter 
cache save to every 7200 seconds (going to save all keys).
INFO  [main] 2018-01-10 10:43:32,720 ColumnFamilyStore.java:408 - Initializing 
system.batches
INFO  [main] 2018-01-10 10:43:32,747 ColumnFamilyStore.java:408 - Initializing 
system.paxos
INFO  [main] 2018-01-10 10:43:32,763 ColumnFamilyStore.java:408 - Initializing 
system.local
INFO  [main] 2018-01-10 10:43:32,791 ColumnFamilyStore.java:408 - Initializing 
system.peers
INFO  [main] 2018-01-10 10:43:32,814 ColumnFamilyStore.java:408 - Initializing 
system.peer_events
INFO  [main] 2018-01-10 10:43:32,821 ColumnFamilyStore.java:408 - Initializing 
system.range_xfers
INFO  [main] 2018-01-10 10:43:32,830 ColumnFamilyStore.java:408 - Initializing 
system.compaction_history
INFO  [main] 2018-01-10 10:43:32,852 ColumnFamilyStore.java:408 - Initializing 
system.sstable_activity
INFO  [main] 2018-01-10 10:43:32,977 ColumnFamilyStore.java:408 - Initializing 
system.size_estimates
INFO  [main] 2018-01-10 10:43:32,992 ColumnFamilyStore.java:408 - Initializing 
system.available_ranges
INFO  [main] 2018-01-10 10:43:33,002 ColumnFamilyStore.java:408 - Initializing 
system.transferred_ranges
INFO  [main] 2018-01-10 10:43:33,008 ColumnFamilyStore.java:408 - Initializing 
system.views_builds_in_progress
INFO  [main] 2018-01-10 10:43:33,014 ColumnFamilyStore.java:408 - Initializing 
system.built_views
INFO  [main] 2018-01-10 10:43:33,021 ColumnFamilyStore.java:408 - Initializing 
system.hints
INFO  [main] 2018-01-10 10:43:33,028 ColumnFamilyStore.java:408 - Initializing 
system.batchlog
INFO  [main] 2018-01-10 10:43:33,036 ColumnFamilyStore.java:408 - Initializing 
system.prepared_statements
INFO  [main] 2018-01-10 10:43:33,049 ColumnFamilyStore.java:408 - Initializing 
system.schema_keyspaces
INFO  [main] 2018-01-10 10:43:33,055 ColumnFamilyStore.java:408 - Initializing 
system.schema_columnfamilies
INFO  [main] 2018-01-10 10:43:33,062 ColumnFamilyStore.java:408 - Initializing 
system.schema_columns
INFO  [main] 2018-01-10 10:43:33,068 ColumnFamilyStore.java:408 - Initializing 
system.schema_triggers
INFO  [main] 2018-01-10 10:43:33,074 ColumnFamilyStore.java:408 - Initializing 
system.schema_usertypes
INFO  [main] 2018-01-10 10:43:33,081 ColumnFamilyStore.java:408 - Initializing 
system.schema_functions
INFO  [main] 2018-01-10 10:43:33,088 ColumnFamilyStore.java:408 - Initializing 
system.schema_aggregates
INFO  [main] 2018-01-10 10:43:33,090 ViewManager.java:137 - Not submitting 
build tasks for views in keyspace system as storage service is not initialized
INFO  [main] 2018-01-10 10:43:33,250 ApproximateTime.java:44 - Scheduling 
approximate time-check task with a precision of 10 milliseconds
INFO  [main] 2018-01-10 10:43:33,307 ColumnFamilyStore.java:408 - Initializing 
system_schema.keyspaces
INFO  [main] 2018-01-10 10:43:33,322 ColumnFamilyStore.java:408 - Initializing 
system_schema.tables
INFO  [main] 2018-01-10 10:43:33,336 ColumnFamilyStore.java:408 - Initializing 
system_schema.columns
INFO  [main] 2018-01-10 10:43:33,347 ColumnFamilyStore.java:408 - Initializing 
system_schema.triggers
INFO  [main] 2018-01-10 10:43:33,353 ColumnFamilyStore.java:408 - Initializing 
system_schema.dropped_columns
INFO  [main] 2018-01-10 10:43:33,359 ColumnFamilyStore.java:408 - Initializing 
system_schema.views
INFO  [main] 2018-01-10 10:43:33,364 ColumnFamilyStore.java:408 - Initializing 
system_schema.types
INFO  [main] 2018-01-10 10:43:33,370 ColumnFamilyStore.java:408 - Initializing 
system_schema.functions
INFO  [main] 2018-01-10 10:43:33,376 ColumnFamilyStore.java:408 - Initializing 
system_schema.aggregates
INFO  [main] 2018-01-10 10:43:33,382 ColumnFamilyStore.java:408 - Initializing 
system_schema.indexes
INFO  [main] 2018-01-10 10:43:33,388 ViewManager.java:137 - Not submitting 
build tasks for views in keyspace system_schema as storage service is not 
initialized
ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,507 LogTransaction.java:273 - 
Transaction log [mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log in 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377] 
indicates txn was not completed, trying to abort it now
ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,512 LogTransaction.java:276 - 
Failed to abort transaction log 
[mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log in 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377]
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction$TransactionTidier.run(LogTransaction.java:274)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction$TransactionTidier.tidy(LogTransaction.java:258)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Ref$GlobalState.release(Ref.java:321) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Ref$State.ensureReleased(Ref.java:199) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Ref.ensureReleased(Ref.java:119) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.complete(LogTransaction.java:393)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
[na:1.8.0_131]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_131]
        at 
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
 ~[na:1.8.0_131]
        at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
 ~[na:1.8.0_131]
        at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
        at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 27 common frames omitted
ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,515 LogTransaction.java:223 - 
Unable to delete 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
 as it does not exist, see debug log file for stack trace
ERROR [MemtablePostFlush:1] 2018-01-10 10:43:33,520 CassandraDaemon.java:228 - 
Exception in thread Thread[MemtablePostFlush:1,5,main]
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:285) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.trackNew(LogTransaction.java:136)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.trackNew(LifecycleTransaction.java:529)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigTableWriter.<init>(BigTableWriter.java:81)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigFormat$WriterFactory.open(BigFormat.java:92)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.SSTableWriter.create(SSTableWriter.java:102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.create(SimpleSSTableMultiWriter.java:119)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.createSSTableMultiWriter(AbstractCompactionStrategy.java:587)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.CompactionStrategyManager.createSSTableMultiWriter(CompactionStrategyManager.java:920)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.createSSTableMultiWriter(ColumnFamilyStore.java:515)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.createFlushWriter(Memtable.java:509)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:448) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:425) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.Memtable.flushRunnables(Memtable.java:303) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_131]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_131]
        at 
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
        Suppressed: java.lang.RuntimeException: 
java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                ... 5 common frames omitted
        Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
                at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
                at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
                at java.nio.file.Files.newOutputStream(Files.java:216)
                at java.nio.file.Files.write(Files.java:3351)
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583)
                ... 21 common frames omitted
Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
 ~[na:1.8.0_131]
        at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
 ~[na:1.8.0_131]
        at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
        at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 27 common frames omitted
ERROR [main] 2018-01-10 10:43:33,522 CassandraDaemon.java:706 - Exception 
encountered during startup
java.lang.RuntimeException: java.util.concurrent.ExecutionException: 
java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:404) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.SystemKeyspace.forceBlockingFlush(SystemKeyspace.java:819)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.SystemKeyspace.removeTruncationRecord(SystemKeyspace.java:670)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:550)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:526)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.schema.LegacySchemaMigrator.lambda$unloadLegacySchemaTables$1(LegacySchemaMigrator.java:137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Iterable.forEach(Iterable.java:75) ~[na:1.8.0_131]
        at 
org.apache.cassandra.schema.LegacySchemaMigrator.unloadLegacySchemaTables(LegacySchemaMigrator.java:137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.schema.LegacySchemaMigrator.migrate(LegacySchemaMigrator.java:83)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:256) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:600) 
[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:689) 
[apache-cassandra-3.11.1.jar:3.11.1]
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: 
java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at java.util.concurrent.FutureTask.report(FutureTask.java:122) 
~[na:1.8.0_131]
        at java.util.concurrent.FutureTask.get(FutureTask.java:192) 
~[na:1.8.0_131]
        at 
org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:400) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 11 common frames omitted
Caused by: java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:285) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LogTransaction.trackNew(LogTransaction.java:136)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.trackNew(LifecycleTransaction.java:529)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigTableWriter.<init>(BigTableWriter.java:81)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.big.BigFormat$WriterFactory.open(BigFormat.java:92)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.format.SSTableWriter.create(SSTableWriter.java:102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.create(SimpleSSTableMultiWriter.java:119)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.AbstractCompactionStrategy.createSSTableMultiWriter(AbstractCompactionStrategy.java:587)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.compaction.CompactionStrategyManager.createSSTableMultiWriter(CompactionStrategyManager.java:920)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore.createSSTableMultiWriter(ColumnFamilyStore.java:515)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.createFlushWriter(Memtable.java:509)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:448) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:425) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at org.apache.cassandra.db.Memtable.flushRunnables(Memtable.java:303) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1137)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_131]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
~[na:1.8.0_131]
        at 
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
        Suppressed: java.lang.RuntimeException: 
java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                at 
org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
                ... 5 common frames omitted
        Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
                at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
                at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
                at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
                at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
                at java.nio.file.Files.newOutputStream(Files.java:216)
                at java.nio.file.Files.write(Files.java:3351)
                at 
org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583)
                ... 21 common frames omitted
Caused by: java.nio.file.AccessDeniedException: 
/var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
        at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
~[na:1.8.0_131]
        at 
sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
 ~[na:1.8.0_131]
        at 
java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
 ~[na:1.8.0_131]
        at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
        at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
        at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
~[apache-cassandra-3.11.1.jar:3.11.1]
        ... 27 common frames omitted
{code}


> node can't start, java.nio.file.AccessDeniedException to not existent file
> --------------------------------------------------------------------------
>
>                 Key: CASSANDRA-14161
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-14161
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: ubuntu +cassandra 3.11.1
>            Reporter: Rogelio Triviño González
>             Fix For: 3.11.1
>
>
> this exception cuts the node starting:
> {code}
> java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
> {code}
> the offending file doesn't exists:
> {code}
>  ls -la /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/
> total 160
> drwxr-xr-x  3 cassandra cassandra 4096 ene  7 11:48 .
> drwxr-xr-x 26 cassandra cassandra 4096 dic 18 07:30 ..
> drwxr-xr-x  2 cassandra cassandra 4096 dic 18 07:30 backups
> -rw-r--r--  1 cassandra cassandra   43 ene  7 03:50 
> mc-100-big-CompressionInfo.db
> -rw-r--r--  1 cassandra cassandra   52 ene  7 03:50 mc-100-big-Data.db
> -rw-r--r--  1 cassandra cassandra    8 ene  7 03:50 mc-100-big-Digest.crc32
> -rw-r--r--  1 cassandra cassandra   16 ene  7 03:50 mc-100-big-Filter.db
> -rw-r--r--  1 cassandra cassandra    9 ene  7 03:50 mc-100-big-Index.db
> -rw-r--r--  1 cassandra cassandra 4615 ene  7 03:50 mc-100-big-Statistics.db
> -rw-r--r--  1 cassandra cassandra   59 ene  7 03:50 mc-100-big-Summary.db
> -rw-r--r--  1 cassandra cassandra   92 ene  7 03:50 mc-100-big-TOC.txt
> -rw-r--r--  1 cassandra cassandra   43 ene  7 11:48 
> mc-101-big-CompressionInfo.db
> -rw-r--r--  1 cassandra cassandra   50 ene  7 11:48 mc-101-big-Data.db
> -rw-r--r--  1 cassandra cassandra   10 ene  7 11:48 mc-101-big-Digest.crc32
> -rw-r--r--  1 cassandra cassandra   16 ene  7 11:48 mc-101-big-Filter.db
> -rw-r--r--  1 cassandra cassandra    9 ene  7 11:48 mc-101-big-Index.db
> -rw-r--r--  1 cassandra cassandra 4615 ene  7 11:48 mc-101-big-Statistics.db
> -rw-r--r--  1 cassandra cassandra   59 ene  7 11:48 mc-101-big-Summary.db
> -rw-r--r--  1 cassandra cassandra   92 ene  7 11:48 mc-101-big-TOC.txt
> -rw-r--r--  1 cassandra cassandra   51 ene  6 17:50 
> mc-98-big-CompressionInfo.db
> -rw-r--r--  1 cassandra cassandra 5226 ene  6 17:50 mc-98-big-Data.db
> -rw-r--r--  1 cassandra cassandra   10 ene  6 17:50 mc-98-big-Digest.crc32
> -rw-r--r--  1 cassandra cassandra   16 ene  6 17:50 mc-98-big-Filter.db
> -rw-r--r--  1 cassandra cassandra    9 ene  6 17:50 mc-98-big-Index.db
> -rw-r--r--  1 cassandra cassandra 5654 ene  6 17:50 mc-98-big-Statistics.db
> -rw-r--r--  1 cassandra cassandra   59 ene  6 17:50 mc-98-big-Summary.db
> -rw-r--r--  1 cassandra cassandra   92 ene  6 17:50 mc-98-big-TOC.txt
> -rw-r--r--  1 cassandra cassandra   43 ene  7 02:50 
> mc-99-big-CompressionInfo.db
> -rw-r--r--  1 cassandra cassandra   50 ene  7 02:50 mc-99-big-Data.db
> -rw-r--r--  1 cassandra cassandra   10 ene  7 02:50 mc-99-big-Digest.crc32
> -rw-r--r--  1 cassandra cassandra   16 ene  7 02:50 mc-99-big-Filter.db
> -rw-r--r--  1 cassandra cassandra    9 ene  7 02:50 mc-99-big-Index.db
> -rw-r--r--  1 cassandra cassandra 4615 ene  7 02:50 mc-99-big-Statistics.db
> -rw-r--r--  1 cassandra cassandra   59 ene  7 02:50 mc-99-big-Summary.db
> -rw-r--r--  1 cassandra cassandra   92 ene  7 02:50 mc-99-big-TOC.txt
> {code}
> permissions are ok, everything assigned to cassandra:cassandra
> the system.log:
> {code}
> INFO  [main] 2018-01-10 10:43:29,367 YamlConfigurationLoader.java:89 - 
> Configuration location: file:/etc/cassandra/cassandra.yaml
> INFO  [main] 2018-01-10 10:43:29,887 Config.java:481 - Node 
> configuration:[allocate_tokens_for_keyspace=null; 
> authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; 
> auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; 
> back_pressure_strategy=null; batch_size_fail_threshold_in_kb=500; 
> batch_size_warn_threshold_in_kb=50; batchlog_replay_throttle_in_kb=1024; 
> broadcast_address=null; broadcast_rpc_address=null; 
> buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=10000; 
> cdc_enabled=false; cdc_free_space_check_interval_ms=250; 
> cdc_raw_directory=null; cdc_total_space_in_mb=0; 
> client_encryption_options=<REDACTED>; cluster_name=PAP Cluster; 
> column_index_cache_size_in_kb=2; column_index_size_in_kb=64; 
> commit_failure_policy=stop; commitlog_compression=null; 
> commitlog_directory=/var/lib/cassandra/commitlog; 
> commitlog_max_compression_buffers_in_pool=3; 
> commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; 
> commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=NaN; 
> commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; 
> compaction_large_partition_warning_threshold_mb=100; 
> compaction_throughput_mb_per_sec=16; concurrent_compactors=null; 
> concurrent_counter_writes=32; concurrent_materialized_view_writes=32; 
> concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; 
> counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; 
> counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=50000; 
> credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; 
> credentials_validity_in_ms=2000; cross_node_timeout=false; 
> data_file_directories=[Ljava.lang.String;@79ca92b9; disk_access_mode=auto; 
> disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; 
> disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; 
> dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; 
> dynamic_snitch_reset_interval_in_ms=600000; 
> dynamic_snitch_update_interval_in_ms=100; 
> enable_scripted_user_defined_functions=false; 
> enable_user_defined_functions=false; 
> enable_user_defined_functions_threads=true; encryption_options=null; 
> endpoint_snitch=GossipingPropertyFileSnitch; file_cache_size_in_mb=null; 
> gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; 
> hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; 
> hinted_handoff_throttle_in_kb=1024; hints_compression=null; 
> hints_directory=null; hints_flush_period_in_ms=10000; 
> incremental_backups=false; index_interval=null; 
> index_summary_capacity_in_mb=null; 
> index_summary_resize_interval_in_minutes=60; initial_token=null; 
> inter_dc_stream_throughput_outbound_megabits_per_sec=200; 
> inter_dc_tcp_nodelay=false; internode_authenticator=null; 
> internode_compression=all; internode_recv_buff_size_in_bytes=0; 
> internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; 
> key_cache_save_period=14400; key_cache_size_in_mb=null; 
> listen_address=192.121.166.40; listen_interface=null; 
> listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; 
> max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; 
> max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; 
> max_streaming_retries=3; max_value_size_in_mb=256; 
> memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; 
> memtable_flush_writers=0; memtable_heap_space_in_mb=null; 
> memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; 
> native_transport_max_concurrent_connections=-1; 
> native_transport_max_concurrent_connections_per_ip=-1; 
> native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; 
> native_transport_port=9042; native_transport_port_ssl=null; num_tokens=256; 
> otc_backlog_expiration_interval_ms=200; 
> otc_coalescing_enough_coalesced_messages=8; otc_coalescing_strategy=DISABLED; 
> otc_coalescing_window_us=200; 
> partitioner=org.apache.cassandra.dht.Murmur3Partitioner; 
> permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; 
> permissions_validity_in_ms=2000; phi_convict_threshold=8.0; 
> prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=100000; 
> read_request_timeout_in_ms=100000; 
> request_scheduler=org.apache.cassandra.scheduler.NoScheduler; 
> request_scheduler_id=null; request_scheduler_options=null; 
> request_timeout_in_ms=100000; role_manager=CassandraRoleManager; 
> roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; 
> roles_validity_in_ms=2000; 
> row_cache_class_name=org.apache.cassandra.cache.OHCProvider; 
> row_cache_keys_to_save=2147483647; row_cache_save_period=0; 
> row_cache_size_in_mb=0; rpc_address=localhost; rpc_interface=null; 
> rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; 
> rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; 
> rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; 
> rpc_server_type=sync; saved_caches_directory=/var/lib/cassandra/saved_caches; 
> seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=63.142.255.107,37.247.116.68};
>  server_encryption_options=<REDACTED>; slow_query_log_timeout_in_ms=500; 
> snapshot_before_compaction=false; ssl_storage_port=7071; 
> sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; 
> start_rpc=false; storage_port=7070; 
> stream_throughput_outbound_megabits_per_sec=200; 
> streaming_keep_alive_period_in_secs=300; 
> streaming_socket_timeout_in_ms=86400000; 
> thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; 
> thrift_prepared_statements_cache_size_mb=null; 
> tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; 
> tracetype_query_ttl=86400; tracetype_repair_ttl=604800; 
> transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@1460a8c0;
>  trickle_fsync=false; trickle_fsync_interval_in_kb=10240; 
> truncate_request_timeout_in_ms=600000; 
> unlogged_batch_across_partitions_warn_threshold=10; 
> user_defined_function_fail_timeout=1500; 
> user_defined_function_warn_timeout=500; user_function_timeout_policy=die; 
> windows_timer_interval=1; write_request_timeout_in_ms=50000]
> INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:367 - 
> DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
> INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:421 - Global 
> memtable on-heap threshold is enabled at 374MB
> INFO  [main] 2018-01-10 10:43:29,888 DatabaseDescriptor.java:425 - Global 
> memtable off-heap threshold is enabled at 374MB
> WARN  [main] 2018-01-10 10:43:29,897 DatabaseDescriptor.java:470 - Small 
> commitlog volume detected at /var/lib/cassandra/commitlog; setting 
> commitlog_total_space_in_mb to 7680.  You can override this in cassandra.yaml
> WARN  [main] 2018-01-10 10:43:29,899 DatabaseDescriptor.java:497 - Small cdc 
> volume detected at /var/lib/cassandra/cdc_raw; setting cdc_total_space_in_mb 
> to 3840.  You can override this in cassandra.yaml
> WARN  [main] 2018-01-10 10:43:30,022 DatabaseDescriptor.java:546 - Only 
> 18.837GiB free across all data volumes. Consider adding more capacity to your 
> cluster or removing obsolete snapshots
> INFO  [main] 2018-01-10 10:43:30,066 RateBasedBackPressure.java:123 - 
> Initialized back-pressure with high ratio: 0.9, factor: 5, flow: FAST, window 
> size: 50000.
> INFO  [main] 2018-01-10 10:43:30,066 DatabaseDescriptor.java:725 - 
> Back-pressure is disabled with strategy null.
> INFO  [main] 2018-01-10 10:43:30,250 GossipingPropertyFileSnitch.java:64 - 
> Loaded cassandra-topology.properties for compatibility
> INFO  [main] 2018-01-10 10:43:30,329 JMXServerUtils.java:249 - Configured JMX 
> server at: service:jmx:rmi://127.0.0.1/jndi/rmi://127.0.0.1:7199/jmxrmi
> INFO  [main] 2018-01-10 10:43:30,335 CassandraDaemon.java:471 - Hostname: 
> uk1.plugandplay.click
> INFO  [main] 2018-01-10 10:43:30,335 CassandraDaemon.java:478 - JVM 
> vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.8.0_131
> INFO  [main] 2018-01-10 10:43:30,336 CassandraDaemon.java:479 - Heap size: 
> 1.463GiB/1.463GiB
> INFO  [main] 2018-01-10 10:43:30,336 CassandraDaemon.java:484 - Code Cache 
> Non-heap memory: init = 2555904(2496K) used = 4545344(4438K) committed = 
> 4587520(4480K) max = 251658240(245760K)
> INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Metaspace 
> Non-heap memory: init = 0(0K) used = 19068664(18621K) committed = 
> 19791872(19328K) max = -1(-1K)
> INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Compressed 
> Class Space Non-heap memory: init = 0(0K) used = 2353456(2298K) committed = 
> 2490368(2432K) max = 1073741824(1048576K)
> INFO  [main] 2018-01-10 10:43:30,337 CassandraDaemon.java:484 - Par Eden 
> Space Heap memory: init = 322174976(314624K) used = 109586656(107018K) 
> committed = 322174976(314624K) max = 322174976(314624K)
> INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:484 - Par Survivor 
> Space Heap memory: init = 40239104(39296K) used = 0(0K) committed = 
> 40239104(39296K) max = 40239104(39296K)
> INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:484 - CMS Old Gen 
> Heap memory: init = 1207959552(1179648K) used = 0(0K) committed = 
> 1207959552(1179648K) max = 1207959552(1179648K)
> INFO  [main] 2018-01-10 10:43:30,338 CassandraDaemon.java:486 - Classpath: 
> /etc/cassandra:/usr/share/cassandra/lib/HdrHistogram-2.1.9.jar:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/caffeine-2.2.6.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.1-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.9.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrent-trees-2.4.0.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/hppc-0.5.4.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jctools-core-1.2.1.jar:/usr/share/cassandra/lib/jflex-1.6.0.jar:/usr/share/cassandra/lib/jna-4.2.2.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/jstackjunit-0.0.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-jvm-3.1.0.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.44.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.4.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.4.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.3.jar:/usr/share/cassandra/lib/reporter-config3-3.0.3.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/snowball-stemmer-1.3.0.581.1.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.11.1.jar:/usr/share/cassandra/apache-cassandra-thrift-3.11.1.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar::/usr/share/cassandra/lib/jamm-0.3.0.jar
> INFO  [main] 2018-01-10 10:43:30,339 CassandraDaemon.java:488 - JVM 
> Arguments: [-Xloggc:/var/log/cassandra/gc.log, -ea, -XX:+UseThreadPriorities, 
> -XX:ThreadPriorityPolicy=42, -XX:+HeapDumpOnOutOfMemoryError, -Xss256k, 
> -XX:StringTableSize=1000003, -XX:+AlwaysPreTouch, -XX:-UseBiasedLocking, 
> -XX:+UseTLAB, -XX:+ResizeTLAB, -XX:+UseNUMA, -XX:+PerfDisableSharedMem, 
> -Djava.net.preferIPv4Stack=true, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, 
> -XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, 
> -XX:MaxTenuringThreshold=1, -XX:CMSInitiatingOccupancyFraction=75, 
> -XX:+UseCMSInitiatingOccupancyOnly, -XX:CMSWaitDuration=10000, 
> -XX:+CMSParallelInitialMarkEnabled, -XX:+CMSEdenChunksRecordAlways, 
> -XX:+CMSClassUnloadingEnabled, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, 
> -XX:+PrintHeapAtGC, -XX:+PrintTenuringDistribution, 
> -XX:+PrintGCApplicationStoppedTime, -XX:+PrintPromotionFailure, 
> -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=10, -XX:GCLogFileSize=10M, 
> -Xms1536M, -Xmx1536M, -Xmn384M, -XX:+UseCondCardMark, 
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler, 
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar, 
> -Dcassandra.jmx.local.port=7199, 
> -Dcom.sun.management.jmxremote.authenticate=false, 
> -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password,
>  -Djava.library.path=/usr/share/cassandra/lib/sigar-bin, 
> -Dlogback.configurationFile=logback.xml, 
> -Dcassandra.logdir=/var/log/cassandra, 
> -Dcassandra.storagedir=/var/lib/cassandra, 
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid, 
> -XX:HeapDumpPath=/var/lib/cassandra/java_1515602606.hprof, 
> -XX:ErrorFile=/var/lib/cassandra/hs_err_1515602606.log]
> INFO  [main] 2018-01-10 10:43:30,598 NativeLibrary.java:174 - JNA mlockall 
> successful
> WARN  [main] 2018-01-10 10:43:30,599 StartupChecks.java:133 - jemalloc shared 
> library could not be preloaded to speed up memory allocations
> WARN  [main] 2018-01-10 10:43:30,599 StartupChecks.java:166 - JMX is not 
> enabled to receive remote connections. Please see cassandra-env.sh for more 
> info.
> INFO  [main] 2018-01-10 10:43:30,601 SigarLibrary.java:44 - Initializing 
> SIGAR library
> INFO  [main] 2018-01-10 10:43:30,614 SigarLibrary.java:180 - Checked OS 
> settings and found them configured for optimal performance.
> WARN  [main] 2018-01-10 10:43:30,619 StartupChecks.java:271 - Maximum number 
> of memory map areas per process (vm.max_map_count) 65530 is too low, 
> recommended value: 1048575, you can change it with sysctl.
> INFO  [main] 2018-01-10 10:43:30,975 QueryProcessor.java:116 - Initialized 
> prepared statement caches with 10 MB (native) and 10 MB (Thrift)
> INFO  [main] 2018-01-10 10:43:31,541 ColumnFamilyStore.java:408 - 
> Initializing system.IndexInfo
> INFO  [SSTableBatchOpen:1] 2018-01-10 10:43:32,405 BufferPool.java:230 - 
> Global buffer pool is enabled, when pool is exhausted (max is 374.000MiB) it 
> will allocate on heap
> INFO  [main] 2018-01-10 10:43:32,653 CacheService.java:112 - Initializing key 
> cache with capacity of 74 MBs.
> INFO  [main] 2018-01-10 10:43:32,662 CacheService.java:134 - Initializing row 
> cache with capacity of 0 MBs
> INFO  [main] 2018-01-10 10:43:32,664 CacheService.java:163 - Initializing 
> counter cache with capacity of 37 MBs
> INFO  [main] 2018-01-10 10:43:32,666 CacheService.java:174 - Scheduling 
> counter cache save to every 7200 seconds (going to save all keys).
> INFO  [main] 2018-01-10 10:43:32,720 ColumnFamilyStore.java:408 - 
> Initializing system.batches
> INFO  [main] 2018-01-10 10:43:32,747 ColumnFamilyStore.java:408 - 
> Initializing system.paxos
> INFO  [main] 2018-01-10 10:43:32,763 ColumnFamilyStore.java:408 - 
> Initializing system.local
> INFO  [main] 2018-01-10 10:43:32,791 ColumnFamilyStore.java:408 - 
> Initializing system.peers
> INFO  [main] 2018-01-10 10:43:32,814 ColumnFamilyStore.java:408 - 
> Initializing system.peer_events
> INFO  [main] 2018-01-10 10:43:32,821 ColumnFamilyStore.java:408 - 
> Initializing system.range_xfers
> INFO  [main] 2018-01-10 10:43:32,830 ColumnFamilyStore.java:408 - 
> Initializing system.compaction_history
> INFO  [main] 2018-01-10 10:43:32,852 ColumnFamilyStore.java:408 - 
> Initializing system.sstable_activity
> INFO  [main] 2018-01-10 10:43:32,977 ColumnFamilyStore.java:408 - 
> Initializing system.size_estimates
> INFO  [main] 2018-01-10 10:43:32,992 ColumnFamilyStore.java:408 - 
> Initializing system.available_ranges
> INFO  [main] 2018-01-10 10:43:33,002 ColumnFamilyStore.java:408 - 
> Initializing system.transferred_ranges
> INFO  [main] 2018-01-10 10:43:33,008 ColumnFamilyStore.java:408 - 
> Initializing system.views_builds_in_progress
> INFO  [main] 2018-01-10 10:43:33,014 ColumnFamilyStore.java:408 - 
> Initializing system.built_views
> INFO  [main] 2018-01-10 10:43:33,021 ColumnFamilyStore.java:408 - 
> Initializing system.hints
> INFO  [main] 2018-01-10 10:43:33,028 ColumnFamilyStore.java:408 - 
> Initializing system.batchlog
> INFO  [main] 2018-01-10 10:43:33,036 ColumnFamilyStore.java:408 - 
> Initializing system.prepared_statements
> INFO  [main] 2018-01-10 10:43:33,049 ColumnFamilyStore.java:408 - 
> Initializing system.schema_keyspaces
> INFO  [main] 2018-01-10 10:43:33,055 ColumnFamilyStore.java:408 - 
> Initializing system.schema_columnfamilies
> INFO  [main] 2018-01-10 10:43:33,062 ColumnFamilyStore.java:408 - 
> Initializing system.schema_columns
> INFO  [main] 2018-01-10 10:43:33,068 ColumnFamilyStore.java:408 - 
> Initializing system.schema_triggers
> INFO  [main] 2018-01-10 10:43:33,074 ColumnFamilyStore.java:408 - 
> Initializing system.schema_usertypes
> INFO  [main] 2018-01-10 10:43:33,081 ColumnFamilyStore.java:408 - 
> Initializing system.schema_functions
> INFO  [main] 2018-01-10 10:43:33,088 ColumnFamilyStore.java:408 - 
> Initializing system.schema_aggregates
> INFO  [main] 2018-01-10 10:43:33,090 ViewManager.java:137 - Not submitting 
> build tasks for views in keyspace system as storage service is not initialized
> INFO  [main] 2018-01-10 10:43:33,250 ApproximateTime.java:44 - Scheduling 
> approximate time-check task with a precision of 10 milliseconds
> INFO  [main] 2018-01-10 10:43:33,307 ColumnFamilyStore.java:408 - 
> Initializing system_schema.keyspaces
> INFO  [main] 2018-01-10 10:43:33,322 ColumnFamilyStore.java:408 - 
> Initializing system_schema.tables
> INFO  [main] 2018-01-10 10:43:33,336 ColumnFamilyStore.java:408 - 
> Initializing system_schema.columns
> INFO  [main] 2018-01-10 10:43:33,347 ColumnFamilyStore.java:408 - 
> Initializing system_schema.triggers
> INFO  [main] 2018-01-10 10:43:33,353 ColumnFamilyStore.java:408 - 
> Initializing system_schema.dropped_columns
> INFO  [main] 2018-01-10 10:43:33,359 ColumnFamilyStore.java:408 - 
> Initializing system_schema.views
> INFO  [main] 2018-01-10 10:43:33,364 ColumnFamilyStore.java:408 - 
> Initializing system_schema.types
> INFO  [main] 2018-01-10 10:43:33,370 ColumnFamilyStore.java:408 - 
> Initializing system_schema.functions
> INFO  [main] 2018-01-10 10:43:33,376 ColumnFamilyStore.java:408 - 
> Initializing system_schema.aggregates
> INFO  [main] 2018-01-10 10:43:33,382 ColumnFamilyStore.java:408 - 
> Initializing system_schema.indexes
> INFO  [main] 2018-01-10 10:43:33,388 ViewManager.java:137 - Not submitting 
> build tasks for views in keyspace system_schema as storage service is not 
> initialized
> ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,507 LogTransaction.java:273 
> - Transaction log [mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log in 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377] 
> indicates txn was not completed, trying to abort it now
> ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,512 LogTransaction.java:276 
> - Failed to abort transaction log 
> [mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log in 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377]
> java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogTransaction$TransactionTidier.run(LogTransaction.java:274)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogTransaction$TransactionTidier.tidy(LogTransaction.java:258)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.utils.concurrent.Ref$GlobalState.release(Ref.java:321) 
> [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.utils.concurrent.Ref$State.ensureReleased(Ref.java:199) 
> [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.utils.concurrent.Ref.ensureReleased(Ref.java:119) 
> [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogTransaction.complete(LogTransaction.java:393)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  [na:1.8.0_131]
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_131]
>       at 
> org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
> Caused by: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at 
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
>  ~[na:1.8.0_131]
>       at 
> java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
>  ~[na:1.8.0_131]
>       at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
>       at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
>       at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       ... 27 common frames omitted
> ERROR [MemtableFlushWriter:1] 2018-01-10 10:43:33,515 LogTransaction.java:223 
> - Unable to delete 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>  as it does not exist, see debug log file for stack trace
> ERROR [MemtablePostFlush:1] 2018-01-10 10:43:33,520 CassandraDaemon.java:228 
> - Exception in thread Thread[MemtablePostFlush:1,5,main]
> java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:285) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogTransaction.trackNew(LogTransaction.java:136)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.trackNew(LifecycleTransaction.java:529)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.<init>(BigTableWriter.java:81)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.format.big.BigFormat$WriterFactory.open(BigFormat.java:92)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.format.SSTableWriter.create(SSTableWriter.java:102)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.create(SimpleSSTableMultiWriter.java:119)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.compaction.AbstractCompactionStrategy.createSSTableMultiWriter(AbstractCompactionStrategy.java:587)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.compaction.CompactionStrategyManager.createSSTableMultiWriter(CompactionStrategyManager.java:920)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore.createSSTableMultiWriter(ColumnFamilyStore.java:515)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.Memtable$FlushRunnable.createFlushWriter(Memtable.java:509)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:448) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:425) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.db.Memtable.flushRunnables(Memtable.java:303) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1137)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_131]
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_131]
>       at 
> org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
>       Suppressed: java.lang.RuntimeException: 
> java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>               at 
> org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               ... 5 common frames omitted
>       Caused by: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>               at 
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
>               at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
>               at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
>               at 
> sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
>               at 
> java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
>               at java.nio.file.Files.newOutputStream(Files.java:216)
>               at java.nio.file.Files.write(Files.java:3351)
>               at 
> org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583)
>               ... 21 common frames omitted
> Caused by: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at 
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
>  ~[na:1.8.0_131]
>       at 
> java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
>  ~[na:1.8.0_131]
>       at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
>       at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
>       at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       ... 27 common frames omitted
> ERROR [main] 2018-01-10 10:43:33,522 CassandraDaemon.java:706 - Exception 
> encountered during startup
> java.lang.RuntimeException: java.util.concurrent.ExecutionException: 
> java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at 
> org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:404) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.SystemKeyspace.forceBlockingFlush(SystemKeyspace.java:819)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.SystemKeyspace.removeTruncationRecord(SystemKeyspace.java:670)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:550)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore.invalidate(ColumnFamilyStore.java:526)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.schema.LegacySchemaMigrator.lambda$unloadLegacySchemaTables$1(LegacySchemaMigrator.java:137)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at java.lang.Iterable.forEach(Iterable.java:75) ~[na:1.8.0_131]
>       at 
> org.apache.cassandra.schema.LegacySchemaMigrator.unloadLegacySchemaTables(LegacySchemaMigrator.java:137)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.schema.LegacySchemaMigrator.migrate(LegacySchemaMigrator.java:83)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:256) 
> [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:600)
>  [apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:689) 
> [apache-cassandra-3.11.1.jar:3.11.1]
> Caused by: java.util.concurrent.ExecutionException: 
> java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at java.util.concurrent.FutureTask.report(FutureTask.java:122) 
> ~[na:1.8.0_131]
>       at java.util.concurrent.FutureTask.get(FutureTask.java:192) 
> ~[na:1.8.0_131]
>       at 
> org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:400) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       ... 11 common frames omitted
> Caused by: java.lang.RuntimeException: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:285) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LogTransaction.trackNew(LogTransaction.java:136)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.trackNew(LifecycleTransaction.java:529)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.<init>(BigTableWriter.java:81)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.format.big.BigFormat$WriterFactory.open(BigFormat.java:92)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.format.SSTableWriter.create(SSTableWriter.java:102)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.create(SimpleSSTableMultiWriter.java:119)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.compaction.AbstractCompactionStrategy.createSSTableMultiWriter(AbstractCompactionStrategy.java:587)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.compaction.CompactionStrategyManager.createSSTableMultiWriter(CompactionStrategyManager.java:920)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore.createSSTableMultiWriter(ColumnFamilyStore.java:515)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.Memtable$FlushRunnable.createFlushWriter(Memtable.java:509)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:448) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.Memtable$FlushRunnable.<init>(Memtable.java:425) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at org.apache.cassandra.db.Memtable.flushRunnables(Memtable.java:303) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1137)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.run(ColumnFamilyStore.java:1102)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_131]
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  ~[na:1.8.0_131]
>       at 
> org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>       at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_131]
>       Suppressed: java.lang.RuntimeException: 
> java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>               at 
> org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:590) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.io.util.FileUtils.appendAndSync(FileUtils.java:571) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogReplica.append(LogReplica.java:85) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.lambda$null$5(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogReplicaSet.append(LogReplicaSet.java:210)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogFile.addRecord(LogFile.java:324) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogFile.abort(LogFile.java:257) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:113) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:103) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.Throwables.perform(Throwables.java:98) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LogTransaction.doAbort(LogTransaction.java:410)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.doAbort(LifecycleTransaction.java:243)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.abort(Transactional.java:144)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               at 
> org.apache.cassandra.db.ColumnFamilyStore$Flush.flushMemtable(ColumnFamilyStore.java:1156)
>  ~[apache-cassandra-3.11.1.jar:3.11.1]
>               ... 5 common frames omitted
>       Caused by: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>               at 
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)
>               at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
>               at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
>               at 
> sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
>               at 
> java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
>               at java.nio.file.Files.newOutputStream(Files.java:216)
>               at java.nio.file.Files.write(Files.java:3351)
>               at 
> org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583)
>               ... 21 common frames omitted
> Caused by: java.nio.file.AccessDeniedException: 
> /var/lib/cassandra/data/system/local-7ad54392bcdd35a684174e047860b377/mc_txn_flush_6579bf70-f625-11e7-8e56-71d63c551064.log
>       at 
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
> ~[na:1.8.0_131]
>       at 
> sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
>  ~[na:1.8.0_131]
>       at 
> java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
>  ~[na:1.8.0_131]
>       at java.nio.file.Files.newOutputStream(Files.java:216) ~[na:1.8.0_131]
>       at java.nio.file.Files.write(Files.java:3351) ~[na:1.8.0_131]
>       at org.apache.cassandra.io.util.FileUtils.write(FileUtils.java:583) 
> ~[apache-cassandra-3.11.1.jar:3.11.1]
>       ... 27 common frames omitted
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org