Re: Commit log periodic sync?

2012-08-29 Thread aaron morton
- if during the streaming session, the sstable that was about to stream out but was being compacted, would we see error in the log? No. Remember we never modify files on disk. And the truth contained in one file generated by compaction is the same as thetruth contained in the files before

Re: Commit log periodic sync?

2012-08-28 Thread rubbish me
Thanks again Aaron. I think case I would not expect to see data lose. If you are still in a test scenario can you try to reproduce the problem ? If possible can you reproduce it with a single node ? We will try that later this week. We did the same exercise this week, this time we

Re: Commit log periodic sync?

2012-08-27 Thread aaron morton
Brutally. kill -9. that's fine. I was thinking about reboot -f -n We are wondering if the fsync of the commit log was working. I would say yes only because there other reported problems. I think case I would not expect to see data lose. If you are still in a test scenario can you try to

Re: Commit log periodic sync?

2012-08-24 Thread aaron morton
- we are running on production linux VMs (not ideal but this is out of our hands) Is the VM doing anything wacky with the IO ? As part of a DR exercise, we killed all 6 nodes in DC1, Nice disaster. Out of interest, what was the shutdown process ? We noticed that data that was written an