[
https://issues.apache.org/jira/browse/CASSANDRA-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13063990#comment-13063990
]
Terje Marthinussen commented on CASSANDRA-47:
---------------------------------------------
It starts making the file, but then it crashes.
java.lang.IndexOutOfBoundsException
at java.io.RandomAccessFile.readBytes(Native Method)
at java.io.RandomAccessFile.read(RandomAccessFile.java:338)
at
org.apache.cassandra.io.compress.AbstractCompressedFile.readCompressedChunk(AbstractCompressedFile.java:169)
at
org.apache.cassandra.io.compress.AbstractCompressedFile.reBuffer(AbstractCompressedFile.java:85)
at
org.apache.cassandra.io.compress.CompressedDataFile$Output.writeAtMost(CompressedDataFile.java:420)
at
org.apache.cassandra.io.compress.CompressedDataFile$Output.write(CompressedDataFile.java:404)
at
org.apache.cassandra.db.ColumnIndexer.writeBloomFilter(ColumnIndexer.java:144)
at
org.apache.cassandra.db.ColumnIndexer.serializeInternal(ColumnIndexer.java:114)
at
org.apache.cassandra.db.ColumnIndexer.serialize(ColumnIndexer.java:50)
at
org.apache.cassandra.db.ColumnFamilySerializer.serializeWithIndexes(ColumnFamilySerializer.java:107)
at
org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:156)
at
org.apache.cassandra.tools.SSTableImport.importUnsorted(SSTableImport.java:290)
at
org.apache.cassandra.tools.SSTableImport.importJson(SSTableImport.java:252)
at org.apache.cassandra.tools.SSTableImport.main(SSTableImport.java:476)
ERROR: null
I added a bit debug printing to the read/writeChunkLength
logger.info("TNM: readChunkLength " + len + " in " + this.path + " at:
" + super.getFilePointer());
INFO 08:13:40,652 TNM: writeChunkLength 28511 in
/var/folders/8d/8drNFwr6FEe7uEdizf5pAE+++TI/-Tmp-/Test-h-22-Data.db2879008826574155982compressing
at: 1245194
INFO 08:13:40,655 TNM: writeChunkLength 65538 in
/var/folders/8d/8drNFwr6FEe7uEdizf5pAE+++TI/-Tmp-/Test-h-22-Data.db2879008826574155982compressing
at: 1310730
INFO 08:13:40,656 TNM: readChunkLength -1313507164 in
/var/folders/8d/8drNFwr6FEe7uEdizf5pAE+++TI/-Tmp-/Test-h-22-Data.db2879008826574155982compressing
at: 1376270
Importing 787 keys...
Currently imported 1 keys.
[Some lines deleted]
INFO 15:10:18,219 TNM: writeChunkLength 14870 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1114122
INFO 15:10:18,219 TNM: readChunkLength 21106 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1179662
INFO 15:10:18,229 TNM: writeChunkLength 21104 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1179658
INFO 15:10:18,258 TNM: readChunkLength 26901 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1245198
INFO 15:10:18,260 TNM: writeChunkLength 26901 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1245194
INFO 15:10:18,260 TNM: readChunkLength 21104 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1179662
INFO 15:10:18,261 TNM: writeChunkLength 21106 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1179658
INFO 15:10:18,261 TNM: readChunkLength 26901 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1245198
INFO 15:20:18,348 TNM: writeChunkLength 26901 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1245194
INFO 15:20:18,370 TNM: readChunkLength 65545 in
/Users/terje/work/cassandra-0.8/data/JP/Test-h-22-Data.db at: 1310734
And then the above exception
Note, this is on OSX and there seems to be another report of problems with OSX
above?
> SSTable compression
> -------------------
>
> Key: CASSANDRA-47
> URL: https://issues.apache.org/jira/browse/CASSANDRA-47
> Project: Cassandra
> Issue Type: New Feature
> Components: Core
> Reporter: Jonathan Ellis
> Assignee: Pavel Yaskevich
> Labels: compression
> Fix For: 1.0
>
> Attachments: CASSANDRA-47.patch, snappy-java-1.0.3-rc4.jar
>
>
> We should be able to do SSTable compression which would trade CPU for I/O
> (almost always a good trade).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
