[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrien Grand updated CASSANDRA-5038: Attachment: CASSANDRA-5038.patch Updated patch (should apply on top of branch cassandra-1.2): - upgraded lz4 to version 1.1.0 - added copyright headers and license files After having applied the patch, you need to download the LZ4 jar from http://repo1.maven.org/maven2/net/jpountz/lz4/lz4/1.1.0/lz4-1.1.0.jar and put it under the lib directory. LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.2 Attachments: CASSANDRA-5038.patch, CASSANDRA-5038.patch, CASSANDRA-5038.patch, LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrien Grand updated CASSANDRA-5038: Attachment: CASSANDRA-5038.patch cassandra-dtest's configuration_test.py and cql_tests.py passed successfully with LZ4Compresssor (after performing a sed -i -e s/SnappyCompressor/LZ4Compressor/g on the test files). Unfortunately, some other tests mentioning compresssion (such as counter_tests.py or sstable_generation_loading_test.py) didn't pass but they didn't pass with Snappy either so this is probably unrelated? LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.2 Attachments: CASSANDRA-5038.patch, CASSANDRA-5038.patch, LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[
https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adrien Grand updated CASSANDRA-5038:
Attachment: CASSANDRA-5038.patch
I performed a first release of lz4-java yesterday, here is a patch with tests
that adds support for lz4 compression. You need to add the lz4 JAR to the lib
directory
(http://repo1.maven.org/maven2/net/jpountz/lz4/lz4/1.0.0/lz4-1.0.0.jar) before
applying it.
This patch is very similar to Jake's Compressor impl, and I especially copied
the {{supportedOptions}} method to return {{crc_check_chance}}. What does it
change to declare this option as supported? ({{DeflateCompressor}} and
{{SnappyCompressor}} just return an empty set.)
Does Cassandra have integration tests that we could try to run with this new
compressor?
LZ4Compressor
-
Key: CASSANDRA-5038
URL: https://issues.apache.org/jira/browse/CASSANDRA-5038
Project: Cassandra
Issue Type: New Feature
Components: Core
Reporter: T Jake Luciani
Priority: Minor
Fix For: 1.2.2
Attachments: CASSANDRA-5038.patch, LZ4Compressor.java, lz4-java.jar
LZ4 is a new compression algo that's ~2x faster than Snappy.
[~jpountz] has written a nice java port which includes a misc.Unsafe version
that performs = than our java snappy version.
Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast
The nice thing is this should work with java7 and be more portable.
We can also fallback the pure java impl
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Attachment: (was: LZ4Compressor.java) LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.1 Attachments: lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Attachment: (was: lz4-java.jar) LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.1 Attachments: LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Attachment: lz4-java.jar LZ4Compressor.java LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.1 Attachments: LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Attachment: (was: lz4-java.jar) LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.1 LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Attachment: (was: LZ4Compressor.java) LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.1 LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Attachment: LZ4Compressor.java lz4-java.jar New version that encodes the length of each chunk in first 4 bytes (didn't use vints) Uses known decompress. Also uses the fastestInstance call now LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.1 Attachments: LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Description: LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl was: LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.1.8 LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Attachment: lz4-java.jar LZ4Compressor.java We are currently benchmarking this. LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.1.8 Attachments: LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Fix Version/s: (was: 1.1.8) 1.2.0 LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.0 Attachments: LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-5038) LZ4Compressor
[ https://issues.apache.org/jira/browse/CASSANDRA-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T Jake Luciani updated CASSANDRA-5038: -- Fix Version/s: (was: 1.2.0) 1.2.1 LZ4Compressor - Key: CASSANDRA-5038 URL: https://issues.apache.org/jira/browse/CASSANDRA-5038 Project: Cassandra Issue Type: New Feature Components: Core Reporter: T Jake Luciani Priority: Minor Fix For: 1.2.1 Attachments: LZ4Compressor.java, lz4-java.jar LZ4 is a new compression algo that's ~2x faster than Snappy. [~jpountz] has written a nice java port which includes a misc.Unsafe version that performs = than our java snappy version. Details at http://blog.jpountz.net/post/28092106032/wow-lz4-is-fast The nice thing is this should work with java7 and be more portable. We can also fallback the pure java impl -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
