[Cassandra Wiki] Update of FrontPage_draft_aaron by AaronMorton
Dear Wiki user, You have subscribed to a wiki page or wiki category on Cassandra Wiki for change notification. The FrontPage_draft_aaron page has been changed by AaronMorton: http://wiki.apache.org/cassandra/FrontPage_draft_aaron?action=diffrev1=80rev2=81 == For Administrators == * [[InstallingCassandra|Installing Cassandra]] * [[MultinodeCluster|Creating a multi-node cluster]] - * [[CassandraHardware|Cassandra Hardware]] * [[Windows|Cassandra on Windows]] * [[CloudConfig|Configuration on Rackspace or Amazon Web Services]] + * [[CassandraHardware|Cassandra Hardware]] * [[Embedding]] * [[RunningCassandra|Running Cassandra]] * [[Operations|Operations Guide]] @@ -89, +89 @@ * [[FrontPage_JP|Japanese 日本語]] * [[FrontPage_PT-BR|BrazilianPortuguese Português do Brasil]] + = Suggestions = + + **If you have any suggestions for additions or changes please add them below together with your name ** +
[Cassandra Wiki] Update of FrontPage_draft_aaron by AaronMorton
Dear Wiki user, You have subscribed to a wiki page or wiki category on Cassandra Wiki for change notification. The FrontPage_draft_aaron page has been changed by AaronMorton: http://wiki.apache.org/cassandra/FrontPage_draft_aaron?action=diffrev1=81rev2=82 = Suggestions = - **If you have any suggestions for additions or changes please add them below together with your name ** + '''If you have any suggestions for additions or changes please add them below together with your name'''
[jira] [Commented] (CASSANDRA-3314) Fail to delete -Index files if index is currently building
[ https://issues.apache.org/jira/browse/CASSANDRA-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13122769#comment-13122769 ] Radim Kolar commented on CASSANDRA-3314: with mmap mode, i dont see errors Fail to delete -Index files if index is currently building -- Key: CASSANDRA-3314 URL: https://issues.apache.org/jira/browse/CASSANDRA-3314 Project: Cassandra Issue Type: Bug Reporter: Radim Kolar Assignee: Pavel Yaskevich Priority: Minor Fix For: 0.8.8, 1.0.0 If there is index building in progress, following errors are thrown if cassandra is trying to delete *-Index.db files. There is no problem with deleting -Data or -Filter.. files. CF is using leveled compaction but it is probably not related. ERROR [NonPeriodicTasks:1] 2011-10-05 09:13:03,702 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.io.IOException: Failed to delete C:\var\lib\cas sandra\data\test\sipdb-h-772-Index.db at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:3 4) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:44 1) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec utor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:908) at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2922) Move SimpleAuthenticator and SimpleAuthority to examples/
[ https://issues.apache.org/jira/browse/CASSANDRA-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Lebresne updated CASSANDRA-2922: Attachment: 2922.patch Attaching a patch that move the two classes and the config files to examples/simple_authentication, along with a small README. One slight concern is that some parts (the cli, ColumnFamilyRecordReader and ColumnFamilyOutputFormat) are kind of suggesting we provide username/password authentication somehow (because they allow to configure a username and password either on the command line or in a config file), why we don't really, at least not out of the box. Move SimpleAuthenticator and SimpleAuthority to examples/ - Key: CASSANDRA-2922 URL: https://issues.apache.org/jira/browse/CASSANDRA-2922 Project: Cassandra Issue Type: Task Reporter: Jonathan Ellis Assignee: Sylvain Lebresne Priority: Minor Fix For: 1.0.0 Attachments: 2922.patch, 2922.txt We've provided SimpleAuthenticator and SimpleAuthority, toy file-based authentication and authorization mechanisms, since CASSANDRA-547. These are NOT production ready (even non-experts can tell the encryption is a joke) but newcomers don't always realize this. Let's move them to examples/ instead. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2922) Move SimpleAuthenticator and SimpleAuthority to examples/
[ https://issues.apache.org/jira/browse/CASSANDRA-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13122827#comment-13122827 ] Jonathan Ellis commented on CASSANDRA-2922: --- +1, and I think standardizing on credential map keys is a Good Thing even if nobody has contributed a full-blown auth solution yet Move SimpleAuthenticator and SimpleAuthority to examples/ - Key: CASSANDRA-2922 URL: https://issues.apache.org/jira/browse/CASSANDRA-2922 Project: Cassandra Issue Type: Task Reporter: Jonathan Ellis Assignee: Sylvain Lebresne Priority: Minor Fix For: 1.0.0 Attachments: 2922.patch, 2922.txt We've provided SimpleAuthenticator and SimpleAuthority, toy file-based authentication and authorization mechanisms, since CASSANDRA-547. These are NOT production ready (even non-experts can tell the encryption is a joke) but newcomers don't always realize this. Let's move them to examples/ instead. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CASSANDRA-3330) Improve CompactionTask extensibility
Improve CompactionTask extensibility Key: CASSANDRA-3330 URL: https://issues.apache.org/jira/browse/CASSANDRA-3330 Project: Cassandra Issue Type: Improvement Components: Core Affects Versions: 1.0.0 Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Fix For: 1.0.0 CompactionTask is still fairly coupled to SizeTieredCompaction, including some ugly casting. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3330) Improve CompactionTask extensibility
[ https://issues.apache.org/jira/browse/CASSANDRA-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-3330: -- Attachment: 3330.txt patch to disentangle things a bit Improve CompactionTask extensibility Key: CASSANDRA-3330 URL: https://issues.apache.org/jira/browse/CASSANDRA-3330 Project: Cassandra Issue Type: Improvement Components: Core Affects Versions: 1.0.0 Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Fix For: 1.0.0 Attachments: 3330.txt CompactionTask is still fairly coupled to SizeTieredCompaction, including some ugly casting. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3330) Improve CompactionTask extensibility
[ https://issues.apache.org/jira/browse/CASSANDRA-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-3330: -- Fix Version/s: (was: 1.0.0) 1.0.1 Labels: compaction (was: ) Improve CompactionTask extensibility Key: CASSANDRA-3330 URL: https://issues.apache.org/jira/browse/CASSANDRA-3330 Project: Cassandra Issue Type: Improvement Components: Core Affects Versions: 1.0.0 Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Labels: compaction Fix For: 1.0.1 Attachments: 3330.txt CompactionTask is still fairly coupled to SizeTieredCompaction, including some ugly casting. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
svn commit: r1180063 - in /cassandra/branches/cassandra-1.0.0: CHANGES.txt NEWS.txt
Author: slebresne
Date: Fri Oct 7 14:55:59 2011
New Revision: 1180063
URL: http://svn.apache.org/viewvc?rev=1180063view=rev
Log:
Add missing entry to the changelog and minor update to NEWS
Modified:
cassandra/branches/cassandra-1.0.0/CHANGES.txt
cassandra/branches/cassandra-1.0.0/NEWS.txt
Modified: cassandra/branches/cassandra-1.0.0/CHANGES.txt
URL:
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/CHANGES.txt?rev=1180063r1=1180062r2=1180063view=diff
==
--- cassandra/branches/cassandra-1.0.0/CHANGES.txt (original)
+++ cassandra/branches/cassandra-1.0.0/CHANGES.txt Fri Oct 7 14:55:59 2011
@@ -84,7 +84,7 @@ Fixes merged from 0.8 below:
* don't bother persisting columns shadowed by a row tombstone (CASSANDRA-2589)
* reset CF and SC deletion times after gc_grace (CASSANDRA-2317)
* optimize away seek when compacting wide rows (CASSANDRA-2879)
- * single-pass streaming (CASSANDRA-2677, 3003)
+ * single-pass streaming (CASSANDRA-2677, 2906, 2916, 3003)
* use reference counting for deleting sstables instead of relying on GC
(CASSANDRA-2521, 3179)
* store hints as serialized mutations instead of pointers to data row
@@ -97,7 +97,7 @@ Fixes merged from 0.8 below:
(CASSANDRA-2953)
* add paging to get_count (CASSANDRA-2894)
* fix short reads in [multi]get (CASSANDRA-2643, 3157, 3192)
- * add optional compression for sstables (CASSANDRA-47, 3001, 3128)
+ * add optional compression for sstables (CASSANDRA-47, 2994, 3001, 3128)
* add scheduler JMX metrics (CASSANDRA-2962)
* add block level checksum for compressed data (CASSANDRA-1717)
* make column family backed column map pluggable and introduce unsynchronized
@@ -149,6 +149,12 @@ Fixes merged from 0.8 below:
* Reduce copies done for intra-host messages (CASSANDRA-1788, 3144)
* support of compaction strategy option for stress.java (CASSANDRA-3204)
* make memtable throughput and column count thresholds no-ops (CASSANDRA-2449)
+ * Return schema information along with the resultSet in CQL (CASSANDRA-2734)
+ * Add new DecimalType (CASSANDRA-2883)
+ * Fix assertion error in RowRepairResolver (CASSANDRA-3156)
+ * Reduce unnecessary high buffer sizes (CASSANDRA-3171)
+ * Pluggable compaction strategy (CASSANDRA-1610)
+ * Add new broadcast_address config option (CASSANDRA-2491)
0.8.6
Modified: cassandra/branches/cassandra-1.0.0/NEWS.txt
URL:
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/NEWS.txt?rev=1180063r1=1180062r2=1180063view=diff
==
--- cassandra/branches/cassandra-1.0.0/NEWS.txt (original)
+++ cassandra/branches/cassandra-1.0.0/NEWS.txt Fri Oct 7 14:55:59 2011
@@ -7,14 +7,15 @@ Upgrading
by default, instead of millisecond. THIS MEANS A ROLLING UPGRADE COULD
MIX milliseconds and microseconds, with clients talking to servers
generating milliseconds unable to overwrite the larger microsecond
- timestamps. If this is important for your application, you can either
- perform a non-rolling upgrade to 1.0, or update your application first
- to use explicit timestamps with the USING timestamp=X syntax.
-- the BinaryMemtable bulk-load interface has been removed. Use the
- sstableloader tool instead.
-- the compaction_thread_priority setting has been removed from
+ timestamps. If you are using CQL and this is important for your
+ application, you can either perform a non-rolling upgrade to 1.0, or
+ update your application first to use explicit timestamps with the USING
+ timestamp=X syntax.
+- The BinaryMemtable bulk-load interface has been removed (use the
+ sstableloader tool instead).
+- The compaction_thread_priority setting has been removed from
cassandra.yaml (use compaction_throughput_mb_per_sec to throttle
- compaction instead)
+ compaction instead).
- CQL types bytea and date were renamed to blob and timestamp,
respectively,
to conform with SQL norms. CQL type int is now a 4-byte int, not 8
(which is still available as bigint).
@@ -26,21 +27,21 @@ Features
- SSTable compression is supported through the 'compression_options'
parameter when creating/updating a column family. For instance, you can
- create a column family Cf using compression (using the Snappy library)
+ create a column family Cf using compression (through the Snappy library)
in the CLI with:
create column family Cf with compression_options={sstable_compression:
SnappyCompressor}
SSTable compression is not activated by default but can be activated or
deactivated at any time.
- Compressed SSTable blocks are checksummed to protect against bitrot
-- New LevelDB-inspired compaction algorithm can be enabled by setting the
- Columnfamily compaction_strategy=LeveledCompactionStrategy
[jira] [Created] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Sylvain Lebresne Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
svn commit: r1180076 - in /cassandra/branches/cassandra-1.0.0: ./ conf/ examples/simple_authentication/ examples/simple_authentication/conf/ examples/simple_authentication/src/ examples/simple_authent
Author: slebresne Date: Fri Oct 7 15:29:22 2011 New Revision: 1180076 URL: http://svn.apache.org/viewvc?rev=1180076view=rev Log: Move SimpleAuthenticator and SimpleAuthority to examples/ patch by slebresne; reviewed by jbellis for CASSANDRA-2922 Added: cassandra/branches/cassandra-1.0.0/examples/simple_authentication/ cassandra/branches/cassandra-1.0.0/examples/simple_authentication/README.txt cassandra/branches/cassandra-1.0.0/examples/simple_authentication/conf/ cassandra/branches/cassandra-1.0.0/examples/simple_authentication/conf/access.properties cassandra/branches/cassandra-1.0.0/examples/simple_authentication/conf/passwd.properties cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/ cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/ cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/ cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/ cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/auth/ cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthenticator.java cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthority.java Removed: cassandra/branches/cassandra-1.0.0/conf/access.properties cassandra/branches/cassandra-1.0.0/conf/passwd.properties cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/auth/SimpleAuthenticator.java cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/auth/SimpleAuthority.java cassandra/branches/cassandra-1.0.0/test/unit/org/apache/cassandra/auth/SimpleAuthorityTest.java Modified: cassandra/branches/cassandra-1.0.0/CHANGES.txt cassandra/branches/cassandra-1.0.0/NEWS.txt cassandra/branches/cassandra-1.0.0/conf/README.txt cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/auth/IAuthenticator.java cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cli/CliClient.java cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cli/CliMain.java cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/hadoop/ColumnFamilyOutputFormat.java cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/hadoop/ColumnFamilyRecordReader.java Modified: cassandra/branches/cassandra-1.0.0/CHANGES.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/CHANGES.txt?rev=1180076r1=1180075r2=1180076view=diff == --- cassandra/branches/cassandra-1.0.0/CHANGES.txt (original) +++ cassandra/branches/cassandra-1.0.0/CHANGES.txt Fri Oct 7 15:29:22 2011 @@ -24,6 +24,7 @@ Fixes merged from 0.8 below: * Fix missing fields in CLI `show schema` output (CASSANDRA-3304) * Nodetool no longer leaks threads and closes JMX connections (CASSANDRA-3309) * fix truncate allowing data to be replayed post-restart (CASSANDRA-3297) + * Move SimpleAuthority and SimpleAuthenticator to examples (CASSANDRA-2922) 1.0.0-rc2 Modified: cassandra/branches/cassandra-1.0.0/NEWS.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/NEWS.txt?rev=1180076r1=1180075r2=1180076view=diff == --- cassandra/branches/cassandra-1.0.0/NEWS.txt (original) +++ cassandra/branches/cassandra-1.0.0/NEWS.txt Fri Oct 7 15:29:22 2011 @@ -22,6 +22,10 @@ Upgrading - Cassandra 1.0 uses arena allocation to reduce old generation fragmentation. This means there is a minimum overhead of 1MB per ColumnFamily plus 1MB per index. +- The SimpleAuthenticator and SimpleAuthority classes have been moved to + the example directory (and are thus not available from the binary + distribution). They never provided actual security and in their current + state are only meant as examples. Features Modified: cassandra/branches/cassandra-1.0.0/conf/README.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/conf/README.txt?rev=1180076r1=1180075r2=1180076view=diff == --- cassandra/branches/cassandra-1.0.0/conf/README.txt (original) +++ cassandra/branches/cassandra-1.0.0/conf/README.txt Fri Oct 7 15:29:22 2011 @@ -8,6 +8,4 @@ log4j-server.proprties: log4j configurat Optional configuration files -access.properties: used for authorization -passwd.properties: used for authentication cassandra-topology.properties: used by PropertyFileSnitch Added: cassandra/branches/cassandra-1.0.0/examples/simple_authentication/README.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/examples/simple_authentication/README.txt?rev=1180076view=auto
[jira] [Commented] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13122870#comment-13122870 ] Benjamin Coverston commented on CASSANDRA-3331: --- +1 Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Sylvain Lebresne Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3330) Improve CompactionTask extensibility
[ https://issues.apache.org/jira/browse/CASSANDRA-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13122871#comment-13122871 ] Benjamin Coverston commented on CASSANDRA-3330: --- +1 Improve CompactionTask extensibility Key: CASSANDRA-3330 URL: https://issues.apache.org/jira/browse/CASSANDRA-3330 Project: Cassandra Issue Type: Improvement Components: Core Affects Versions: 1.0.0 Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Labels: compaction Fix For: 1.0.1 Attachments: 3330.txt CompactionTask is still fairly coupled to SizeTieredCompaction, including some ugly casting. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Comment: was deleted (was: +1) Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Sylvain Lebresne Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-3238) Issue with multi region ec2 and replication updates
[ https://issues.apache.org/jira/browse/CASSANDRA-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Lebresne resolved CASSANDRA-3238. - Resolution: Not A Problem Since with dynamic_snitch_badness_threshold the problem goes away, resolving as Not A Problem. Feel free to reopen if you think there is still something to fix here. Issue with multi region ec2 and replication updates --- Key: CASSANDRA-3238 URL: https://issues.apache.org/jira/browse/CASSANDRA-3238 Project: Cassandra Issue Type: Bug Components: Core Affects Versions: 1.0.0 Reporter: Nick Bailey Assignee: Vijay Priority: Minor Fix For: 1.0.0 Using the Ec2MultiRegionSnitch and updating replication settings for a keyspace seems to cause some issues that require a rolling restart to fix. The following was observed when updating a keyspace from SimpleStrategy to NTS in a multi region environment: * All repairs would hang. Even repairs only against a keyspace that was not updated. * Reads at CL.ONE would start to go across region After a rolling restart of the cluster, repairs started working correctly again and reads stayed local to the region. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Lebresne updated CASSANDRA-3331: Fix Version/s: 1.0.0 Assignee: Benjamin Coverston (was: Sylvain Lebresne) Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2802) Enable encryption for data across the DC only.
[ https://issues.apache.org/jira/browse/CASSANDRA-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Williams updated CASSANDRA-2802: Affects Version/s: (was: 0.8.0) Fix Version/s: (was: 0.8.8) 1.0.1 Enable encryption for data across the DC only. -- Key: CASSANDRA-2802 URL: https://issues.apache.org/jira/browse/CASSANDRA-2802 Project: Cassandra Issue Type: New Feature Components: Core Environment: JVM Reporter: Vijay Assignee: Vijay Priority: Minor Fix For: 1.0.1 Attachments: 0001-2802-Commiting-New-Port-For-SSL.patch, 0001-Changes-to-Snitch-to-avoid-NPE-v2.patch, 0002-2802-Changes-to-Snitch-to-avoid-NPE.patch, 0002-Commiting-New-Port-For-SSL-v2.patch, 0003-yaml-changes-for-ssl-port-v2.patch Make DC level Encryption option 1) Modify EncryptionOptions to add inter_dc option. 2) Modify OutboundTCPConnection.connect() to check if it is in the same DC and if the encryption option is enabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CASSANDRA-3332) Build warning at org/apache/cassandra/io/util/Memory.java, is this expected ?
Build warning at org/apache/cassandra/io/util/Memory.java, is this expected ? - Key: CASSANDRA-3332 URL: https://issues.apache.org/jira/browse/CASSANDRA-3332 Project: Cassandra Issue Type: Bug Components: Core Affects Versions: 1.0.1 Environment: trunk Reporter: satish babu krishnamoorthy Priority: Minor Build warning at org/apache/cassandra/io/util/Memory.java, is this expected ? [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:22: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] import sun.misc.Unsafe; [javac]^ [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:28: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] private static final Unsafe unsafe; [javac] ^ [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:34: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] Field field = sun.misc.Unsafe.class.getDeclaredField(theUnsafe); [javac] ^ [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:36: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] unsafe = (sun.misc.Unsafe) field.get(null); [javac] ^ satish@ubuntu:~/workspace/cassandra$ java -version java version 1.6.0_27 Java(TM) SE Runtime Environment (build 1.6.0_27-b07) Java HotSpot(TM) 64-Bit Server VM (build 20.2-b06, mixed mode) satish@ubuntu:~/workspace/cassandra$ javac -version javac 1.6.0_27 satish@ubuntu:~/workspace/cassandra$ svn info Path: . URL: http://svn.apache.org/repos/asf/cassandra/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1180097 Node Kind: directory Schedule: normal Last Changed Author: jbellis Last Changed Rev: 1179902 Last Changed Date: 2011-10-06 17:00:21 -0700 (Thu, 06 Oct 2011) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2863) NPE when writing SSTable generated via repair
[ https://issues.apache.org/jira/browse/CASSANDRA-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13122984#comment-13122984 ] Joaquin Casares commented on CASSANDRA-2863: We've seen the same error via autobootstrap. NPE when writing SSTable generated via repair - Key: CASSANDRA-2863 URL: https://issues.apache.org/jira/browse/CASSANDRA-2863 Project: Cassandra Issue Type: Bug Components: Core Affects Versions: 0.8.1 Reporter: Héctor Izquierdo Fix For: 0.8.8 A NPE is generated during repair when closing an sstable generated via SSTable build. It doesn't happen always. The node had been scrubbed and compacted before calling repair. INFO [CompactionExecutor:2] 2011-07-06 11:11:32,640 SSTableReader.java (line 158) Opening /d2/cassandra/data/sbs/walf-g-730 ERROR [CompactionExecutor:2] 2011-07-06 11:11:34,327 AbstractCassandraDaemon.java (line 113) Fatal exception in thread Thread[CompactionExecutor:2,1,main] java.lang.NullPointerException at org.apache.cassandra.io.sstable.SSTableWriter$RowIndexer.close(SSTableWriter.java:382) at org.apache.cassandra.io.sstable.SSTableWriter$RowIndexer.index(SSTableWriter.java:370) at org.apache.cassandra.io.sstable.SSTableWriter$Builder.build(SSTableWriter.java:315) at org.apache.cassandra.db.compaction.CompactionManager$9.call(CompactionManager.java:1103) at org.apache.cassandra.db.compaction.CompactionManager$9.call(CompactionManager.java:1094) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3314) Fail to delete -Index files if index is currently building
[ https://issues.apache.org/jira/browse/CASSANDRA-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13122993#comment-13122993 ] Pavel Yaskevich commented on CASSANDRA-3314: Interesting thing that I can't reproduce this behavior and don't see in the code what can cause it, can you please provide steps to reproduce? Fail to delete -Index files if index is currently building -- Key: CASSANDRA-3314 URL: https://issues.apache.org/jira/browse/CASSANDRA-3314 Project: Cassandra Issue Type: Bug Reporter: Radim Kolar Assignee: Pavel Yaskevich Priority: Minor Fix For: 0.8.8, 1.0.0 If there is index building in progress, following errors are thrown if cassandra is trying to delete *-Index.db files. There is no problem with deleting -Data or -Filter.. files. CF is using leveled compaction but it is probably not related. ERROR [NonPeriodicTasks:1] 2011-10-05 09:13:03,702 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.io.IOException: Failed to delete C:\var\lib\cas sandra\data\test\sipdb-h-772-Index.db at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:3 4) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:44 1) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec utor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:908) at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3299) clientutil depends on FBUtilities (bad)
[
https://issues.apache.org/jira/browse/CASSANDRA-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13122995#comment-13122995
]
Jonathan Ellis commented on CASSANDRA-3299:
---
True enough. Not a big deal either way, let's go with what you have.
clientutil depends on FBUtilities (bad)
---
Key: CASSANDRA-3299
URL: https://issues.apache.org/jira/browse/CASSANDRA-3299
Project: Cassandra
Issue Type: Bug
Components: API, Drivers
Affects Versions: 1.0.0
Reporter: Eric Evans
Assignee: Eric Evans
Labels: cql
Fix For: 1.0.1
Attachments:
v1-0001-CASSANDRA-3299-move-FBUtils-methods-for-bytes-hex-to-s.txt
clientutils' (indirect )dependency on FBUtilities (needed for tests) would
result in huge numbers of classes being pulled in transitively.
The attached patch moves the {{bytesToHex}} and {{hexToBytes}} methods into a
new class ({{o.a.c.utils.Hex}}), which has no external dependencies.
This should be pretty safe, but I've marked it fixfor-1.0.1 since we're so
close to release, and because the JDBC driver can embed a snapshot jar in the
meantime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-3332) Build warning at org/apache/cassandra/io/util/Memory.java, is this expected ?
[ https://issues.apache.org/jira/browse/CASSANDRA-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis resolved CASSANDRA-3332. --- Resolution: Not A Problem Yes, this is expected. (See CASSANDRA-3271.) Build warning at org/apache/cassandra/io/util/Memory.java, is this expected ? - Key: CASSANDRA-3332 URL: https://issues.apache.org/jira/browse/CASSANDRA-3332 Project: Cassandra Issue Type: Bug Components: Core Affects Versions: 1.0.1 Environment: trunk Reporter: satish babu krishnamoorthy Priority: Minor Labels: build Build warning at org/apache/cassandra/io/util/Memory.java, is this expected ? [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:22: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] import sun.misc.Unsafe; [javac]^ [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:28: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] private static final Unsafe unsafe; [javac] ^ [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:34: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] Field field = sun.misc.Unsafe.class.getDeclaredField(theUnsafe); [javac] ^ [javac] /home/satish/workspace/cassandra/src/java/org/apache/cassandra/io/util/Memory.java:36: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [javac] unsafe = (sun.misc.Unsafe) field.get(null); [javac] ^ satish@ubuntu:~/workspace/cassandra$ java -version java version 1.6.0_27 Java(TM) SE Runtime Environment (build 1.6.0_27-b07) Java HotSpot(TM) 64-Bit Server VM (build 20.2-b06, mixed mode) satish@ubuntu:~/workspace/cassandra$ javac -version javac 1.6.0_27 satish@ubuntu:~/workspace/cassandra$ svn info Path: . URL: http://svn.apache.org/repos/asf/cassandra/trunk Repository Root: http://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1180097 Node Kind: directory Schedule: normal Last Changed Author: jbellis Last Changed Rev: 1179902 Last Changed Date: 2011-10-06 17:00:21 -0700 (Thu, 06 Oct 2011) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (CASSANDRA-2863) NPE when writing SSTable generated via repair
[ https://issues.apache.org/jira/browse/CASSANDRA-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis reassigned CASSANDRA-2863: - Assignee: Sylvain Lebresne Joaquin, can you give steps to reproduce? NPE when writing SSTable generated via repair - Key: CASSANDRA-2863 URL: https://issues.apache.org/jira/browse/CASSANDRA-2863 Project: Cassandra Issue Type: Bug Components: Core Affects Versions: 0.8.1 Reporter: Héctor Izquierdo Assignee: Sylvain Lebresne Fix For: 0.8.8 A NPE is generated during repair when closing an sstable generated via SSTable build. It doesn't happen always. The node had been scrubbed and compacted before calling repair. INFO [CompactionExecutor:2] 2011-07-06 11:11:32,640 SSTableReader.java (line 158) Opening /d2/cassandra/data/sbs/walf-g-730 ERROR [CompactionExecutor:2] 2011-07-06 11:11:34,327 AbstractCassandraDaemon.java (line 113) Fatal exception in thread Thread[CompactionExecutor:2,1,main] java.lang.NullPointerException at org.apache.cassandra.io.sstable.SSTableWriter$RowIndexer.close(SSTableWriter.java:382) at org.apache.cassandra.io.sstable.SSTableWriter$RowIndexer.index(SSTableWriter.java:370) at org.apache.cassandra.io.sstable.SSTableWriter$Builder.build(SSTableWriter.java:315) at org.apache.cassandra.db.compaction.CompactionManager$9.call(CompactionManager.java:1103) at org.apache.cassandra.db.compaction.CompactionManager$9.call(CompactionManager.java:1094) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Attachment: 0001-add-files-to-src-and-bin-add-uninstall.patch Modified the batch file to include a switch for UNINSTALL. Also added the files in the ./bin/daemon directory Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Attachment: (was: 0001-add-files-to-src-and-bin-add-uninstall.patch) Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (CASSANDRA-3314) Fail to delete -Index files if index is currently building
[ https://issues.apache.org/jira/browse/CASSANDRA-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis reassigned CASSANDRA-3314: - Assignee: (was: Pavel Yaskevich) Also, would be good to know if you can reproduce in latest 0.8, as I would expect. Fail to delete -Index files if index is currently building -- Key: CASSANDRA-3314 URL: https://issues.apache.org/jira/browse/CASSANDRA-3314 Project: Cassandra Issue Type: Bug Reporter: Radim Kolar Priority: Minor Fix For: 0.8.8, 1.0.0 If there is index building in progress, following errors are thrown if cassandra is trying to delete *-Index.db files. There is no problem with deleting -Data or -Filter.. files. CF is using leveled compaction but it is probably not related. ERROR [NonPeriodicTasks:1] 2011-10-05 09:13:03,702 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.io.IOException: Failed to delete C:\var\lib\cas sandra\data\test\sipdb-h-772-Index.db at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:3 4) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:44 1) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec utor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:908) at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Comment: was deleted (was: Modified the batch file to include a switch for UNINSTALL. Also added the files in the ./bin/daemon directory) Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Attachments: 0001-add-files-to-src-and-bin-add-uninstall.patch Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Attachment: 0001-add-files-to-src-and-bin-add-uninstall.patch Added INSTALL option to the batch file. Also included the bin/daemon directory along with the files and licenses. Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Attachments: 0001-add-files-to-src-and-bin-add-uninstall.patch Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3314) Fail to delete -Index files if index is currently building
[ https://issues.apache.org/jira/browse/CASSANDRA-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123015#comment-13123015 ] Pavel Yaskevich commented on CASSANDRA-3314: Tried on both latest 0.8 and 1.0.0 with disk_access_mode: standard and with/without secondary indexes (used stress.java to populate system with data and nodetool to run different operations) and couldn't reproduce... Fail to delete -Index files if index is currently building -- Key: CASSANDRA-3314 URL: https://issues.apache.org/jira/browse/CASSANDRA-3314 Project: Cassandra Issue Type: Bug Reporter: Radim Kolar Priority: Minor Fix For: 0.8.8, 1.0.0 If there is index building in progress, following errors are thrown if cassandra is trying to delete *-Index.db files. There is no problem with deleting -Data or -Filter.. files. CF is using leveled compaction but it is probably not related. ERROR [NonPeriodicTasks:1] 2011-10-05 09:13:03,702 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.io.IOException: Failed to delete C:\var\lib\cas sandra\data\test\sipdb-h-772-Index.db at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:3 4) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:44 1) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec utor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:908) at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Attachment: (was: 0002-adding-daemon-directory.patch) Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Attachments: 0001-add-files-to-src-and-bin-add-uninstall.patch, 0002-adding-daemon-directory.patch Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Attachment: 0002-adding-daemon-directory.patch Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Attachments: 0001-add-files-to-src-and-bin-add-uninstall.patch, 0002-adding-daemon-directory.patch Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3331) Apache Daemon missing from the binary tarball
[ https://issues.apache.org/jira/browse/CASSANDRA-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Coverston updated CASSANDRA-3331: -- Attachment: 0002-adding-daemon-directory.patch Apache Daemon missing from the binary tarball - Key: CASSANDRA-3331 URL: https://issues.apache.org/jira/browse/CASSANDRA-3331 Project: Cassandra Issue Type: Bug Affects Versions: 1.0.0 Reporter: Benjamin Coverston Assignee: Benjamin Coverston Fix For: 1.0.0 Attachments: 0001-add-files-to-src-and-bin-add-uninstall.patch, 0002-adding-daemon-directory.patch Apparently the tools used to run the binary release are missing from the binary tarball. I will verify that they are in the 1.0 branch, then update the ticket so we can ensure that they are included. Ben -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
svn commit: r1180133 - /cassandra/branches/cassandra-1.0.0/NEWS.txt
Author: jbellis Date: Fri Oct 7 18:24:41 2011 New Revision: 1180133 URL: http://svn.apache.org/viewvc?rev=1180133view=rev Log: update NEWS Modified: cassandra/branches/cassandra-1.0.0/NEWS.txt Modified: cassandra/branches/cassandra-1.0.0/NEWS.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/NEWS.txt?rev=1180133r1=1180132r2=1180133view=diff == --- cassandra/branches/cassandra-1.0.0/NEWS.txt (original) +++ cassandra/branches/cassandra-1.0.0/NEWS.txt Fri Oct 7 18:24:41 2011 @@ -3,6 +3,12 @@ Upgrading - +- Upgrading from version 0.7.1+ or 0.8.2+ can be done with a rolling + restart, one node at a time. (0.8.0 or 0.8.1 are NOT network-compatible + with 1.0: upgrade to the most recent 0.8 release first.) + You do not need to bring down the whole cluster at once. +- After upgrading, run nodetool scrub against each node before running + repair, moving nodes, or adding new ones. - CQL inserts/updates now generate microsecond resolution timestamps by default, instead of millisecond. THIS MEANS A ROLLING UPGRADE COULD MIX milliseconds and microseconds, with clients talking to servers @@ -19,9 +25,9 @@ Upgrading - CQL types bytea and date were renamed to blob and timestamp, respectively, to conform with SQL norms. CQL type int is now a 4-byte int, not 8 (which is still available as bigint). -- Cassandra 1.0 uses arena allocation to reduce old generation fragmentation. - This means there is a minimum overhead of 1MB per ColumnFamily plus - 1MB per index. +- Cassandra 1.0 uses arena allocation to reduce old generation + fragmentation. This means there is a minimum overhead of 1MB + per ColumnFamily plus 1MB per index. - The SimpleAuthenticator and SimpleAuthority classes have been moved to the example directory (and are thus not available from the binary distribution). They never provided actual security and in their current
svn commit: r1180157 - in /cassandra/branches/cassandra-1.0.0: ./ bin/ bin/daemon/ tools/stress/bin/
Author: jbellis Date: Fri Oct 7 19:03:06 2011 New Revision: 1180157 URL: http://svn.apache.org/viewvc?rev=1180157view=rev Log: add bin/daemon to release tarball patch by bcoverston; reviewed by jbellis for CASSANDRA-3331 Added: cassandra/branches/cassandra-1.0.0/bin/daemon/ cassandra/branches/cassandra-1.0.0/bin/daemon/LICENSE.txt cassandra/branches/cassandra-1.0.0/bin/daemon/NOTICE.txt cassandra/branches/cassandra-1.0.0/bin/daemon/RELEASE-NOTES.txt cassandra/branches/cassandra-1.0.0/bin/daemon/prunmgr.exe (with props) cassandra/branches/cassandra-1.0.0/bin/daemon/prunsrv.exe (with props) Modified: cassandra/branches/cassandra-1.0.0/CHANGES.txt cassandra/branches/cassandra-1.0.0/README.txt cassandra/branches/cassandra-1.0.0/bin/cassandra.bat cassandra/branches/cassandra-1.0.0/build.xml cassandra/branches/cassandra-1.0.0/tools/stress/bin/stress.bat Modified: cassandra/branches/cassandra-1.0.0/CHANGES.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/CHANGES.txt?rev=1180157r1=1180156r2=1180157view=diff == --- cassandra/branches/cassandra-1.0.0/CHANGES.txt (original) +++ cassandra/branches/cassandra-1.0.0/CHANGES.txt Fri Oct 7 19:03:06 2011 @@ -11,6 +11,7 @@ * avoid including compaction cache-warming in keycache stats (CASSANDRA-3325) * run compaction and hinted handoff threads at MIN_PRIORITY (CASSANDRA-3308) * default hsha thrift server to cpu core count in rpc pool (CASSANDRA-3329) + * add bin\daemon to binary tarball for Windows service (CASSANDRA-3331) Fixes merged from 0.8 below: * Fix tool .bat files when CASSANDRA_HOME contains spaces (CASSANDRA-3258) * Force flush of status table when removing/updating token (CASSANDRA-3243) Modified: cassandra/branches/cassandra-1.0.0/README.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/README.txt?rev=1180157r1=1180156r2=1180157view=diff == --- cassandra/branches/cassandra-1.0.0/README.txt (original) +++ cassandra/branches/cassandra-1.0.0/README.txt Fri Oct 7 19:03:06 2011 @@ -41,7 +41,7 @@ Now that we're ready, let's start it up! (Running the startup script with the -f argument will cause Cassandra to remain in the foreground and log to standard out. On windows, running it with the 'install' argument instead will install Cassandra as a -Windows Service.) +Windows Service, and 'uninstall' will remove it.) Now let's try to read and write some data using the command line client. Modified: cassandra/branches/cassandra-1.0.0/bin/cassandra.bat URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/bin/cassandra.bat?rev=1180157r1=1180156r2=1180157view=diff == --- cassandra/branches/cassandra-1.0.0/bin/cassandra.bat (original) +++ cassandra/branches/cassandra-1.0.0/bin/cassandra.bat Fri Oct 7 19:03:06 2011 @@ -14,8 +14,11 @@ @REM See the License for the specific language governing permissions and @REM limitations under the License. +@echo off + set ARG=%1 set INSTALL=INSTALL +set UNINSTALL=UNINSTALL pushd %~dp0.. if NOT DEFINED CASSANDRA_HOME set CASSANDRA_HOME=%CD% @@ -60,7 +63,8 @@ goto :eof REM Include the build\classes\main directory so it works in development set CASSANDRA_CLASSPATH=%CLASSPATH%;%CASSANDRA_HOME%\build\classes\main;%CASSANDRA_HOME%\build\classes\thrift set CASSANDRA_PARAMS=-Dcassandra -Dcassandra-foreground=yes -if /i %ARG% == INSTALL goto installService +if /i %ARG% == INSTALL goto doInstallOperation +if /i %ARG% == UNINSTALL goto doInstallOperation goto runDaemon @@ -69,7 +73,7 @@ echo Starting Cassandra Server %JAVA_HOME%\bin\java %JAVA_OPTS% %CASSANDRA_PARAMS% -cp %CASSANDRA_CLASSPATH% %CASSANDRA_MAIN% goto finally -:installService +:doInstallOperation set SERVICE_JVM=cassandra rem location of Prunsrv set PATH_PRUNSRV=%CASSANDRA_HOME%\bin\daemon\ @@ -81,15 +85,17 @@ set JAVA_OPTS_DELM=%JAVA_OPTS: -=;-% rem Allow prunsrv to be overridden if %PRUNSRV% == set PRUNSRV=%PATH_PRUNSRV%prunsrv -rem Install the service echo trying to delete service if it has been created already -%PRUNSRV% //DS//%SERVICE_JVM% -echo Installing %SERVICE_JVM% -%PRUNSRV% //IS//%SERVICE_JVM% - +%PRUNSRV% //DS//%SERVICE_JVM% +rem quit if we're just going to uninstall +if /i %ARG% == UNINSTALL goto finally + +echo. +echo Installing %SERVICE_JVM%. If you get registry warnings, re-run as an Administrator +%PRUNSRV% //IS//%SERVICE_JVM% echo Setting the parameters for %SERVICE_JVM% rem set PR_CLASSPATH=%CASSANDRA_CLASSPATH% -%PRUNSRV% //US//%SERVICE_JVM% ^ +%PRUNSRV% //US//%SERVICE_JVM% ^ --Jvm=auto --StdOutput auto --StdError auto ^ --Classpath=%CASSANDRA_CLASSPATH% ^ --StartMode=jvm --StartClass=%CASSANDRA_MAIN% --StartMethod=main ^ Added:
svn commit: r1180158 - in /cassandra/branches/cassandra-1.0: ./ bin/ bin/daemon/ conf/ contrib/ examples/simple_authentication/ examples/simple_authentication/conf/ examples/simple_authentication/src/
Author: jbellis Date: Fri Oct 7 19:08:20 2011 New Revision: 1180158 URL: http://svn.apache.org/viewvc?rev=1180158view=rev Log: merge from 1.0.0 Added: cassandra/branches/cassandra-1.0/bin/daemon/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/bin/daemon/ cassandra/branches/cassandra-1.0/bin/daemon/LICENSE.txt - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/bin/daemon/LICENSE.txt cassandra/branches/cassandra-1.0/bin/daemon/NOTICE.txt - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/bin/daemon/NOTICE.txt cassandra/branches/cassandra-1.0/bin/daemon/RELEASE-NOTES.txt - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/bin/daemon/RELEASE-NOTES.txt cassandra/branches/cassandra-1.0/bin/daemon/prunmgr.exe - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/bin/daemon/prunmgr.exe cassandra/branches/cassandra-1.0/bin/daemon/prunsrv.exe - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/bin/daemon/prunsrv.exe cassandra/branches/cassandra-1.0/examples/simple_authentication/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/ cassandra/branches/cassandra-1.0/examples/simple_authentication/README.txt - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/README.txt cassandra/branches/cassandra-1.0/examples/simple_authentication/conf/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/conf/ cassandra/branches/cassandra-1.0/examples/simple_authentication/conf/access.properties - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/conf/access.properties cassandra/branches/cassandra-1.0/examples/simple_authentication/conf/passwd.properties - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/conf/passwd.properties cassandra/branches/cassandra-1.0/examples/simple_authentication/src/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/ cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/ cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/ cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/ cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/auth/ - copied from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/auth/ cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthenticator.java - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthenticator.java cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthority.java - copied unchanged from r1180157, cassandra/branches/cassandra-1.0.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthority.java Removed: cassandra/branches/cassandra-1.0/conf/access.properties cassandra/branches/cassandra-1.0/conf/passwd.properties cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/auth/SimpleAuthenticator.java cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/auth/SimpleAuthority.java cassandra/branches/cassandra-1.0/test/unit/org/apache/cassandra/auth/SimpleAuthorityTest.java Modified: cassandra/branches/cassandra-1.0/ (props changed) cassandra/branches/cassandra-1.0/CHANGES.txt cassandra/branches/cassandra-1.0/NEWS.txt cassandra/branches/cassandra-1.0/README.txt cassandra/branches/cassandra-1.0/bin/cassandra.bat cassandra/branches/cassandra-1.0/build.xml cassandra/branches/cassandra-1.0/conf/README.txt cassandra/branches/cassandra-1.0/conf/cassandra.yaml cassandra/branches/cassandra-1.0/contrib/ (props changed) cassandra/branches/cassandra-1.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java (props changed) cassandra/branches/cassandra-1.0/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java (props changed) cassandra/branches/cassandra-1.0/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java (props changed)
svn commit: r1180159 - in /cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction: CompactionTask.java LeveledCompactionStrategy.java LeveledCompactionTask.java LeveledManifest.j
Author: jbellis
Date: Fri Oct 7 19:09:10 2011
New Revision: 1180159
URL: http://svn.apache.org/viewvc?rev=1180159view=rev
Log:
clean up CompactionTask
patch by jbellis; reviewed by bcoverston for CASSANDRA-3330
Modified:
cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/CompactionTask.java
cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/LeveledCompactionStrategy.java
cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/LeveledCompactionTask.java
cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/LeveledManifest.java
Modified:
cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/CompactionTask.java
URL:
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/CompactionTask.java?rev=1180159r1=1180158r2=1180159view=diff
==
---
cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/CompactionTask.java
(original)
+++
cassandra/branches/cassandra-1.0/src/java/org/apache/cassandra/db/compaction/CompactionTask.java
Fri Oct 7 19:09:10 2011
@@ -39,7 +39,7 @@ import org.apache.cassandra.utils.Closea
public class CompactionTask extends AbstractCompactionTask
{
-private static final Logger logger =
LoggerFactory.getLogger(CompactionTask.class);
+protected static final Logger logger =
LoggerFactory.getLogger(CompactionTask.class);
protected String compactionFileLocation;
protected final int gcBefore;
protected boolean isUserDefined;
@@ -70,20 +70,13 @@ public class CompactionTask extends Abst
assert sstables != null;
SetSSTableReader toCompact = new HashSetSSTableReader(sstables);
-if (!isUserDefined)
-{
-if (!allowSingletonCompaction() toCompact.size() 2)
-{
-String msg = Nothing to compact in +
cfs.getColumnFamilyName();
-if (cfs.getCompactionStrategy() instanceof
SizeTieredCompactionStrategy)
-msg += . Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection);
-logger.info(msg);
-return 0;
-}
-
-if (compactionFileLocation == null)
-compactionFileLocation =
cfs.table.getDataFileLocation(cfs.getExpectedCompactedFileSize(toCompact));
+if (!isCompactionInteresting(toCompact))
+return 0;
+if (compactionFileLocation == null)
+compactionFileLocation =
cfs.table.getDataFileLocation(cfs.getExpectedCompactedFileSize(toCompact));
+if (partialCompactionsAcceptable())
+{
// If the compaction file path is null that means we have no space
left for this compaction.
// Try again w/o the largest one.
if (compactionFileLocation == null)
@@ -219,12 +212,17 @@ public class CompactionTask extends Abst
builder.append(]);
double mbps = dTime 0 ?
(double)endsize/(1024*1024)/((double)dTime/1000) : 0;
-logger.info(String.format(Compacted to %s. %,d to %,d (~%d%% of
original) bytes for %,d keys at %fMBPS. Time: %,dms.,
+logger.info(String.format(Compacted to %s. %,d to %,d (~%d%% of
original) bytes for %,d keys at %fMB/s. Time: %,dms.,
builder.toString(), startsize, endsize,
(int) (ratio * 100), totalkeysWritten, mbps, dTime));
logger.debug(String.format(CF Total Bytes Compacted: %,d,
CompactionTask.addToTotalBytesCompacted(endsize)));
return toCompact.size();
}
+protected boolean partialCompactionsAcceptable()
+{
+return !isUserDefined;
+}
+
//extensibility point for other strategies that may want to limit the
upper bounds of the sstable segment size
protected boolean newSSTableSegmentThresholdReached(SSTableWriter writer,
long position)
{
@@ -232,11 +230,15 @@ public class CompactionTask extends Abst
}
/**
- * extend this if the overridden compaction strategy requires single files
to be compacted to function properly
- * @return boolean
+ * @return true if the proposed compaction is worth proceeding with. We
allow leveled compaction to
+ * override this to allow promoting sstables from one level to another
w/o rewriting them, if there is no overlapping.
*/
-protected boolean allowSingletonCompaction()
+protected boolean isCompactionInteresting(SetSSTableReader toCompact)
{
+if (isUserDefined || toCompact.size() = 2)
+return true;
+logger.info(String.format(Nothing to compact in %s. Use
forceUserDefinedCompaction if you wish to force compaction of single sstables
(e.g. for tombstone collection),
+
[jira] [Resolved] (CASSANDRA-3330) Improve CompactionTask extensibility
[ https://issues.apache.org/jira/browse/CASSANDRA-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis resolved CASSANDRA-3330. --- Resolution: Fixed committed Improve CompactionTask extensibility Key: CASSANDRA-3330 URL: https://issues.apache.org/jira/browse/CASSANDRA-3330 Project: Cassandra Issue Type: Improvement Components: Core Affects Versions: 1.0.0 Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Labels: compaction Fix For: 1.0.1 Attachments: 3330.txt CompactionTask is still fairly coupled to SizeTieredCompaction, including some ugly casting. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
svn commit: r1180164 - in /cassandra/trunk: ./ bin/ bin/daemon/ conf/ contrib/ examples/simple_authentication/ examples/simple_authentication/conf/ examples/simple_authentication/src/ examples/simple_
Author: jbellis Date: Fri Oct 7 19:13:04 2011 New Revision: 1180164 URL: http://svn.apache.org/viewvc?rev=1180164view=rev Log: merge from 1.0 Added: cassandra/trunk/bin/daemon/ - copied from r1180160, cassandra/branches/cassandra-1.0/bin/daemon/ cassandra/trunk/bin/daemon/LICENSE.txt - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/bin/daemon/LICENSE.txt cassandra/trunk/bin/daemon/NOTICE.txt - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/bin/daemon/NOTICE.txt cassandra/trunk/bin/daemon/RELEASE-NOTES.txt - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/bin/daemon/RELEASE-NOTES.txt cassandra/trunk/bin/daemon/prunmgr.exe - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/bin/daemon/prunmgr.exe cassandra/trunk/bin/daemon/prunsrv.exe - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/bin/daemon/prunsrv.exe cassandra/trunk/examples/simple_authentication/ - copied from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/ cassandra/trunk/examples/simple_authentication/README.txt - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/README.txt cassandra/trunk/examples/simple_authentication/conf/ - copied from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/conf/ cassandra/trunk/examples/simple_authentication/conf/access.properties - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/conf/access.properties cassandra/trunk/examples/simple_authentication/conf/passwd.properties - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/conf/passwd.properties cassandra/trunk/examples/simple_authentication/src/ - copied from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/src/ cassandra/trunk/examples/simple_authentication/src/org/ - copied from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/ cassandra/trunk/examples/simple_authentication/src/org/apache/ - copied from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/ cassandra/trunk/examples/simple_authentication/src/org/apache/cassandra/ - copied from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/ cassandra/trunk/examples/simple_authentication/src/org/apache/cassandra/auth/ - copied from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/auth/ cassandra/trunk/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthenticator.java - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthenticator.java cassandra/trunk/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthority.java - copied unchanged from r1180160, cassandra/branches/cassandra-1.0/examples/simple_authentication/src/org/apache/cassandra/auth/SimpleAuthority.java Removed: cassandra/trunk/conf/access.properties cassandra/trunk/conf/passwd.properties cassandra/trunk/src/java/org/apache/cassandra/auth/SimpleAuthenticator.java cassandra/trunk/src/java/org/apache/cassandra/auth/SimpleAuthority.java cassandra/trunk/test/unit/org/apache/cassandra/auth/SimpleAuthorityTest.java Modified: cassandra/trunk/ (props changed) cassandra/trunk/CHANGES.txt cassandra/trunk/NEWS.txt cassandra/trunk/README.txt cassandra/trunk/bin/cassandra.bat cassandra/trunk/build.xml cassandra/trunk/conf/README.txt cassandra/trunk/conf/cassandra.yaml cassandra/trunk/contrib/ (props changed) cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java (props changed) cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java (props changed) cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java (props changed) cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/NotFoundException.java (props changed) cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/SuperColumn.java (props changed) cassandra/trunk/src/java/org/apache/cassandra/auth/IAuthenticator.java cassandra/trunk/src/java/org/apache/cassandra/cli/CliClient.java cassandra/trunk/src/java/org/apache/cassandra/cli/CliMain.java cassandra/trunk/src/java/org/apache/cassandra/config/Config.java cassandra/trunk/src/java/org/apache/cassandra/config/DatabaseDescriptor.java cassandra/trunk/src/java/org/apache/cassandra/db/compaction/CompactionTask.java
[jira] [Created] (CASSANDRA-3333) remove more copies from read/write network path
remove more copies from read/write network path --- Key: CASSANDRA- URL: https://issues.apache.org/jira/browse/CASSANDRA- Project: Cassandra Issue Type: Improvement Components: Core Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Fix For: 1.0.1 RowMutation.serializedBuffer and ReadVerbHandler both do an extra copy of the serialized data. We can avoid this be pre-computing the serialized size and allocating an appropriate buffer. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3333) remove more copies from read/write network path
[ https://issues.apache.org/jira/browse/CASSANDRA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-: -- Attachment: 0002-reduce-copies.patch 0001-clean-up-Serializer-mess.patch 01 cleans up the serializer snafu we've been living with 02 actually does the optimization Prior to this patch we had three generic serializers: ICompactSerializer, which is used by Messages, and whose de/serialize methods have version parameters ICompactSerializer2, which does not have versions and whose methods have DataInput/Output parameters instead of Input/OutputStreams. (The former is a superset of the later.) ICompactSerializer3, which extends ICS2 and adds serializedSize. To do this optimization I'd need ICS4, since I want serializedSize AND versioning. Instead, I've replaced the three old interfaces with just ISerializer and IVersionedSerializer. Both use DataInput/Output, and both have a serializedSize method; the difference is that the former does not have a version parameter. Implementers that don't care about precomputing size simply implement as UnsupportedOperation. A few serializers (in LegacyBloomFilter and MerkleTree) still needed a Stream parameter because they are doing JDK serialization under the hood. None of that code actually cares about using a generic Serializer interface, so I just made them one-off classes and everything was happy. remove more copies from read/write network path --- Key: CASSANDRA- URL: https://issues.apache.org/jira/browse/CASSANDRA- Project: Cassandra Issue Type: Improvement Components: Core Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Fix For: 1.0.1 Attachments: 0001-clean-up-Serializer-mess.patch, 0002-reduce-copies.patch RowMutation.serializedBuffer and ReadVerbHandler both do an extra copy of the serialized data. We can avoid this be pre-computing the serialized size and allocating an appropriate buffer. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CASSANDRA-3334) dropping index causes some inflight mutations to fail
dropping index causes some inflight mutations to fail
-
Key: CASSANDRA-3334
URL: https://issues.apache.org/jira/browse/CASSANDRA-3334
Project: Cassandra
Issue Type: Bug
Components: Core
Affects Versions: 1.0.0
Environment: windows
Reporter: Radim Kolar
Priority: Minor
dropping index causes some inflight mutations to fail. hector on client side
didnt throw any exception
INFO [MigrationStage:1] 2011-10-07 23:11:53,742 Migration.java (line 119)
Applying migration fb1a8540-f128-11e0--23b38323f4da Update column family to
org.apache.cassandra.config.CFMetaData@786669[cfId=1000,ksName=test,cfName=sipdb,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=null,comment=phone
calls routing
information,rowCacheSize=0.0,keyCacheSize=0.0,readRepairChance=0.0,replicateOnWrite=false,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.Int32Type,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.ConcurrentLinkedHashCacheProvider@8bb33c,mergeShardsChance=0.1,keyAlias=java.nio.HeapByteBuffer[pos=461
lim=464 cap=466],column_metadata={java.nio.HeapByteBuffer[pos=0 lim=3
cap=3]=ColumnDefinition{name=6b616d,
validator=org.apache.cassandra.db.marshal.AsciiType, index_type=null,
index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
INFO [MigrationStage:1] 2011-10-07 23:11:53,805 ColumnFamilyStore.java (line
664) Enqueuing flush of Memtable-Migrations@27537043(7860/9825 serialized/live
bytes, 1 ops)
INFO [MigrationStage:1] 2011-10-07 23:11:53,820 ColumnFamilyStore.java (line
664) Enqueuing flush of Memtable-Schema@8340427(3320/4150 serialized/live
bytes, 3 ops)
INFO [FlushWriter:3] 2011-10-07 23:11:53,820 Memtable.java (line 237) Writing
Memtable-Migrations@27537043(7860/9825 serialized/live bytes, 1 ops)
INFO [FlushWriter:3] 2011-10-07 23:11:55,008 Memtable.java (line 273)
Completed flushing \var\lib\cassandra\data\system\Migrations-h-14-Data.db (7924
bytes)
INFO [FlushWriter:3] 2011-10-07 23:11:55,008 Memtable.java (line 237) Writing
Memtable-Schema@8340427(3320/4150 serialized/live bytes, 3 ops)
INFO [CompactionExecutor:4] 2011-10-07 23:11:55,008 CompactionTask.java (line
119) Compacting
[SSTableReader(path='\var\lib\cassandra\data\system\Migrations-h-13-Data.db'),
SSTableReader(path='\var\lib\cassandra\data\system\Migrations-h-14-Data.db'),
SSTableReader(path='\var\lib\cassandra\data\system\Migrations-h-11-Data.db'),
SSTableReader(path='\var\lib\cassandra\data\system\Migrations-h-12-Data.db')]
INFO [FlushWriter:3] 2011-10-07 23:11:56,430 Memtable.java (line 273)
Completed flushing \var\lib\cassandra\data\system\Schema-h-14-Data.db (3470
bytes)
INFO [CompactionExecutor:3] 2011-10-07 23:11:56,446 CompactionTask.java (line
119) Compacting
[SSTableReader(path='\var\lib\cassandra\data\system\Schema-h-13-Data.db'),
SSTableReader(path='\var\lib\cassandra\data\system\Schema-h-14-Data.db'),
SSTableReader(path='\var\lib\cassandra\data\system\Schema-h-12-Data.db'),
SSTableReader(path='\var\lib\cassandra\data\system\Schema-h-11-Data.db')]
ERROR [MutationStage:56] 2011-10-07 23:11:56,508 AbstractCassandraDaemon.java
(line 133) Fatal exception in thread Thread[MutationStage:56,5,main]
java.lang.AssertionError
at
org.apache.cassandra.db.index.SecondaryIndexManager.applyIndexUpdates(SecondaryIndexManager.java:369)
at org.apache.cassandra.db.Table.apply(Table.java:457)
at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:253)
at
org.apache.cassandra.service.StorageProxy$5.runMayThrow(StorageProxy.java:436)
at
org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1263)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
ERROR [MutationStage:51] 2011-10-07 23:11:56,539 AbstractCassandraDaemon.java
(line 133) Fatal exception in thread Thread[MutationStage:51,5,main]
java.lang.AssertionError
at
org.apache.cassandra.db.index.SecondaryIndexManager.applyIndexUpdates(SecondaryIndexManager.java:369)
at org.apache.cassandra.db.Table.apply(Table.java:457)
at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:253)
at
org.apache.cassandra.service.StorageProxy$5.runMayThrow(StorageProxy.java:436)
at
org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1263)
at
[jira] [Commented] (CASSANDRA-3314) Fail to delete -Index files if index is currently building
[ https://issues.apache.org/jira/browse/CASSANDRA-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123207#comment-13123207 ] Radim Kolar commented on CASSANDRA-3314: load table with data ( 2 m rows used). start index build, it will take a while. During index building run read/write test which will write enough data to trigger table compaction. i didnt tested it on 0.8 Fail to delete -Index files if index is currently building -- Key: CASSANDRA-3314 URL: https://issues.apache.org/jira/browse/CASSANDRA-3314 Project: Cassandra Issue Type: Bug Reporter: Radim Kolar Priority: Minor Fix For: 0.8.8, 1.0.0 If there is index building in progress, following errors are thrown if cassandra is trying to delete *-Index.db files. There is no problem with deleting -Data or -Filter.. files. CF is using leveled compaction but it is probably not related. ERROR [NonPeriodicTasks:1] 2011-10-05 09:13:03,702 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.io.IOException: Failed to delete C:\var\lib\cas sandra\data\test\sipdb-h-772-Index.db at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:3 4) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:44 1) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. access$301(ScheduledThreadPoolExecutor.java:98) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. run(ScheduledThreadPoolExecutor.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec utor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:908) at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2819) Split rpc timeout for read and write ops
[ https://issues.apache.org/jira/browse/CASSANDRA-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-2819: -- Attachment: 2819-v5-rebased.txt rebased to trunk. (IAsyncCancellableCallback is not included in the patch, so I took my best guess at one.) Comments: - Writes still use the old rpc_timeout - would prefer to rename old rpc_timeout to other_rpc_timout and comment what it's used for (truncate, ?) - looks like most remaining uses of old rpc_timeout should really be max(different timeouts) - currently, expiring map checks callbacks for expiration every 1/2 of default timeout. This means short timeouts could go much longer than desired, before being cancelled. I see two options: go back to direct await(timeout) in the callback/response handlers, or update EM to scan much more frequently (which could burn a lot of CPU for a system with many outstanding callbacks) Split rpc timeout for read and write ops Key: CASSANDRA-2819 URL: https://issues.apache.org/jira/browse/CASSANDRA-2819 Project: Cassandra Issue Type: New Feature Components: Core Reporter: Stu Hood Assignee: Melvin Wang Fix For: 1.0.1 Attachments: 2819-v4.txt, 2819-v5-rebased.txt, c2819.patch, rpc-jira.patch Given the vastly different latency characteristics of reads and writes, it makes sense for them to have independent rpc timeouts internally. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3314) Fail to delete -Index files if index is currently building
[
https://issues.apache.org/jira/browse/CASSANDRA-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123214#comment-13123214
]
Radim Kolar commented on CASSANDRA-3314:
Here is larger segment of log, since index building started. I can reproduce it
any time. Ignore bug _Nothing to compact in sipdb_, its not related. Its other
leveldb compaction bug.
INFO [MigrationStage:1] 2011-10-07 23:24:35,293 Migration.java (line 119)
Applying migration c12c20d0-f12a-11e0--23b38323f4da Update column family to
org.apache.cassandra.config.CFMetaData@7c401b[cfId=1000,ksName=test,cfName=sipdb,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=null,comment=phone
calls routing
information,rowCacheSize=0.0,keyCacheSize=0.0,readRepairChance=0.0,replicateOnWrite=false,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.Int32Type,minCompactionThreshold=4,maxCompactionThreshold=32,rowCacheSavePeriodInSeconds=0,keyCacheSavePeriodInSeconds=0,rowCacheKeysToSave=2147483647,rowCacheProvider=org.apache.cassandra.cache.ConcurrentLinkedHashCacheProvider@154c995,mergeShardsChance=0.1,keyAlias=java.nio.HeapByteBuffer[pos=478
lim=481 cap=483],column_metadata={java.nio.HeapByteBuffer[pos=0 lim=3
cap=3]=ColumnDefinition{name=6b616d,
validator=org.apache.cassandra.db.marshal.AsciiType, index_type=KEYS,
index_name='kam'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={}]
INFO [MigrationStage:1] 2011-10-07 23:24:35,309 ColumnFamilyStore.java (line
664) Enqueuing flush of Memtable-Migrations@25069868(7870/9837 serialized/live
bytes, 1 ops)
INFO [FlushWriter:4] 2011-10-07 23:24:35,309 Memtable.java (line 237) Writing
Memtable-Migrations@25069868(7870/9837 serialized/live bytes, 1 ops)
INFO [MigrationStage:1] 2011-10-07 23:24:35,309 ColumnFamilyStore.java (line
664) Enqueuing flush of Memtable-Schema@3067216(3325/4156 serialized/live
bytes, 3 ops)
INFO [FlushWriter:4] 2011-10-07 23:24:35,356 Memtable.java (line 273)
Completed flushing \var\lib\cassandra\data\system\Migrations-h-17-Data.db (7934
bytes)
INFO [FlushWriter:4] 2011-10-07 23:24:35,371 Memtable.java (line 237) Writing
Memtable-Schema@3067216(3325/4156 serialized/live bytes, 3 ops)
INFO [FlushWriter:4] 2011-10-07 23:24:35,418 Memtable.java (line 273)
Completed flushing \var\lib\cassandra\data\system\Schema-h-17-Data.db (3475
bytes)
INFO [MigrationStage:1] 2011-10-07 23:24:35,418 SecondaryIndexManager.java
(line 181) Creating new index : ColumnDefinition{name=6b616d,
validator=org.apache.cassandra.db.marshal.AsciiType, index_type=KEYS,
index_name='kam'}
INFO [Creating index: sipdb.kam] 2011-10-07 23:24:35,449
ColumnFamilyStore.java (line 664) Enqueuing flush of
Memtable-sipdb@30231056(2284899/30490286 serialized/live bytes, 42052 ops)
INFO [FlushWriter:4] 2011-10-07 23:24:35,449 Memtable.java (line 237) Writing
Memtable-sipdb@30231056(2284899/30490286 serialized/live bytes, 42052 ops)
INFO [FlushWriter:4] 2011-10-07 23:24:36,262 Memtable.java (line 273)
Completed flushing \var\lib\cassandra\data\test\sipdb-h-1049-Data.db (4506422
bytes)
INFO [CompactionExecutor:3] 2011-10-07 23:24:36,262 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [Creating index: sipdb.kam] 2011-10-07 23:24:36,262 SecondaryIndex.java
(line 145) Submitting index build of sipdb.kam for data in
SSTableReader(path='\var\lib\cassandra\data\test\sipdb-h-1047-Data.db'),
SSTableReader(path='\var\lib\cassandra\data\test\sipdb-h-1049-Data.db')
INFO [CompactionExecutor:3] 2011-10-07 23:24:36,262 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [pool-1-thread-1] 2011-10-07 23:24:36,403 Memtable.java (line 177)
ColumnFamilyStore(table='test', columnFamily='sipdb.kam') liveRatio is
36.2837528604119 (just-counted was 36.2837528604119). calculation took 16ms
for 67 columns
INFO [pool-1-thread-1] 2011-10-07 23:24:36,496 Memtable.java (line 177)
ColumnFamilyStore(table='test', columnFamily='sipdb.kam') liveRatio is
36.2837528604119 (just-counted was 35.62471395881007). calculation took 15ms
for 132 columns
INFO [pool-1-thread-1] 2011-10-07 23:24:36,668 Memtable.java (line 177)
ColumnFamilyStore(table='test', columnFamily='sipdb.kam') liveRatio is
36.2837528604119 (just-counted was 35.51029748283753). calculation took 31ms
for 263 columns
INFO [pool-1-thread-1] 2011-10-07 23:24:37,043 Memtable.java (line 177)
ColumnFamilyStore(table='test', columnFamily='sipdb.kam') liveRatio is
36.286453839516824 (just-counted was
[jira] [Commented] (CASSANDRA-3333) remove more copies from read/write network path
[ https://issues.apache.org/jira/browse/CASSANDRA-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123225#comment-13123225 ] Brandon Williams commented on CASSANDRA-: - +1 remove more copies from read/write network path --- Key: CASSANDRA- URL: https://issues.apache.org/jira/browse/CASSANDRA- Project: Cassandra Issue Type: Improvement Components: Core Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Labels: network Fix For: 1.0.1 Attachments: 0001-clean-up-Serializer-mess.patch, 0002-reduce-copies.patch RowMutation.serializedBuffer and ReadVerbHandler both do an extra copy of the serialized data. We can avoid this be pre-computing the serialized size and allocating an appropriate buffer. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CASSANDRA-3335) ThreadPoolExecutor creates threads a non-daemon and will block on shutdown by default
ThreadPoolExecutor creates threads a non-daemon and will block on shutdown by default - Key: CASSANDRA-3335 URL: https://issues.apache.org/jira/browse/CASSANDRA-3335 Project: Cassandra Issue Type: Bug Components: Core Reporter: Brandon Williams Priority: Minor This is most obviously visible in OptionalTasks which should not block shutdown, but often does. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3335) ThreadPoolExecutor creates threads as non-daemon and will block on shutdown by default
[ https://issues.apache.org/jira/browse/CASSANDRA-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Williams updated CASSANDRA-3335: Summary: ThreadPoolExecutor creates threads as non-daemon and will block on shutdown by default (was: ThreadPoolExecutor creates threads a non-daemon and will block on shutdown by default) ThreadPoolExecutor creates threads as non-daemon and will block on shutdown by default -- Key: CASSANDRA-3335 URL: https://issues.apache.org/jira/browse/CASSANDRA-3335 Project: Cassandra Issue Type: Bug Components: Core Reporter: Brandon Williams Priority: Minor This is most obviously visible in OptionalTasks which should not block shutdown, but often does. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
svn commit: r1180260 - /cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/concurrent/AIOExecutorService.java
Author: jbellis Date: Fri Oct 7 21:56:16 2011 New Revision: 1180260 URL: http://svn.apache.org/viewvc?rev=1180260view=rev Log: r/m unused code Removed: cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/concurrent/AIOExecutorService.java
[jira] [Updated] (CASSANDRA-3335) ThreadPoolExecutor creates threads as non-daemon and will block on shutdown by default
[ https://issues.apache.org/jira/browse/CASSANDRA-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Ellis updated CASSANDRA-3335: -- Attachment: 3335.txt Patch that switches DTPE to daemon threads, and Memtable's jamm TPE to DTPE. The only other direct use of TPE is the thrift handler for sync mode in ACD, which doesn't seem to have a problem killing things off when we ask it to so I left it alone. ThreadPoolExecutor creates threads as non-daemon and will block on shutdown by default -- Key: CASSANDRA-3335 URL: https://issues.apache.org/jira/browse/CASSANDRA-3335 Project: Cassandra Issue Type: Bug Components: Core Reporter: Brandon Williams Priority: Minor Attachments: 3335.txt This is most obviously visible in OptionalTasks which should not block shutdown, but often does. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (CASSANDRA-3336) leveldb compaction style problem - nothing to compact
leveldb compaction style problem - nothing to compact
-
Key: CASSANDRA-3336
URL: https://issues.apache.org/jira/browse/CASSANDRA-3336
Project: Cassandra
Issue Type: Bug
Components: Core
Affects Versions: 1.0.0
Reporter: Radim Kolar
cassandra keeps spamming this in system log even if there is no write activity.
It is difficult to reproduce, i seen it just twice.
content of JSON file is:
{
generations : [ {
generation : 0,
members : [ ]
}, {
generation : 1,
members : [ 1042, 1043, 1044, 1045 ]
}, {
generation : 2,
members : [ ]
}, {
generation : 3,
members : [ 969, 972, 973, 974, 979, 982, 985, 986, 987, 1001 ]
}, {
generation : 4,
members : [ 948, 949, 950, 951, 952, 953, 954, 955, 956, 957, 958, 959,
960, 961, 962, 963, 964, 965, 966, 967, 968, 970, 971, 975, 976, 977, 978, 980,
981, 983, 984, 988, 989, 990, 991, 992, 993, 994, 995, 996, 997, 998, 999,
1000, 1002, 1003 ]
}, {
generation : 5,
members : [ ]
}, {
generation : 6,
members : [ ]
}, {
generation : 7,
members : [ ]
} ]
}
INFO [CompactionExecutor:3] 2011-10-07 23:25:44,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:25:44,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:25:49,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:25:49,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:25:54,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:25:54,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:25:59,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:25:59,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:04,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:04,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:09,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:09,342 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:14,343 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:14,343 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:19,343 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
INFO [CompactionExecutor:3] 2011-10-07 23:26:19,343 CompactionTask.java (line
80) Nothing to compact in sipdb. Use forceUserDefinedCompaction if you wish to
force compaction of single sstables (e.g. for tombstone collection)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
[jira] [Commented] (CASSANDRA-3329) make HSHA the default Thrift server
[ https://issues.apache.org/jira/browse/CASSANDRA-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123270#comment-13123270 ] Brandon Williams commented on CASSANDRA-3329: - It looks like defaulting to the number of cores for hsha isn't quite adequate - I get about 20% less throughput on 4 cores with this patch than if I set it explicitly to 16. make HSHA the default Thrift server --- Key: CASSANDRA-3329 URL: https://issues.apache.org/jira/browse/CASSANDRA-3329 Project: Cassandra Issue Type: Improvement Components: API Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Fix For: 1.0.0 Attachments: 3329.txt HSHA has been an option since 0.8.3 (CASSANDRA-1405) and has been stable. Besides making possible lots of unpooled connections such as are common in some environments (*cough* PHP), we've seen EC2 in particular have trouble with lots of threads (CASSANDRA-2170). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (CASSANDRA-3329) make HSHA the default Thrift server
[ https://issues.apache.org/jira/browse/CASSANDRA-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Williams reopened CASSANDRA-3329: - make HSHA the default Thrift server --- Key: CASSANDRA-3329 URL: https://issues.apache.org/jira/browse/CASSANDRA-3329 Project: Cassandra Issue Type: Improvement Components: API Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Fix For: 1.0.0 Attachments: 3329.txt HSHA has been an option since 0.8.3 (CASSANDRA-1405) and has been stable. Besides making possible lots of unpooled connections such as are common in some environments (*cough* PHP), we've seen EC2 in particular have trouble with lots of threads (CASSANDRA-2170). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
svn commit: r1180277 - in /cassandra/branches/cassandra-1.0.0: conf/cassandra.yaml src/java/org/apache/cassandra/config/DatabaseDescriptor.java
Author: brandonwilliams Date: Fri Oct 7 23:21:26 2011 New Revision: 1180277 URL: http://svn.apache.org/viewvc?rev=1180277view=rev Log: Bump hsha threads to cores * 4 Modified: cassandra/branches/cassandra-1.0.0/conf/cassandra.yaml cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/config/DatabaseDescriptor.java Modified: cassandra/branches/cassandra-1.0.0/conf/cassandra.yaml URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/conf/cassandra.yaml?rev=1180277r1=1180276r2=1180277view=diff == --- cassandra/branches/cassandra-1.0.0/conf/cassandra.yaml (original) +++ cassandra/branches/cassandra-1.0.0/conf/cassandra.yaml Fri Oct 7 23:21:26 2011 @@ -219,7 +219,8 @@ rpc_server_type: sync # disconnects before accepting more. The defaults for sync are min of 16 and max # unlimited. # -# For the Hsha server, the min and max both default to the number of CPU cores. +# For the Hsha server, the min and max both default to quadruple the number of +# CPU cores. # # This configuration is ignored by the async server. # Modified: cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/config/DatabaseDescriptor.java URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/config/DatabaseDescriptor.java?rev=1180277r1=1180276r2=1180277view=diff == --- cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/config/DatabaseDescriptor.java (original) +++ cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/config/DatabaseDescriptor.java Fri Oct 7 23:21:26 2011 @@ -367,7 +367,7 @@ public class DatabaseDescriptor throw new ConfigurationException(Unknown rpc_server_type: + conf.rpc_server_type); if (conf.rpc_min_threads == null) conf.rpc_min_threads = conf.rpc_server_type.toLowerCase().equals(hsha) - ? Runtime.getRuntime().availableProcessors() + ? Runtime.getRuntime().availableProcessors() * 4 : 16; if (conf.rpc_max_threads == null) conf.rpc_max_threads = conf.rpc_server_type.toLowerCase().equals(hsha)
[jira] [Resolved] (CASSANDRA-3329) make HSHA the default Thrift server
[ https://issues.apache.org/jira/browse/CASSANDRA-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Williams resolved CASSANDRA-3329. - Resolution: Fixed Bumped to cores * 4 in r1180277 make HSHA the default Thrift server --- Key: CASSANDRA-3329 URL: https://issues.apache.org/jira/browse/CASSANDRA-3329 Project: Cassandra Issue Type: Improvement Components: API Reporter: Jonathan Ellis Assignee: Jonathan Ellis Priority: Minor Fix For: 1.0.0 Attachments: 3329.txt HSHA has been an option since 0.8.3 (CASSANDRA-1405) and has been stable. Besides making possible lots of unpooled connections such as are common in some environments (*cough* PHP), we've seen EC2 in particular have trouble with lots of threads (CASSANDRA-2170). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3326) Add timing information to cassandra-cli queries
[ https://issues.apache.org/jira/browse/CASSANDRA-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish babu krishnamoorthy updated CASSANDRA-3326: -- Attachment: 3326.patch Add timing information to cassandra-cli queries --- Key: CASSANDRA-3326 URL: https://issues.apache.org/jira/browse/CASSANDRA-3326 Project: Cassandra Issue Type: New Feature Components: Tools Affects Versions: 1.0.0 Reporter: Radim Kolar Assignee: satish babu krishnamoorthy Priority: Minor Labels: cli Fix For: 1.0.0 Attachments: 3326.patch It would be highly helpful for monitoring cluster health to return ETA on queries in cassandra-cli. MySQL is doing it too and you can switch this feature on in Postgresql and Oracle CLI. get testdb[234123]; Returned 0 results *in 0.08 ms*. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3326) Add timing information to cassandra-cli queries
[ https://issues.apache.org/jira/browse/CASSANDRA-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish babu krishnamoorthy updated CASSANDRA-3326: -- Attachment: 3326.patch Add timing information to cassandra-cli queries --- Key: CASSANDRA-3326 URL: https://issues.apache.org/jira/browse/CASSANDRA-3326 Project: Cassandra Issue Type: New Feature Components: Tools Affects Versions: 1.0.0 Reporter: Radim Kolar Assignee: satish babu krishnamoorthy Priority: Minor Labels: cli Fix For: 1.0.0 Attachments: 3326.patch It would be highly helpful for monitoring cluster health to return ETA on queries in cassandra-cli. MySQL is doing it too and you can switch this feature on in Postgresql and Oracle CLI. get testdb[234123]; Returned 0 results *in 0.08 ms*. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3326) Add timing information to cassandra-cli queries
[ https://issues.apache.org/jira/browse/CASSANDRA-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish babu krishnamoorthy updated CASSANDRA-3326: -- Attachment: (was: 3326.patch) Add timing information to cassandra-cli queries --- Key: CASSANDRA-3326 URL: https://issues.apache.org/jira/browse/CASSANDRA-3326 Project: Cassandra Issue Type: New Feature Components: Tools Affects Versions: 1.0.0 Reporter: Radim Kolar Assignee: satish babu krishnamoorthy Priority: Minor Labels: cli Fix For: 1.0.0 Attachments: 3326.patch It would be highly helpful for monitoring cluster health to return ETA on queries in cassandra-cli. MySQL is doing it too and you can switch this feature on in Postgresql and Oracle CLI. get testdb[234123]; Returned 0 results *in 0.08 ms*. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[cassandra-dbapi2] push by pcannon - allow override of SchemaDecoder... on 2011-10-07 23:11 GMT
Revision: d31c412df1a6 Author: paul cannon p...@riptano.com Date: Fri Oct 7 16:06:33 2011 Log: allow override of SchemaDecoder When an execute() call is made, there will likely be cases where the caller knows better than the driver how best to deserialize data- I guess this is the point to the ASSUME command in cassandra-cli and which has been requested for cqlsh. The simplest way to allow caller-controlled deserialization, it seems to me, is to allow passing in a SchemaDecoder-like class as an optional parameter to execute(). The custom decoder will be used until a new query is made. This adds that. http://code.google.com/a/apache-extras.org/p/cassandra-dbapi2/source/detail?r=d31c412df1a6
[jira] [Updated] (CASSANDRA-3188) cqlsh 2.0
[
https://issues.apache.org/jira/browse/CASSANDRA-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
paul cannon updated CASSANDRA-3188:
---
Attachment: 3188.patch1.txt
This doesn't have any awesome help text in it yet, but I'm uploading this to
get some review.
It does have a working ASSUME, DESCRIBE, and SHOW, much (imo) improved controls
for determining where to connect, a config file, much better error handling,
and smarter tab completion in a lot of areas.
Some of the working new commands:
{noformat}
ASSUME mycolumnfam NAMES ARE uuid;
ASSUME mycolumnfam VALUES ARE int;
ASSUME mycolumnfam(somecol) VALUES ARE ascii;
DESCRIBE KEYSPACE foo;
DESCRIBE COLUMNFAMILY bar;
DESCRIBE CLUSTER;
DESCRIBE SCHEMA;
SHOW VERSIONS;
SHOW HOST;
SHOW ASSUMPTIONS;
{noformat}
Downside: the ASSUME stuff all depends on a patch to the python CQL driver. See:
http://code.google.com/a/apache-extras.org/p/cassandra-dbapi2/source/detail?r=d31c412df1a66d0c8b99ba313a19855f1ef8106bname=override-decoder
The tab completion could still be improved a lot, which I think would greatly
aid usability, together with some good help text.
cqlsh 2.0
-
Key: CASSANDRA-3188
URL: https://issues.apache.org/jira/browse/CASSANDRA-3188
Project: Cassandra
Issue Type: Improvement
Reporter: Jonathan Ellis
Assignee: paul cannon
Fix For: 1.0.1
Attachments: 3188.patch1.txt
I'd like to see some improvements to cqlsh to bring it to feature parity w/
the old cli:
- describe [KS | CF | cluster | schema]
- assume
- connect / don't crap out w/ stacktrace if C* isn't currently running on
localhost
- help
It may be easier to do this by forking the cli and replacing its one-off api
with CQL, or it may be easier to add these features to cqlsh.
Either is fine, but if it's a close call my inclination would be to build it
in Java for the reasoning over on CASSANDRA-3010.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
