[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-30 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-1258:
--

Attachment: 1258-v8.txt

version that pushes CFMetadata into SSTable objects.  tests pass now.

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: 1258-v4.txt, 1258-v5.txt, 1258-v6.txt, 1258-v7.txt, 
 1258-v8.txt, trunk-1258-src-2.txt, trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-30 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: 1258-sstr-test.txt

adds coverage for recoverAndOpen

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: 1258-sstr-test.txt, 1258-v4.txt, 1258-v5.txt, 
 1258-v6.txt, 1258-v7.txt, 1258-v8.txt, trunk-1258-src-2.txt, 
 trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-29 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: 1258-v7.txt

Limits scope of CFS passthrough

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: 1258-v4.txt, 1258-v5.txt, 1258-v6.txt, 1258-v7.txt, 
 trunk-1258-src-2.txt, trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-28 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: 1258-v6.txt

1258-v6.txt Replaces CFMD with CFS passthrough

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: 1258-v4.txt, 1258-v5.txt, 1258-v6.txt, 
 trunk-1258-src-2.txt, trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-27 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-1258:
--

Attachment: 1258-v4.txt

added code in v4 to flush the index CFSes before finalizing the index + filter. 
 getting test failure in SSTWT though -- not sure if the flush is exposing a 
problem in the test, or if it was already failing (didn't check).

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: 1258-v4.txt, trunk-1258-src-2.txt, trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-27 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: 1258-v5.txt

Passes down comparator and CFMetaData (which wanted to be found in DD as well) 
into sliceiterators. 

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: 1258-v4.txt, 1258-v5.txt, trunk-1258-src-2.txt, 
 trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-25 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: trunk-1258-src-3.txt

trunk-1258-src-3.txt does indexed column creation through SSTableWriter

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: trunk-1258-src-2.txt, trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-25 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: trunk-1258-src-3.txt

skip over BF creation to save some overhead

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: trunk-1258-src-2.txt, trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-25 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: (was: trunk-1258-src-3.txt)

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: trunk-1258-src-2.txt, trunk-1258-src-3.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-22 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: (was: trunk-1258-src.txt)

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: trunk-1258-src-2.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-22 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: trunk-1258-src-2.txt

New patch file rebases on most recent trunk

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: trunk-1258-src-2.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-22 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: trunk-1258-src-2.txt

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7 beta 1

 Attachments: trunk-1258-src-2.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-21 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: trunk-1258-src.txt

Patches for allowing CFS to accept a recovered SSTableReader from which to 
retrieve the indexed columns.

Having this on CFS allows for other uses such as added indexes after the fact, 
and providing mbean hooks into rebuilding indexes. 

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7

 Attachments: trunk-1258-src.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-21 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: (was: trunk-1258-src.txt)

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (CASSANDRA-1258) rebuild indexes after streaming

2010-07-21 Thread Nate McCall (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate McCall updated CASSANDRA-1258:
---

Attachment: trunk-1258-src.txt

replacing patch file for minor code style change

 rebuild indexes after streaming
 ---

 Key: CASSANDRA-1258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
 Project: Cassandra
  Issue Type: Sub-task
  Components: Core
Reporter: Jonathan Ellis
Assignee: Nate McCall
 Fix For: 0.7

 Attachments: trunk-1258-src.txt


 since index CFSes are private, they won't be streamed with other sstables.  
 which is good, because the normal partitioner logic wouldn't stream the right 
 parts anyway.
 seems like the right solution is to extend SSTW.maybeRecover to rebuild 
 indexes as well.  (this has the added benefit of being able to use streaming 
 as a relatively straightforward bulk loader.)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.