Re: Github pull requests

2016-08-26 Thread Ben Coverston
I think it would certainly make contributing to Cassandra more
straightforward.

I'm not a committer, so I don't regularly create patches, and every time I
do I have to search/verify that I'm doing it right.

But pull requests? I make pull requests every day, and GitHub makes that
process work the same everywhere.

On Fri, Aug 26, 2016 at 9:33 AM, Jonathan Ellis  wrote:

> Hi all,
>
> Historically we've insisted that people go through the process of creating
> a Jira issue and attaching a patch or linking a branch to demonstrate
> intent-to-contribute and to make sure we have a unified record of changes
> in Jira.
>
> But I understand that other Apache projects are now recognizing a github
> pull request as intent-to-contribute [1] and some are even making github
> the official repo, with an Apache mirror, rather than the other way
> around.  (Maybe this is required to accept pull requests, I am not sure.)
>
> Should we revisit our policy here?
>
> [1] e.g. https://github.com/apache/spark/pulls?q=is%3Apr+is%3Aclosed
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder, http://www.datastax.com
> @spyced
>



-- 
Ben Coverston
DataStax -- The Apache Cassandra Company


Re: Cassandra 2.0 with Hadoop 2.x?

2014-02-10 Thread Ben Coverston
Clint, I'm hoping that
https://issues.apache.org/jira/browse/CASSANDRA-5201 will
make it into Cassandra 2.0, as it is a general purpose solution that will
work for both mapred, and mapreduce based code.


On Wed, Feb 5, 2014 at 1:33 PM, Clint Kelly  wrote:

> One other question: Has anyone considered taking a crack at modifying
> the CqlPagingRecordReader to use the DataStax java driver?  I am not
> sure how that kind of cross-pollination of different projects works,
> but I thought the paging mechanisms in the DataStax driver might help
> simplify the CqlPagingRecordReader code.
>
> Best regards,
> Clint
>
> On Tue, Feb 4, 2014 at 12:49 PM, Clint Kelly 
> wrote:
> > Folks,
> >
> > Has anyone out there used Cassandra 2.0 with Hadoop 2.x?  I saw this
> > discussion on the Cassandra JIRA:
> >
> > https://issues.apache.org/jira/browse/CASSANDRA-5201
> >
> > but the fix (https://github.com/michaelsembwever/cassandra-hadoop)
> > referenced in the thread is for Cassandra 1.2.
> >
> > I put together a similar patch for Cassandra 2.0 for anyone who is
> interested:
> >
> > https://github.com/wibiclint/cassandra2-hadoop2
> >
> > but I'm wondering if there is a more official solution to this
> > problem.  Any help would be appreciated.  Thanks!
> >
> > Best regards,
> > Clint
>



-- 
Ben Coverston
DataStax -- The Apache Cassandra Company


Re: maximum sstable size

2012-10-29 Thread Ben Coverston
It's possible, take a look at the CompactionTask class for some guidance on
what we did for LCS.

On Mon, Oct 29, 2012 at 5:16 AM, Radim Kolar  wrote:

> its possible to implement maximum sstable size for tieredcompactionpolicy
> without much code changes?
>
> I am using it in lucene with really good performance effect, max size is 4
> GB, dataset total size is 30 GB. It prevents lucene from creating too big
> segment which takes too long to be merged with newer segments.
>



-- 
Ben Coverston
DataStax -- The Apache Cassandra Company


Re: RFC: Cassandra Virtual Nodes

2012-03-23 Thread Ben Coverston
> The SSTable indices should still be scanned for size tiered compaction.
> Do I miss anything here?
>
>
No I don't think you did, in fact, depending on the size of your SSTable a
contiguous range (or the entire SSTable) may or may not be affected by a
cleanup/move or any type of topology change. There is lots of room for
optimization here. After loading the indexes we actually know start/end
range for an SSTable so we can include/exclude it in any such operation.

-- 
Ben Coverston
DataStax -- The Apache Cassandra Company


Re: Welcome committer Aaron Morton!

2012-01-27 Thread Ben Coverston
Congrats Aaron! Well deserved.

On Wed, Jan 18, 2012 at 4:51 PM, aaron morton wrote:

> Thanks Jonathan and the other committers.
>
> Cheers :)
> -
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 19/01/2012, at 7:19 AM, Jonathan Ellis wrote:
>
> > The Apache Cassandra PMC has voted to add Aaron as a committer.
> > Thanks for helping make Cassandra what it is today!
> >
> > --
> > Jonathan Ellis
> > Project Chair, Apache Cassandra
> > co-founder of DataStax, the source for professional Cassandra support
> > http://www.datastax.com
>
>


-- 
Ben Coverston
DataStax -- The Apache Cassandra Company