Re: Copy from CSV on OS X problem with varint values <= -2^63

2017-04-07 Thread Brice Dutheil
@Boris, what formula did you use on homebrew and what is the git version of this formula ? Anyway the current cassandra formula is here : https://github.com/Homebrew/homebrew-core/blob/master/Formula/cassandra.rb I am not a Homebrew developper, the formula does a lot of facy stuff, yet I see a

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2017-02-13 Thread Brice Dutheil
The Android battle is another thing that I wouldn't consider for OracleJDK / OpenJDK. While I do like what Google did from a technical point of view, Google may have overstepped fair use (or not – I don't know). Anyway Sun didn't like what Google did, they probably considered going to court at

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-26 Thread Brice Dutheil
gt;>>>> I would agree with Eric with his following statement. In fact, I was >>>>> trying to say the same thing. >>>>> >>>>> "I don't really have any opinions on Oracle per say, but Cassandra is >>>>> a >>>>> Fr

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-22 Thread Brice Dutheil
Pretty much a non-story, it seems like. Clickbait imho. Search ‘The Register’ in this wikipedia page @Ben Manes Agreed, OpenJDK and Oracle JDK are now pretty close, but there is still some differences in the VM

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-21 Thread Brice Dutheil
hink its better to stay away from Oracle as we never know when they > would switch open source to closed source. Given their history of practices > their statements are not credible. > > I am pretty sure the community would take care of OpenJDK. > > > > > > On Wed, De

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-21 Thread Brice Dutheil
The problem described in this article is different than what you have on your servers and I’ll add this article should be reaad with caution, as The Register is known for sensationalism. The article itself has no substantial proof or enough details. In my opinion this article is clickbait. Anyway

Re: Data migration from Oracle to Cassandra

2016-11-21 Thread Brice Dutheil
Hi Shashidhar, I have done something like that at reasonably high scale, migrating a few billions of Oracle records to Cassandra. Basically the process we used is : the app will perform the write in cassandra for new or updated records, the batch will backfeed old data in cassandra. We wrote

Re: cql-maven-plugin

2016-10-07 Thread Brice Dutheil
a from a cql file? > > On Fri, Oct 7, 2016 at 2:40 PM, Brice Dutheil <brice.duth...@gmail.com> > wrote: > >> Hi there, >> >> I’d like to share a very simple project around handling CQL files with >> maven. We were using the cassandra-maven-plugin before, but

cql-maven-plugin

2016-10-07 Thread Brice Dutheil
Hi there, I’d like to share a very simple project around handling CQL files with maven. We were using the cassandra-maven-plugin before, but with limitations on the authentication and the use of thrift protocol. I was tempted to write a replacement focused only the execution of CQL statements, in

Re: [ANNOUNCEMENT] Website update

2016-09-12 Thread Brice Dutheil
Really nice update ! There's still some todos ;) http://cassandra.apache.org/doc/latest/architecture/storage_engine.html http://cassandra.apache.org/doc/latest/architecture/guarantees.html http://cassandra.apache.org/doc/latest/operating/read_repair.html ... -- Brice On Mon, Sep 12, 2016 at

Re: NTP Synchronization Setup Changes

2016-04-01 Thread Brice Dutheil
Hi another tip, make sure the OS doesn't come with pre-configured NTP synchronisation services. We had a proper NTP setup, but we missed a service that came with CentOS that synced to a low stratum NTP server. -- Brice On Thu, Mar 31, 2016 at 10:00 AM -0700, "Eric Evans"

Re: Cassandra Java Driver

2015-12-26 Thread Brice Dutheil
Not yet. The latestest DSE (4.8.3) is shipped with a patched version of Cassandra 2.11. You can find this information on their website. 4.8 Release note : https://docs.datastax.com/en/datastax_enterprise/4.8/datastax_enterprise/RNdse.html >From this page in the menu you can navigate and unroll

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Brice Dutheil
Additionally if the time uuid is generated client side, make sure the boxes that will perform the write hava correct ntp/ptp configuration. @John Haddad Keep in mind that in a distributed environment you probably have so much variance that nanosecond precision is pointless. Even google notes

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Brice Dutheil
at Google scale, it's > unlikely to be happening anywhere. The fact that dapper was written in the > context of tracing is irrelevant. > On Thu, Oct 29, 2015 at 7:27 PM Brice Dutheil <brice.duth...@gmail.com> > wrote: > >> Additionally if the time uuid is generated clien

Re: Cassandra query degradation with high frequency updated tables.

2015-10-10 Thread Brice Dutheil
What do you mean by that *And since this is a test , this is just running on a single node.* ? What is the hardware spec ? Also from the schema in CASSANDRA-10502 there’s a lot of maps, what is the size fo these maps ? I’ve seen cassandra

Re: Realtime data and (C)AP

2015-10-09 Thread Brice Dutheil
On Fri, Oct 9, 2015 at 2:27 AM, Steve Robenalt wrote: In general, if you write at QUORUM and read at ONE (or LOCAL variants > thereof if you have multiple data centers), your apps will work well > despite the theoretical consistency issues. Nit-picky comment : if

BATCH consistency level VS. individual statement consistency level

2015-07-06 Thread Brice Dutheil
Hi, I’m not sure how consistency level is applied on batch statement. I didn’t found detailed information on datastax.com (1) http://docs.datastax.com/en/cql/3.0/cql/cql_reference/batch_r.html regarding that. - It is possible to set a CL on individual statements. - It is possible to set a

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-22 Thread Brice Dutheil
) -- as time progresses we are going to update the existing keys very frequently ( i think LCS will work better here -- we are going with this strategy for long term benefit) On Wed, Apr 22, 2015 at 4:17 AM, Brice Dutheil brice.duth...@gmail.com wrote: Yes I was referring referring

Re: Handle Write Heavy Loads in Cassandra 2.0.3

2015-04-22 Thread Brice Dutheil
Cassandra is printing compacting large rows when row is less than 100mb. Thanks Anuj Wadehra Sent from Yahoo Mail on Android https://overview.mail.yahoo.com/mobile/?.src=Android -- *From*:Brice Dutheil brice.duth...@gmail.com *Date*:Wed, 22 Apr, 2015 at 3

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
threads -- do u think that will cause a problem ? As far as i have read LCS is recommended for such cases. should i just switch back to SizeTiredCompactionStrategy. On Tue, Apr 21, 2015 at 6:13 PM, Brice Dutheil brice.duth...@gmail.com wrote: Could it that the app is inserting _duplicate_ keys

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
Could it that the app is inserting _duplicate_ keys ? -- Brice On Tue, Apr 21, 2015 at 1:52 PM, Marcus Eriksson krum...@gmail.com wrote: nope, but you can correlate I guess, tools/bin/sstablemetadata gives you sstable level information and, it is also likely that since you get so many L0

Re: Handle Write Heavy Loads in Cassandra 2.0.3

2015-04-21 Thread Brice Dutheil
*:Brice Dutheil brice.duth...@gmail.com *Date*:Tue, 21 Apr, 2015 at 10:22 pm *Subject*:Re: Handle Write Heavy Loads in Cassandra 2.0.3 This is an intricate matter, I cannot say for sure what are good parameters from the wrong ones, too many things changed at once. However there’s many things

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
, Adobe, Intuit, and eBay. On Tue, Apr 21, 2015 at 5:46 PM, Brice Dutheil brice.duth...@gmail.com wrote: Oh, thank you Sebastian for this input and the ticket reference ! We did notice an increase in CPU usage, but kept the concurrent compaction low enough for our usage, by default it takes

Re: Handle Write Heavy Loads in Cassandra 2.0.3

2015-04-21 Thread Brice Dutheil
This is an intricate matter, I cannot say for sure what are good parameters from the wrong ones, too many things changed at once. However there’s many things to consider - What is your OS ? - Do your nodes have SSDs or mechanical drives ? How many cores do you have ? - Is it the CPUs

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
-on, and predictably scalable to any size. With more than 500 customers in 45 countries, DataStax is the database technology and transactional backbone of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. On Tue, Apr 21, 2015 at 9:06 AM, Brice Dutheil

Re: Frequent timeout issues

2015-04-01 Thread Brice Dutheil
And the keyspace? What is the replication factor. Also how are the inserts done? On Wednesday, April 1, 2015, Amlan Roy amlan@cleartrip.com wrote: Write consistency level is ONE. This is the describe output for one of the tables. CREATE TABLE event_data ( event text, week text,

Re: Delayed events processing / queue (anti-)pattern

2015-03-27 Thread Brice Dutheil
Would it help here to not actually issue a delete statement but instead use date based compaction and a dynamically calculated ttl that is some safe distance in the future from your key? I’m not sure about about this part *date based compaction*, do you mean DateTieredCompationStrategy ? Anyway

Re: CQL 3.x Update ...USING TIMESTAMP...

2015-03-13 Thread Brice Dutheil
I agree with Tyler, in the normal run of a live application I would not recommend the use of the timestamp, and use other ways to *version* *inserts*. Otherwise you may fall in the *upsert* pitfalls that Tyler mentions. However I find there’s a legitimate use the USING TIMESTAMP trick, when

Re: Better option to load data to cassandra

2014-11-12 Thread Brice Dutheil
On our project we wrote ourself a custom batch to load the data to cassandra the way we wanted. -- Brice On Tue, Nov 11, 2014 at 2:33 PM, srinivas rao pinnakasrin...@gmail.com wrote: hi Alexey, i tried with sqoop, and data stax copy command. any other options we can use. i have one more

Re: paging through an entire table in chunks?

2014-09-29 Thread Brice Dutheil
You may be using the async feature http://www.datastax.com/documentation/developer/java-driver/1.0/java-driver/asynchronous_t.html of the java driver. In order to manage complexity related to do several queries I used RxJava, it leverages readability and asynchronicity in a very elegant way (much

Re: using dynamic cell names in CQL 3

2014-09-26 Thread Brice Dutheil
I’m not sure I understand correctly “for example column.name would be event_name(temperature)“, what I gather however is that you have multiple events that may or may not have certain properties, in your example I believe you mean you want a CF for events with a type event_name that contains a

Re: Repair taking long time

2014-09-26 Thread Brice Dutheil
Unfortunately DSE 4.5.0 is still on 2.0.x -- Brice On Fri, Sep 26, 2014 at 7:40 PM, Jonathan Haddad j...@jonhaddad.com wrote: Are you using Cassandra 2.0 vnodes? If so, repair takes forever. This problem is addressed in 2.1. On Fri, Sep 26, 2014 at 9:52 AM, Gene Robichaux

Re: Help with approach to remove RDBMS schema from code to move to C*?

2014-09-20 Thread Brice Dutheil
I’m fairly new to cassandra, but here’s my input. Think of your column families as a projection of how the application needs them. Thinking with CQRS in mind helps. So with more CFs that may require more space, as data may be written differently in different column families for different usage.