Re: Cassandra 4.X CqlBulkOutputFormat - mapreduce

2022-04-26 Thread Ahmed Eljami
you for your response .. But I’m looking for this source in > cassandra 4.x release: > > > > > https://github.com/AndyHu19900119/cassandra/blob/trunk/examples/hadoop_word_count/src/WordCount.java > > > > That was removed a long time ago when Hadoop code was removed in C* 3.0 > (CASSANDRA-9353). Cheers! > > -- Cordialement; Ahmed ELJAMI

Re: sstablepartitions in apache cassandra

2022-04-26 Thread Ahmed Eljami
e: > > Hi all, > > > > I want to check all partitions greater than a certain threshold in my > > existing apache cassandra column family. > > Is there any alternative for datastax sstable tool > > 'sstablepartitions' in open source apache cassandra? > > > > Regards, > > Ashish Gupta > -- Cordialement; Ahmed ELJAMI

Re: Cassandra doesn't flush any commit log files into cdc_raw directory

2021-04-29 Thread Ahmed Eljami
nt to understand why there's no commit log file flushed into > cdc_raw directory at all even when the threshold cdc_total_space_in_mb has > been reached and write suspension has been triggered in Cassandra DB. This > sounds like a bug and currently makes the CDC feature useless. > > Thanks so much, > Bingqin Zhou > -- Cordialement; Ahmed ELJAMI

Re: Increased read latency with Cassandra >= 3.11.7

2021-02-22 Thread Ahmed Eljami
Hey, I have created the issue, here => https://issues.apache.org/jira/browse/CASSANDRA-16465 Le ven. 19 févr. 2021 à 10:10, Ahmed Eljami a écrit : > Hi folks, > > If this can help, we encountered the same behaviour with 3.11.9. We are > using LCS. > After upgrading fro

Re: Increased read latency with Cassandra >= 3.11.7

2021-02-19 Thread Ahmed Eljami
es version 3.11.10 provide any improvement? >> >> Thanks, >> Johannes >> >> - >> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org >> For additional commands, e-mail: user-h...@cassandra.apache.org >> >> -- Cordialement; Ahmed ELJAMI

Re: Cassandra and GCP

2020-12-18 Thread Ahmed Eljami
Hi, First, you should deploy with the minimal configuration required for the production. More details can be found from Cassandra doc here => https://cassandra.apache.org/doc/latest/operating/hardware.html Also, to ensure reliability and fault tolerance you should configure your cluster to have

Re: Cassandra monitoring

2020-12-18 Thread Ahmed Eljami
; for > Windows 10 > > > > *From: *Manu Chadha > *Sent: *18 December 2020 08:57 > *To: *user@cassandra.apache.org > *Subject: *Cassandra monitoring > > > > Hi > > > > Could the group please suggest options for monitoring Cassandra in > production (GCP)? > > > > I am trying to use Prometheus and followed this tutorial - > https://www.robustperception.io/monitoring-cassandra-with-prometheus > > > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows 10 > > > > > -- Cordialement; Ahmed ELJAMI

Question about cdc & nodetool flush ks table

2020-11-18 Thread Ahmed Eljami
Hi folks, I'm about testing cdc, in my case I'm working on a table with a low write rate. I have programmed an explicit global flush (for all memtables) and I can see that commitLogs are transferred to cdc_raw BUT when I run a nodetool flush with ks and table nothing happens. When I enable Debug

Re: Increased read latency with Cassandra >= 3.11.7

2020-11-05 Thread Ahmed Eljami
vement? > > Thanks, > Johannes > > - > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > For additional commands, e-mail: user-h...@cassandra.apache.org > > -- Cordialement; Ahmed ELJAMI

Re: CDC Tools

2020-05-27 Thread Ahmed Eljami
gt; this Kafka connector resources page [2]. Cheers! > > [1] > https://www.datastax.com/blog/2019/09/datastax-cdc-connector-apache-kafkatm-enables-globally-replicated-microservices > [2] https://www.datastax.com/dev/datastax-apache-kafka-connector > >> -- Cordialement; Ahmed ELJAMI

CDC Tools

2020-05-26 Thread Ahmed Eljami
Hi guys, I'm looking for a tool that helps me to parse CommitLog (CDC). I found Debezium https://debezium.io/documentation/reference/1.2/ and I want to know if someone has used it or if you could advise me other solutions? Cheers.

Re: How to assure data consistency in switch over to standby dc

2020-01-16 Thread Ahmed Eljami
stency. > > -- > > regards, > Laxmikant Upadhyay > > -- Cordialement; Ahmed ELJAMI

Re: Find large partition https://github.com/tolbertam/sstable-tools

2019-11-22 Thread Ahmed Eljami
I found this project on instaclustr github but I dont have any idea about license: https://github.com/instaclustr/cassandra-sstable-tools/blob/cassandra-3.11/README.md Le ven. 22 nov. 2019 à 03:33, Sergio Bilello a écrit : > Hi guys! > Just for curiosity do you know anything beside >

Re: Medusa : a new OSS backup/restore tool for Apache Cassandra

2019-11-07 Thread Ahmed Eljami
lexanderdeja > > Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > -- Cordialement; Ahmed ELJAMI

Re: Cassandra copy command

2019-08-22 Thread Ahmed Eljami
>>> >> >>>> >> On Wed, 21 Aug 2019 at 12:14, Rahul Reddy >>>> wrote: >>>> >> > >>>> >> > Hello, >>>> >> > >>>> >> > I have 3 datacenters . Want to make sure record count is same in >>>> all dc's . If I run copy command node1 in dc1 does it get the data from >>>> only dc1? Nodetool cfstats I'm seeing discrepancies in partitions count is >>>> it because we didn't run cleanup after adding few nodes and remove them?. >>>> To rule out any discripencies I want to run copy command from 3 DC's and >>>> compare. Please let me know if copy command extracts data from the DC only >>>> I ran it from? >>>> >> >>>> >> - >>>> >> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org >>>> >> For additional commands, e-mail: user-h...@cassandra.apache.org >>>> >> >>>> >>>> - >>>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org >>>> For additional commands, e-mail: user-h...@cassandra.apache.org >>>> >>>> -- Cordialement; Ahmed ELJAMI

Re: Need information related to Cassandra 4.x Release date

2019-08-20 Thread Ahmed Eljami
Hi, Not yet fixed, probably Q4 2019. Please find more informations on this thread: https://lists.apache.org/thread.html/246a5d79240b7701455360d650de7acb11c66e53d007babe206fe0a7@%3Cdev.cassandra.apache.org%3E

Re: Get information about GC pause (Stop the world) via JMX, it's possible ?

2019-07-04 Thread Ahmed Eljami
Generation.CollectionTime / >> java.lang.type=GarbageCollector.name=G1 Old Generation.CollectionCount) >> >> On Thu, Jun 27, 2019 at 11:56 AM Dimo Velev wrote: >> >>> That is s standard jvm metric. Connect to your cassandra node with a JMX >>> browser (jconsole, jm

Get information about GC pause (Stop the world) via JMX, it's possible ?

2019-06-27 Thread Ahmed Eljami
Hi, I want to know if it's possible to get information about GC pause duration (Stop the world) via JMX. Today, we get this information from gc.log with the JVM option XX:+PrintGCApplicationStoppedTime{color} Total time for which application threads were stopped: 0.0001273 seconds, Stopping

Re: [EXTERNAL] Two separate rows for the same partition !!

2019-05-16 Thread Ahmed Eljami
uploading them would be swell. Otherwise , an anonymized JSON dump may be > good enough for whichever developer looks at fixing this > > -- > Jeff Jirsa > > > On May 15, 2019, at 7:27 PM, Ahmed Eljami wrote: > > Jeff, In this case is there any solution to resolve that dir

Re: [EXTERNAL] Two separate rows for the same partition !!

2019-05-15 Thread Ahmed Eljami
Jeff, In this case is there any solution to resolve that directly in the sstable (compact, scrub...) or we have to apply a batch on the client level (delete a partition and re write it)? Thank you for your reply. Le mer. 15 mai 2019 à 18:09, Ahmed Eljami a écrit : > effectiv

Re: [EXTERNAL] Two separate rows for the same partition !!

2019-05-15 Thread Ahmed Eljami
effectively, this was written in 2.1.14 and we upgrade to 3.11.3 so we should not be impacted by this issue ?! thanks

Re: [EXTERNAL] Two separate rows for the same partition !!

2019-05-15 Thread Ahmed Eljami
;, "value" : "", "tstamp" : "2019-04-26T17:20:39.910Z", "ttl" : 31708792, "expires_at" : "2020-04-27T17:20:31Z", "expired" : false } Why we don't have a *liveness_info* for this row ? Thanks Le mer. 15 mai 2019

Re: [EXTERNAL] Two separate rows for the same partition !!

2019-05-15 Thread Ahmed Eljami
ng columns (perhaps g) has different values? That would easily > explain the 2 rows returned – because they ARE different rows in the same > partition. In your data model, make sure you need all the clustering > columns to determine uniqueness or you will indeed have more rows than you > m

Two separate rows for the same partition !!

2019-05-15 Thread Ahmed Eljami
, "clustering" : [ "", "Token", "abcd", "" ], "cells" : [ { "name" : "dvalue", "value" : "", "tstamp" : "2019-04-26T17:20:39.910Z", "ttl" : 31708792, "expires_at" : "2020-04-27T17:20:31Z", "expired" : false } ] }, { "type" : "range_tombstone_bound", "start" : { "type" : "exclusive", "clustering" : [ "", "Token", "abcd", "" ], "deletion_info" : { "marked_deleted" : "2019-04-26T17:20:39.909Z", "local_delete_time" : "2019-04-26T17:20:39Z" } } }, { "type" : "range_tombstone_bound", "end" : { "type" : "inclusive", "clustering" : [ "", "Token", "abcd", "*" ], "deletion_info" : { "marked_deleted" : "2019-04-26T17:20:39.909Z", "local_delete_time" : "2019-04-26T17:20:39Z" } } } ] } what's weired that the two rows with "position" : 3974, and "position" : 4123 should be on the same row...!! Since, we can't reproduce the issue ... Any idea please ? Thanks. -- Cordialement; Ahmed ELJAMI

Re: [EXTERNAL] Re: Garbage Collector

2019-03-22 Thread Ahmed Eljami
but most of the rest is at or near > default. For the most part, it's been "feed it more RAM, and it works" > compared to CMS's "lower overhead, works great until it doesn't" and dozens > of knobs. > > I haven't tried ZGC yet, but anecdotally I've heard that it do

Garbage Collector

2019-03-19 Thread Ahmed Eljami
Hi Folks, Does someone use G1 GC or ZGC on production? Can you share your feedback, the configuration used if it's possible ? Thanks.

Re: [EXTERNAL] Re: Cluster size "limit"

2019-03-14 Thread Ahmed Eljami
So less vnodes allows more nodes, I understand. But, It still hard to implement on existing cluster with more than 10 Keyspaces with different RF...

Re: [EXTERNAL] Re: Cluster size "limit"

2019-03-13 Thread Ahmed Eljami
t; Sean > > > > *From:* Ahmed Eljami > *Sent:* Wednesday, March 13, 2019 1:27 PM > *To:* user@cassandra.apache.org > *Subject:* [EXTERNAL] Re: Cluster size "limit" > > > > Yes, 256 vnodes > > > > Le mer. 13 mars 2019 à 17:31, Jeff Jirsa a écrit

Re: Cluster size "limit"

2019-03-13 Thread Ahmed Eljami
Yes, 256 vnodes Le mer. 13 mars 2019 à 17:31, Jeff Jirsa a écrit : > Do you use vnodes? How many vnodes per machine? > > -- > Jeff Jirsa > > > On Mar 13, 2019, at 3:58 PM, Ahmed Eljami wrote: > > Hi, > > We are planning to add a third datacenter to our cl

Cluster size "limit"

2019-03-13 Thread Ahmed Eljami
Hi, We are planning to add a third datacenter to our cluster (already has 2 datacenter, every datcenter has 50 nodes, so 100 nodes in total). My fear is that an important number of nodes per cluster (> 100) could cause a lot of problems like gossip duration, maintenance (repair...)... I know

Re: removenode force vs assasinate

2019-03-11 Thread Ahmed Eljami
Thx onmstester, I Thnik that remove node dont stream data : refer to blog of TLP : http://thelastpickle.com/blog/2018/09/18/assassinate.html Will *NOT* stream any of the decommissioned node’s data to the new replicas. Anyway, I have already launched a remove node but it continues to appear DL

removenode force vs assasinate

2019-03-11 Thread Ahmed Eljami
Hello, Can someone explain me the difference between removenode foce and assasinate in a case where a node staying in status DL ? Thx

Re: Usage of allocate_tokens_for_keyspace for a new cluster

2019-02-15 Thread Ahmed Eljami
Except that the doc concerns the latest version (4..0) and there is a Jira ( https://issues.apache.org/jira/browse/CASSANDRA-14557) not yet resolved who introduces a new parameter default_keyspace_rf So I'm not sur if it will be the right procedure on 4.0 for this parameter (

Re: Cassandra collection tombstones

2019-01-28 Thread Ahmed Eljami
Hi Alain, Just to confirm, range tombstones that we are talking about here is not related to this jira: https://issues.apache.org/jira/browse/CASSANDRA-14861 ? Thanks a lot.

Re: Question about allocate_tokens_for_keyspace

2019-01-28 Thread Ahmed Eljami
en selection, so this is useful when you have a > single keyspace across the cluster or the same replication strategy for all > keyspaces. > > Also, is worth noting that the option is available for Murmur3Partitioner. > > Regards, > Horia > > On Mon, Jan 28, 2019 at 9:44

Question about allocate_tokens_for_keyspace

2019-01-28 Thread Ahmed Eljami
Hi Folks, I'm about to configure a new cluster with num_token = 32 and using the new token allocation. For the first keyspace, I understood that it will be used to start my cluster: allocate_tokens_for_keyspace = my_first_ks. My question is how about the rest of keyspaces ? they will take the

Re: Re: Re: how to configure the Token Allocation Algorithm

2019-01-24 Thread Ahmed Eljami
number_of_tokens = 12 >> >>> [str(((2**64 / number_of_tokens) * i) - 2**63) for i in >> range(number_of_tokens)] >> ['-9223372036854775808', '-7686143364045646507', '-6148914691236517206', >> '-4611686018427387905', '-3074457345618258604', '-1537228672809129303', >> '-2', '1537228672809129299', '3074457345618258600', '4611686018427387901', >> '6148914691236517202', '7686143364045646503'] >> ``` >> >> >> Using manual initial_token (your idea), how could i add a new node to a >> long running cluster (the procedure)? >> >> -- Cordialement; Ahmed ELJAMI

Re: impact/incompatibility of patch backport on Cassandra 3.11.2

2018-09-12 Thread Ahmed Eljami
Got it! Thanks a lot Jeff :)

Re: impact/incompatibility of patch backport on Cassandra 3.11.2

2018-09-11 Thread Ahmed Eljami
Any opinion please ? Le jeu. 6 sept. 2018 à 22:18, Ahmed Eljami a écrit : > Hi, > > We are testing Cassandra 3.11.2 and we sawed that it contains a critcal > bug wich was fixed in 3.11.3 ( > https://issues.apache.org/jira/browse/CASSANDRA-13929). > > After about 1

impact/incompatibility of patch backport on Cassandra 3.11.2

2018-09-06 Thread Ahmed Eljami
Hi, We are testing Cassandra 3.11.2 and we sawed that it contains a critcal bug wich was fixed in 3.11.3 ( https://issues.apache.org/jira/browse/CASSANDRA-13929). After about 1 months of testing, we haven't encountered this bug in our environnement, but to be sure before going in production, we

Re: Problem to activate mode DEBUG to see the slow queries

2018-06-28 Thread Ahmed Eljami
​Hello Jean Carlo, To activate Debug mode, you should edit "logback.xml " not "log4j-server.properties" Ahmed.

Re: Cassandra Driver Pagination

2018-04-25 Thread Ahmed Eljami
When you continue iterating over > the result set in the java driver and hit the end of the current page, it > will send another request to C* using that paging state to get the next set > of rows. > > Thanks, > Andy > > On Tue, Apr 24, 2018 at 9:49 AM, Ahmed Eljami <ahmed.

Cassandra Driver Pagination

2018-04-24 Thread Ahmed Eljami
Hello, Can someone explain me how paging is implemented ? according to the doc of datastax, the goal being to avoid loading much results in memory. Does it mean that the whole partition is not upload to heap memory? ​C* version: 2.1 Java Driver version: 3.0 ​Best regards​

Re: how to check C* partition size

2018-01-08 Thread Ahmed Eljami
​>Nodetool tablestats gives you a general idea. Since C* 3.X :)

Compaction: ThreadPool Metrics vs Compaction Metrics

2018-01-05 Thread Ahmed Eljami
​Hello, ​​Could someone explain me the difference between the values of the two following metrics​: *​ThreadPool Metrics:​CompactionExecutor:CompletedTasks* vs *Compaction Metrics:CompletedTasks* I do not the same value when I query JMX! Thanks

Re: How to stress test collections in Cassandra Stress

2017-04-24 Thread Ahmed Eljami
> size: fixed(64) > population: norm(0..40M) > - name: items > cluster: fixed(40) > > When running the benchmark, I get: java.io.IOException: Operation x10 on > key(s) [27056313]: Error executing: (NoSuchElementException) > > > -- Cordialement; Ahmed ELJAMI

Re: HELP with bulk loading

2017-03-10 Thread Ahmed Eljami
gt;>> ? >>> >>> 3. sstableloader is slow too. Assuming that I have new empty C* cluster, >>> how can I improve the upload speed? Maybe disable replication or some other >>> settings while streaming and then turn it back? >>> >>> Thanks! >>> Artur. >>> >> > > > -- > > <http://www.datastax.com/> > > STEFANIA ALBORGHETTI > > Software engineer | +852 6114 9265 <+852%206114%209265> | > stefania.alborghe...@datastax.com > > > [image: http://www.datastax.com/cloud-applications] > <http://www.datastax.com/cloud-applications> > > > > -- Cordialement; Ahmed ELJAMI

Re: Discrete events table - Partition Question

2017-02-15 Thread Ahmed Eljami
​Hello, ​I don't see any impact in your case (a table without composite key). But it can be less flexible on your query-pattern, in this case you can't return an event by date... for example! but if you'r sure that you will query only by id_event, in this case, no problems.

Frozen type support

2017-01-24 Thread Ahmed Eljami
Hi, ​I would like to know if the Frozen type will no longer be supported​ in the future versions of Cassandra ? Thx. Ahmed

Re: Not able to cqlsh on 2.1.9 on Ubuntu 14.04

2015-09-14 Thread Ahmed Eljami
### > ajay@comp:~$ telnet localhost 9042 > Trying 127.0.0.1... > > ### > > > > Any ideas please?? We have been stuck on this for a good 3 hours now :( > > > > Thanks and Regards, > Ajay > -- Cordialement; Ahmed ELJAMI

Re: Not able to cqlsh on 2.1.9 on Ubuntu 14.04

2015-09-14 Thread Ahmed Eljami
gt; >> Even telnet fails :( >> >> >> ### >> ajay@comp:~$ telnet localhost 9042 >> Trying 127.0.0.1... >> >> ### >> >> >> >> Any ideas please?? We have been stuck on this for a good 3 hours now :( >> >> >> >> Thanks and Regards, >> Ajay >> > > -- Cordialement; Ahmed ELJAMI

How can I specify the file_data_directories for a keyspace

2015-08-25 Thread Ahmed Eljami
When I defines several file_data_directories in cassandra.yaml, would it be possible to specify the location keyspace and tables ? or it is * only* and *automatically* managed by Cassandra. Thx. -- Ahmed ELJAMI