Re: Memory requirements for Cassandra reaper
Thanks a lot. On Tue, 4 May 2021 at 19:51, Erick Ramirez wrote: > 2GB is allocated to the Reaper JVM on startup (see > https://github.com/thelastpickle/cassandra-reaper/blob/2.2.4/src/packaging/bin/cassandra-reaper#L90-L91 > ). > > If you just want to test it out on a machine with only 8GB, you can update > the cassandra-reaper script to only use 1GB by setting -Xms1G and -Xmx1G > but you won't be able to do much with it. It might also be necessary to > reduce the heap allocated to Cassandra down to 2GB so there's enough RAM > left for the operating system. > > For test and production environments, I recommend deploying Reaper on a > dedicated machine so it doesn't affect the performance of whatever cluster > it is connecting to. Reaper needs a minimum of 2 vCPUs + 2GB of RAM and > this works in most cases. > > As a side note, if you just want to play around with the likes of Reaper > and Medusa (backups) then I'd recommend having a look at deploying > https://k8ssandra.io/ -- it's a production-ready platform for running > Apache Cassandra on Kubernetes with all the tools bundled in: > >- Reaper <http://cassandra-reaper.io/docs/> for automated repairs >- Medusa <https://github.com/thelastpickle/cassandra-medusa/wiki> for >backups and restores >- Metrics Collector ><https://github.com/datastax/metric-collector-for-apache-cassandra> for >monitoring with Prometheus + Grafana >- *Stargate.io <https://stargate.io/>* for accessing your data using >REST, GraphQL and JSON Doc APIs >- Traefik templates for k8s cluster ingress > > Cheers! > >>
Re: Memory requirements for Cassandra reaper
2GB is allocated to the Reaper JVM on startup (see https://github.com/thelastpickle/cassandra-reaper/blob/2.2.4/src/packaging/bin/cassandra-reaper#L90-L91 ). If you just want to test it out on a machine with only 8GB, you can update the cassandra-reaper script to only use 1GB by setting -Xms1G and -Xmx1G but you won't be able to do much with it. It might also be necessary to reduce the heap allocated to Cassandra down to 2GB so there's enough RAM left for the operating system. For test and production environments, I recommend deploying Reaper on a dedicated machine so it doesn't affect the performance of whatever cluster it is connecting to. Reaper needs a minimum of 2 vCPUs + 2GB of RAM and this works in most cases. As a side note, if you just want to play around with the likes of Reaper and Medusa (backups) then I'd recommend having a look at deploying https://k8ssandra.io/ -- it's a production-ready platform for running Apache Cassandra on Kubernetes with all the tools bundled in: - Reaper <http://cassandra-reaper.io/docs/> for automated repairs - Medusa <https://github.com/thelastpickle/cassandra-medusa/wiki> for backups and restores - Metrics Collector <https://github.com/datastax/metric-collector-for-apache-cassandra> for monitoring with Prometheus + Grafana - *Stargate.io <https://stargate.io/>* for accessing your data using REST, GraphQL and JSON Doc APIs - Traefik templates for k8s cluster ingress Cheers! >
Re: Memory requirements for Cassandra reaper
Hi Surbhi, I don't know the memory requirements, but speaking from my observation, a single Cassandra Reaper instance with an external postgres database storage backend, and managing a single small Cassandra cluster, the Cassandra Reaper's Java process memory usage is slightly short of 1GB. The memory usage goes up a little with the size of the cluster, about half MB memory for each additional node in the Cassandra cluster. If you use the in-memory storage backend, you naturally should expect the Cassandra Reaper's Java process to use more memory, but I don't have any data on this. A Cassandra instance with 3GB heap size may take up to 6GB memory, because Cassandra will also use off-heap memory, and the JVM itself also needs to use some memory. The operating system will take maybe 1GB. That will only leave about 1GB for Cassandra Reaper, which doesn't sound like enough. You may need to increase the server's memory size, reduce the Cassandra's heap size a bit or run the Cassandra Reaper on a separate server. Cheers, Bowen On 04/05/2021 19:14, Surbhi Gupta wrote: Hi, What are the memory requirements for Cassandra reaper? I was trying to setup cassandra reaper on a 8GB box where cassandra is taking 3GB heap size , but i got error "Cannot allocate memory" Hence wanted to understand the memory requirements for cassandra reaper . What should be the size of the memory on the box where we need to run reaper ? Thanks Surbhi
Memory requirements for Cassandra reaper
Hi, What are the memory requirements for Cassandra reaper? I was trying to setup cassandra reaper on a 8GB box where cassandra is taking 3GB heap size , but i got error "Cannot allocate memory" Hence wanted to understand the memory requirements for cassandra reaper . What should be the size of the memory on the box where we need to run reaper ? Thanks Surbhi
Cassandra Reaper 2.0 was released
Hi folks, I wanted to share with you that Reaper 2.0 was recently released. It ships with the new sidecar mode (no more externally opened JMX), Cassandra 4.0 support and a lot of other features and optimizations. We wrote 2 blog posts that give more information on the new features in 2.0: https://thelastpickle.com/blog/2019/12/10/cassandra-reaper-2-0-release.html https://thelastpickle.com/blog/2019/12/18/diagnostics.html Upgrade is recommended for people using older versions and we're happy to get your feedback. Documentation and downloads are available on the official Reaper website <http://cassandra-reaper.io/>. Cheers, - Alexander Dejanovski France @alexanderdeja Consultant Apache Cassandra Consulting http://www.thelastpickle.com
RE: [EXTERNAL] Re: Cassandra reaper
Wait, isn’t this the Apache Cassandra mailing list? Shouldn’t this be on the pickle users list or something? (Just kidding, everyone. I think there should be room for reaper and DataStax inquiries here.) Sean Durity From: Joaquin Casares [mailto:joaq...@thelastpickle.com] Sent: Tuesday, April 24, 2018 9:01 PM To: user@cassandra.apache.org Subject: [EXTERNAL] Re: Cassandra reaper Sure thing Abdul, That's great to hear! Unfortunately, the JMX authentication needs to be in the config file currently. And even if the JMX authentication was stored within Cassandra, we would still need to store connection details within the yaml and storing the JMX authentication credentials within Cassandra may not be ideal from a security standpoint. The UI keeps logs of all the previous repairs, to the best of my knowledge. If you want to completely uninstall Reaper, you can perform a DROP KEYSPACE reaper_db; from within cqlsh, but that would remove all schedules as well. Cheers, Joaquin Joaquin Casares Consultant Austin, TX Apache Cassandra Consulting http://www.thelastpickle.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.thelastpickle.com=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=PEWhz4hxiOaWoMVLpyDu5vEkXvAaFOuEwQo32agHoTY=3QUQ2XgRQ31nXrv16qWThhf5iAra-ZKEmm6_Kuviiu4=> On Tue, Apr 24, 2018 at 7:49 PM, Abdul Patel <abd786...@gmail.com<mailto:abd786...@gmail.com>> wrote: Thanks Joaquin, Yes i used the same and worked fine ..only thing is i had to add userid password ..which is somewhat annoyoing to keep in comfig file ..can i get reed of it and still store on reaper_db keyspace? Also how to clean reaper_db by deleting completed reaper information from gui? Or any other cleanup is required? On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com<mailto:joaq...@thelastpickle.com>> wrote: Hello Abdul, Depending on what you want your backend to be stored on, you'll want to use a different file. So if you want your Reaper state to be stored within a Cassandra cluster, which I would recommend, use this file as your base file: https://github.com/thelastpickle/cassandra-reaper/blob/master/src/packaging/resource/cassandra-reaper-cassandra.yaml<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_thelastpickle_cassandra-2Dreaper_blob_master_src_packaging_resource_cassandra-2Dreaper-2Dcassandra.yaml=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=PEWhz4hxiOaWoMVLpyDu5vEkXvAaFOuEwQo32agHoTY=BzysNkz8sW4bppmaQYmtONrtpBJ0AIZykql2dhnve6M=> Make a copy of the yaml and include your system-specific settings. Then symlink it to the following location: /etc/cassandra-reaper/cassandra-reaper.yaml For completeness, this file is an example of how to use a Postgres server to store the Reaper state: https://github.com/thelastpickle/cassandra-reaper/blob/master/src/packaging/resource/cassandra-reaper.yaml<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_thelastpickle_cassandra-2Dreaper_blob_master_src_packaging_resource_cassandra-2Dreaper.yaml=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=PEWhz4hxiOaWoMVLpyDu5vEkXvAaFOuEwQo32agHoTY=uxgFgOaZ4hxGuhEAyJdWBNHtuPWSeMmKLx8D5Vi1cb4=> Hope that helped! Joaquin Casares Consultant Austin, TX Apache Cassandra Consulting http://www.thelastpickle.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.thelastpickle.com=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=PEWhz4hxiOaWoMVLpyDu5vEkXvAaFOuEwQo32agHoTY=3QUQ2XgRQ31nXrv16qWThhf5iAra-ZKEmm6_Kuviiu4=> On Tue, Apr 24, 2018 at 7:07 PM, Abdul Patel <abd786...@gmail.com<mailto:abd786...@gmail.com>> wrote: Thanks But the differnce here is cassandra-reaper-caasandra has more paramters than the cassandra-reaper.yaml Can i just use the 1 file with all details or it looks for one specific file? On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com<mailto:joaq...@thelastpickle.com>> wrote: Hello Abdul, You'll only want one: The yaml file used by the service is located at /etc/cassandra-reaper/cassandra-reaper.yaml and alternate config templates can be found under /etc/cassandra-reaper/configs. It is recommended to create a new file with your specific configuration and symlink it as /etc/cassandra-reaper/cassandra-reaper.yaml to avoid your configuration from being overwritten during upgrades. Adapt the config file to suit your setup and then run `sudo service cassandra-reaper start`. Source: http://cassandra-reaper.io/docs/download/install/#service-configuration<https://urldefense.proofpoint.com/v2/url?u=http-3A__cassandra-2Dreaper.io_docs_download_install_-23service-2Dconfiguration=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=PEWhz4hxiOaWoMVLpyDu5vEkXvAaFOuEwQo32agHoTY=SM78-CnFa1NuyMNphEbKEasDArrYF-DMCed-eq_EZ8k=> Hope t
Cassandra reaper metrics
Hi Does the metrics work with prometheus? I did find graphite example ..not sure what would be the prometheus example.
Re: Cassandra reaper
Sure thing Abdul, That's great to hear! Unfortunately, the JMX authentication needs to be in the config file currently. And even if the JMX authentication was stored within Cassandra, we would still need to store connection details within the yaml and storing the JMX authentication credentials within Cassandra may not be ideal from a security standpoint. The UI keeps logs of all the previous repairs, to the best of my knowledge. If you want to completely uninstall Reaper, you can perform a DROP KEYSPACE reaper_db; from within cqlsh, but that would remove all schedules as well. Cheers, Joaquin Joaquin Casares Consultant Austin, TX Apache Cassandra Consulting http://www.thelastpickle.com On Tue, Apr 24, 2018 at 7:49 PM, Abdul Patel <abd786...@gmail.com> wrote: > Thanks Joaquin, > > Yes i used the same and worked fine ..only thing is i had to add userid > password ..which is somewhat annoyoing to keep in comfig file ..can i get > reed of it and still store on reaper_db keyspace? > Also how to clean reaper_db by deleting completed reaper information from > gui? Or any other cleanup is required? > > > On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com> > wrote: > >> Hello Abdul, >> >> Depending on what you want your backend to be stored on, you'll want to >> use a different file. >> >> So if you want your Reaper state to be stored within a Cassandra cluster, >> which I would recommend, use this file as your base file: >> >> https://github.com/thelastpickle/cassandra-reaper/blob/ >> master/src/packaging/resource/cassandra-reaper-cassandra.yaml >> >> Make a copy of the yaml and include your system-specific settings. Then >> symlink it to the following location: >> >> /etc/cassandra-reaper/cassandra-reaper.yaml >> >> For completeness, this file is an example of how to use a Postgres server >> to store the Reaper state: >> >> https://github.com/thelastpickle/cassandra-reaper/blob/ >> master/src/packaging/resource/cassandra-reaper.yaml >> >> >> Hope that helped! >> >> Joaquin Casares >> Consultant >> Austin, TX >> >> Apache Cassandra Consulting >> http://www.thelastpickle.com >> >> On Tue, Apr 24, 2018 at 7:07 PM, Abdul Patel <abd786...@gmail.com> wrote: >> >>> Thanks >>> >>> But the differnce here is cassandra-reaper-caasandra has more paramters >>> than the cassandra-reaper.yaml >>> Can i just use the 1 file with all details or it looks for one specific >>> file? >>> >>> >>> On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com> >>> wrote: >>> >>>> Hello Abdul, >>>> >>>> You'll only want one: >>>> >>>> The yaml file used by the service is located at >>>> /etc/cassandra-reaper/cassandra-reaper.yaml and alternate config >>>> templates can be found under /etc/cassandra-reaper/configs. It is >>>> recommended to create a new file with your specific configuration and >>>> symlink it as /etc/cassandra-reaper/cassandra-reaper.yaml to avoid >>>> your configuration from being overwritten during upgrades. >>>> >>>> Adapt the config file to suit your setup and then run `sudo service >>>> cassandra-reaper start`. >>>> >>>> >>>> Source: http://cassandra-reaper.io/docs/download/install/#service-co >>>> nfiguration >>>> >>>> >>>> Hope that helps! >>>> >>>> Joaquin Casares >>>> Consultant >>>> Austin, TX >>>> >>>> Apache Cassandra Consulting >>>> http://www.thelastpickle.com >>>> >>>> On Tue, Apr 24, 2018 at 6:51 PM, Abdul Patel <abd786...@gmail.com> >>>> wrote: >>>> >>>>> Hi All, >>>>> >>>>> For reaper do we need both file or only one? >>>>> >>>>> Cassandra.reaper.yaml >>>>> Cassandra-reaper-cassandra.yaml >>>>> >>>> >>>> >>
Re: Cassandra reaper
Thanks Joaquin, Yes i used the same and worked fine ..only thing is i had to add userid password ..which is somewhat annoyoing to keep in comfig file ..can i get reed of it and still store on reaper_db keyspace? Also how to clean reaper_db by deleting completed reaper information from gui? Or any other cleanup is required? On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com> wrote: > Hello Abdul, > > Depending on what you want your backend to be stored on, you'll want to > use a different file. > > So if you want your Reaper state to be stored within a Cassandra cluster, > which I would recommend, use this file as your base file: > > https://github.com/thelastpickle/cassandra-reaper/blob/master/src/ > packaging/resource/cassandra-reaper-cassandra.yaml > > Make a copy of the yaml and include your system-specific settings. Then > symlink it to the following location: > > /etc/cassandra-reaper/cassandra-reaper.yaml > > For completeness, this file is an example of how to use a Postgres server > to store the Reaper state: > > https://github.com/thelastpickle/cassandra-reaper/blob/master/src/ > packaging/resource/cassandra-reaper.yaml > > > Hope that helped! > > Joaquin Casares > Consultant > Austin, TX > > Apache Cassandra Consulting > http://www.thelastpickle.com > > On Tue, Apr 24, 2018 at 7:07 PM, Abdul Patel <abd786...@gmail.com> wrote: > >> Thanks >> >> But the differnce here is cassandra-reaper-caasandra has more paramters >> than the cassandra-reaper.yaml >> Can i just use the 1 file with all details or it looks for one specific >> file? >> >> >> On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com> >> wrote: >> >>> Hello Abdul, >>> >>> You'll only want one: >>> >>> The yaml file used by the service is located at >>> /etc/cassandra-reaper/cassandra-reaper.yaml and alternate config >>> templates can be found under /etc/cassandra-reaper/configs. It is >>> recommended to create a new file with your specific configuration and >>> symlink it as /etc/cassandra-reaper/cassandra-reaper.yaml to avoid your >>> configuration from being overwritten during upgrades. >>> >>> Adapt the config file to suit your setup and then run `sudo service >>> cassandra-reaper start`. >>> >>> >>> Source: http://cassandra-reaper.io/docs/download/install/#service-co >>> nfiguration >>> >>> >>> Hope that helps! >>> >>> Joaquin Casares >>> Consultant >>> Austin, TX >>> >>> Apache Cassandra Consulting >>> http://www.thelastpickle.com >>> >>> On Tue, Apr 24, 2018 at 6:51 PM, Abdul Patel <abd786...@gmail.com> >>> wrote: >>> >>>> Hi All, >>>> >>>> For reaper do we need both file or only one? >>>> >>>> Cassandra.reaper.yaml >>>> Cassandra-reaper-cassandra.yaml >>>> >>> >>> >
Re: Cassandra reaper
Hello Abdul, Depending on what you want your backend to be stored on, you'll want to use a different file. So if you want your Reaper state to be stored within a Cassandra cluster, which I would recommend, use this file as your base file: https://github.com/thelastpickle/cassandra-reaper/blob/master/src/packaging/resource/cassandra-reaper-cassandra.yaml Make a copy of the yaml and include your system-specific settings. Then symlink it to the following location: /etc/cassandra-reaper/cassandra-reaper.yaml For completeness, this file is an example of how to use a Postgres server to store the Reaper state: https://github.com/thelastpickle/cassandra-reaper/blob/master/src/packaging/resource/cassandra-reaper.yaml Hope that helped! Joaquin Casares Consultant Austin, TX Apache Cassandra Consulting http://www.thelastpickle.com On Tue, Apr 24, 2018 at 7:07 PM, Abdul Patel <abd786...@gmail.com> wrote: > Thanks > > But the differnce here is cassandra-reaper-caasandra has more paramters > than the cassandra-reaper.yaml > Can i just use the 1 file with all details or it looks for one specific > file? > > > On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com> > wrote: > >> Hello Abdul, >> >> You'll only want one: >> >> The yaml file used by the service is located at >> /etc/cassandra-reaper/cassandra-reaper.yaml and alternate config >> templates can be found under /etc/cassandra-reaper/configs. It is >> recommended to create a new file with your specific configuration and >> symlink it as /etc/cassandra-reaper/cassandra-reaper.yaml to avoid your >> configuration from being overwritten during upgrades. >> >> Adapt the config file to suit your setup and then run `sudo service >> cassandra-reaper start`. >> >> >> Source: http://cassandra-reaper.io/docs/download/install/#service- >> configuration >> >> >> Hope that helps! >> >> Joaquin Casares >> Consultant >> Austin, TX >> >> Apache Cassandra Consulting >> http://www.thelastpickle.com >> >> On Tue, Apr 24, 2018 at 6:51 PM, Abdul Patel <abd786...@gmail.com> wrote: >> >>> Hi All, >>> >>> For reaper do we need both file or only one? >>> >>> Cassandra.reaper.yaml >>> Cassandra-reaper-cassandra.yaml >>> >> >>
Re: Cassandra reaper
Thanks But the differnce here is cassandra-reaper-caasandra has more paramters than the cassandra-reaper.yaml Can i just use the 1 file with all details or it looks for one specific file? On Tuesday, April 24, 2018, Joaquin Casares <joaq...@thelastpickle.com> wrote: > Hello Abdul, > > You'll only want one: > > The yaml file used by the service is located at > /etc/cassandra-reaper/cassandra-reaper.yaml > and alternate config templates can be found under > /etc/cassandra-reaper/configs. It is recommended to create a new file with > your specific configuration and symlink it as > /etc/cassandra-reaper/cassandra-reaper.yaml > to avoid your configuration from being overwritten during upgrades. > > Adapt the config file to suit your setup and then run `sudo service > cassandra-reaper start`. > > > Source: http://cassandra-reaper.io/docs/download/install/# > service-configuration > > > Hope that helps! > > Joaquin Casares > Consultant > Austin, TX > > Apache Cassandra Consulting > http://www.thelastpickle.com > > On Tue, Apr 24, 2018 at 6:51 PM, Abdul Patel <abd786...@gmail.com> wrote: > >> Hi All, >> >> For reaper do we need both file or only one? >> >> Cassandra.reaper.yaml >> Cassandra-reaper-cassandra.yaml >> > >
Re: Cassandra reaper
Hello Abdul, You'll only want one: The yaml file used by the service is located at /etc/cassandra-reaper/cassandra-reaper.yaml and alternate config templates can be found under /etc/cassandra-reaper/configs. It is recommended to create a new file with your specific configuration and symlink it as /etc/cassandra-reaper/cassandra-reaper.yaml to avoid your configuration from being overwritten during upgrades. Adapt the config file to suit your setup and then run `sudo service cassandra-reaper start`. Source: http://cassandra-reaper.io/docs/download/install/#service-configuration Hope that helps! Joaquin Casares Consultant Austin, TX Apache Cassandra Consulting http://www.thelastpickle.com On Tue, Apr 24, 2018 at 6:51 PM, Abdul Patel <abd786...@gmail.com> wrote: > Hi All, > > For reaper do we need both file or only one? > > Cassandra.reaper.yaml > Cassandra-reaper-cassandra.yaml >
Cassandra reaper
Hi All, For reaper do we need both file or only one? Cassandra.reaper.yaml Cassandra-reaper-cassandra.yaml
RE: [EXTERNAL] Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?
Datos IO solves many of the problems inherent in Cassandra backups (primarily issues with acceptable restores). It is worth considering. Other groups in my company are happy with it. Sean Durity From: Lerh Chuan Low [mailto:l...@instaclustr.com] Sent: Thursday, December 14, 2017 4:13 PM To: user@cassandra.apache.org Subject: [EXTERNAL] Re: Any Cassandra Backup and Restore tool like Cassandra Reaper? Tablesnap assumes S3, and tableslurp can set up the stage for restoring by downloading the relevant SSTables (but then it's up to the operator to complete the restore from there). Restoring (especially point-in-time restore) isn't easy to handle so there aren't a lot available out there. There's also Netflix's Priam https://github.com/Netflix/Priam<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Netflix_Priam=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=sRV37KK5PaTUR9CK_K51nLT891UrXhpxDLeFISAY1w4=CkFf4Zlib0sjVBkVOiWgYY7G1VYKHrBluvU35Cc9bDc=> but I think it's a little bit old and is meant to run alongside C* as an agent and be the agent for repairs, monitoring, backups and restores, configuring Cassandra YAMLs... One other one I've heard of is https://github.com/tbarbugli/cassandra_snapshotter<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_tbarbugli_cassandra-5Fsnapshotter=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=sRV37KK5PaTUR9CK_K51nLT891UrXhpxDLeFISAY1w4=0kRuPvbtgWNr2yV4VOpDk4vqthk_L9CNGX0uxFKFiuc=> but there's no restore yet. On 15 December 2017 at 07:52, Rutvij Bhatt <rut...@sense.com<mailto:rut...@sense.com>> wrote: There is tablesnap/tablechop/tableslurp - https://github.com/JeremyGrosser/tablesnap<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_JeremyGrosser_tablesnap=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=sRV37KK5PaTUR9CK_K51nLT891UrXhpxDLeFISAY1w4=xsx3AL8JrDNgaikDMFEBqTcWpZa9M0h5hevQi4kVB4M=>. On Thu, Dec 14, 2017 at 3:49 PM Roger Brown <roger.br...@perfectsearchcorp.com<mailto:roger.br...@perfectsearchcorp.com>> wrote: I've found nothing affordable that works with vnodes. If you have money, you could use DataStax OpsCenter or Datos.io Recoverx. I ended up creating a cron job to make snapshots along with incremental_backups: true in the cassandra.yaml. And I'm thinking of setting up a replication strategy so that one rack contains 1 replica of each keyspace and then using r1soft to image each of those servers to tape for offsite backup. On Thu, Dec 14, 2017 at 1:30 PM Harika Vangapelli -T (hvangape - AKRAYA INC at Cisco) <hvang...@cisco.com<mailto:hvang...@cisco.com>> wrote: Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? Harika Vangapelli Engineer - IT hvang...@cisco.com<mailto:hvang...@cisco.com> Tel: Cisco Systems, Inc. United States cisco.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__cisco.com=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=sRV37KK5PaTUR9CK_K51nLT891UrXhpxDLeFISAY1w4=usAzFb-boMNjQssKMHYtwrE4ba8eoBMETpRqqLwVjxs=> Think before you print. This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message. Please click here<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.cisco.com_web_about_doing-5Fbusiness_legal_cri_index.html=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=sRV37KK5PaTUR9CK_K51nLT891UrXhpxDLeFISAY1w4=2zOTFslDaReXQeF2gOKx4ax3gH4aLr9WJgcKUvtJUSU=> for Company Registration Information. The information in this Internet Email is confidential and may be legally privileged. It is intended solely for the addressee. Access to this Email by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to our clients any opinions or advice contained in this Email are subject to the terms and conditions expressed in any applicable governing The Home Depot terms of business or client engagement letter. The Home Depot disclaims all responsibility and liability for the accuracy and content of this attachment and for any damages or losses arising from any inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other items of a destructive nature, which may be contained in this attachment and shall not be liable for direct, indirect, consequential or special damages in connection with this e-mail message or its attachment.
Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?
Tablesnap assumes S3, and tableslurp can set up the stage for restoring by downloading the relevant SSTables (but then it's up to the operator to complete the restore from there). Restoring (especially point-in-time restore) isn't easy to handle so there aren't a lot available out there. There's also Netflix's Priam https://github.com/Netflix/Priam but I think it's a little bit old and is meant to run alongside C* as an agent and be the agent for repairs, monitoring, backups and restores, configuring Cassandra YAMLs... One other one I've heard of is https://github.com/tbarbugli/cassandra_snapshotter but there's no restore yet. On 15 December 2017 at 07:52, Rutvij Bhatt <rut...@sense.com> wrote: > There is tablesnap/tablechop/tableslurp - https://github.com/ > JeremyGrosser/tablesnap. > > > On Thu, Dec 14, 2017 at 3:49 PM Roger Brown <roger.brown@ > perfectsearchcorp.com> wrote: > >> I've found nothing affordable that works with vnodes. If you have money, >> you could use DataStax OpsCenter or Datos.io Recoverx. >> >> I ended up creating a cron job to make snapshots along with >> incremental_backups: true in the cassandra.yaml. And I'm thinking of >> setting up a replication strategy so that one rack contains 1 replica of >> each keyspace and then using r1soft to image each of those servers to tape >> for offsite backup. >> >> >> On Thu, Dec 14, 2017 at 1:30 PM Harika Vangapelli -T (hvangape - AKRAYA >> INC at Cisco) <hvang...@cisco.com> wrote: >> >>> Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? >>> >>> >>> >>> [image: >>> http://wwwin.cisco.com/c/dam/cec/organizations/gmcc/services-tools/signaturetool/images/logo/logo_gradient.png] >>> >>> >>> >>> *Harika Vangapelli* >>> >>> Engineer - IT >>> >>> hvang...@cisco.com >>> >>> Tel: >>> >>> *Cisco Systems, Inc.* >>> >>> >>> >>> >>> United States >>> cisco.com >>> >>> >>> >>> [image: http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif]Think >>> before you print. >>> >>> This email may contain confidential and privileged material for the sole >>> use of the intended recipient. Any review, use, distribution or disclosure >>> by others is strictly prohibited. If you are not the intended recipient (or >>> authorized to receive for the recipient), please contact the sender by >>> reply email and delete all copies of this message. >>> >>> Please click here >>> <http://www.cisco.com/web/about/doing_business/legal/cri/index.html> >>> for Company Registration Information. >>> >>> >>> >>
Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?
There is tablesnap/tablechop/tableslurp - https://github.com/JeremyGrosser/tablesnap. On Thu, Dec 14, 2017 at 3:49 PM Roger Brown < roger.br...@perfectsearchcorp.com> wrote: > I've found nothing affordable that works with vnodes. If you have money, > you could use DataStax OpsCenter or Datos.io Recoverx. > > I ended up creating a cron job to make snapshots along with > incremental_backups: true in the cassandra.yaml. And I'm thinking of > setting up a replication strategy so that one rack contains 1 replica of > each keyspace and then using r1soft to image each of those servers to tape > for offsite backup. > > > On Thu, Dec 14, 2017 at 1:30 PM Harika Vangapelli -T (hvangape - AKRAYA > INC at Cisco) <hvang...@cisco.com> wrote: > >> Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? >> >> >> >> [image: >> http://wwwin.cisco.com/c/dam/cec/organizations/gmcc/services-tools/signaturetool/images/logo/logo_gradient.png] >> >> >> >> *Harika Vangapelli* >> >> Engineer - IT >> >> hvang...@cisco.com >> >> Tel: >> >> *Cisco Systems, Inc.* >> >> >> >> >> United States >> cisco.com >> >> >> >> [image: http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif]Think >> before you print. >> >> This email may contain confidential and privileged material for the sole >> use of the intended recipient. Any review, use, distribution or disclosure >> by others is strictly prohibited. If you are not the intended recipient (or >> authorized to receive for the recipient), please contact the sender by >> reply email and delete all copies of this message. >> >> Please click here >> <http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for >> Company Registration Information. >> >> >> >
Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?
I've found nothing affordable that works with vnodes. If you have money, you could use DataStax OpsCenter or Datos.io Recoverx. I ended up creating a cron job to make snapshots along with incremental_backups: true in the cassandra.yaml. And I'm thinking of setting up a replication strategy so that one rack contains 1 replica of each keyspace and then using r1soft to image each of those servers to tape for offsite backup. On Thu, Dec 14, 2017 at 1:30 PM Harika Vangapelli -T (hvangape - AKRAYA INC at Cisco) <hvang...@cisco.com> wrote: > Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? > > > > [image: > http://wwwin.cisco.com/c/dam/cec/organizations/gmcc/services-tools/signaturetool/images/logo/logo_gradient.png] > > > > *Harika Vangapelli* > > Engineer - IT > > hvang...@cisco.com > > Tel: > > *Cisco Systems, Inc.* > > > > > United States > cisco.com > > > > [image: http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif]Think > before you print. > > This email may contain confidential and privileged material for the sole > use of the intended recipient. Any review, use, distribution or disclosure > by others is strictly prohibited. If you are not the intended recipient (or > authorized to receive for the recipient), please contact the sender by > reply email and delete all copies of this message. > > Please click here > <http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for > Company Registration Information. > > >
Any Cassandra Backup and Restore tool like Cassandra Reaper?
Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? [http://wwwin.cisco.com/c/dam/cec/organizations/gmcc/services-tools/signaturetool/images/logo/logo_gradient.png] Harika Vangapelli Engineer - IT hvang...@cisco.com<mailto:hvang...@cisco.com> Tel: Cisco Systems, Inc. United States cisco.com [http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif]Think before you print. This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message. Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.
New command line client for cassandra-reaper
Hi, I'm using cassandra-reaper (https://github.com/thelastpickle/cassandra-reaper) to manage repairs of my Cassandra clusters, probably like a bunch of other people. When I started using it (it was still the version from the spotify repository) the UI didn't work well, and the Python cli client was slow to use because we had to use Docker to run it. It was frustrating for me so over a couple of weeks I wrote https://github.com/vrischmann/happyreaper which is another CLI client. It doesn't do much more than spreaper (there are some client-side filters that spreaper doesn't have I think), the main benefit is that it's a self-contained binary without needing a Python environment. I'm announcing it here in case it's of interest to anyone. If anyone has feedback feel free to share. Vincent.
Re: Cassandra reaper
Done, thanks https://github.com/thelastpickle/cassandra-reaper/issues/22 On Mon, Nov 21, 2016 at 9:53 PM, Alexander Dejanovski < a...@thelastpickle.com> wrote: > Hi Jai, > > Reaper is fully open sourced and you should be able to add schedules. > Could you open an issue on GitHub and provide both configuration and error > output (if any) ? >> https://github.com/thelastpickle/cassandra- > reaper/issues > > > Thanks, > > On Tue, Nov 22, 2016 at 1:59 AM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> I noticed that I am not able to add schedules, but I can run repairs. >> >> Is there some limitation on the opensource for adding the schedules? >> >> On Mon, Nov 21, 2016 at 4:25 PM, Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> wrote: >> >> Hello Alexander, >> >> Thanks for the help, I couldn't get around with my issue. >> but I started using : https://github.com/thelastpickle/cassandra-reaper >> it works like a charm :) >> >> I am using GUI, I just need to tweak/play with the configuration. >> >> Thanks again for the help >> >> >> On Tue, Nov 1, 2016 at 12:26 PM, Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> wrote: >> >> ok thank you, >> I will try and update you. >> >> On Tue, Nov 1, 2016 at 10:57 AM, Alexander Dejanovski < >> a...@thelastpickle.com> wrote: >> >> Running reaper with INFO level logging (that can be configured in the >> yaml file), you should have a console output telling you what's going on. >> >> If you started reaper with memory back end, restarting it will reset it >> and you'll have to register your cluster again, but if you used postgres it >> will resume tasks where they were left off. >> >> Please restart Reaper to at least have an output we can get information >> from, otherwise we're blind. >> >> Since you're using Cassandra 2.1, I'd advise switching to our fork since >> the original one is compiled against Cassandra 2.0 libraries. If you switch >> and use postgres, make sure you update the schema accordingly as we added >> fields for incremental repair support. >> >> Cheers, >> >> Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> a écrit : >> >> Cassandra version is 2.1.16 >> >> In my setup I don't see it is writting to any logs >> >> On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < >> a...@thelastpickle.com> wrote: >> >> Do you have anything in the reaper logs that would show a failure of some >> sort ? >> Also, can you tell me which version of Cassandra you're using ? >> >> Thanks >> >> On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> wrote: >> >> Thanks Alex, >> >> Forgot to mention but I did add the cluster. See the status below. It >> says the status is running but I don't see any repair happening. this is in >> the same state from past 1 days. >> b/w there not much of data in cluster. >> >> [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 >> # Report improvements/bugs at https://github.com/spotify/ >> cassandra-reaper/issues >> # >> -- >> # Repair run with id '3': >> { >> "cause": "manual spreaper run", >> "cluster_name": "production", >> "column_families": [], >> "creation_time": "2016-11-01T00:39:15Z", >> "duration": null, >> "end_time": null, >> "estimated_time_of_arrival": null, >> "id": 3, >> "intensity": 0.900, >> "keyspace_name": "users", >> * "last_event": "no events",* >> "owner": "root", >> "pause_time": null, >> "repair_parallelism": "DATACENTER_AWARE", >> "segments_repaired": 0, >> "start_time": "2016-11-01T00:39:15Z", >> * "state": "RUNNING",* >> "total_segments": 301 >> } >> [root@ machine cassandra-reaper]# >> >> On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < >> a...@thelastpickle.com> wrote: >> >> Hi, >> >> The first step in using reaper is to add a cluster to it, as it is a tool >> that can manage multiple clusters and does not
Re: Cassandra reaper
Hi Jai, Reaper is fully open sourced and you should be able to add schedules. Could you open an issue on GitHub and provide both configuration and error output (if any) ? >> https://github.com/thelastpickle/cassandra-reaper/issues Thanks, On Tue, Nov 22, 2016 at 1:59 AM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > I noticed that I am not able to add schedules, but I can run repairs. > > Is there some limitation on the opensource for adding the schedules? > > On Mon, Nov 21, 2016 at 4:25 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello Alexander, > > Thanks for the help, I couldn't get around with my issue. > but I started using : https://github.com/thelastpickle/cassandra-reaper > it works like a charm :) > > I am using GUI, I just need to tweak/play with the configuration. > > Thanks again for the help > > > On Tue, Nov 1, 2016 at 12:26 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > ok thank you, > I will try and update you. > > On Tue, Nov 1, 2016 at 10:57 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > > Running reaper with INFO level logging (that can be configured in the yaml > file), you should have a console output telling you what's going on. > > If you started reaper with memory back end, restarting it will reset it > and you'll have to register your cluster again, but if you used postgres it > will resume tasks where they were left off. > > Please restart Reaper to at least have an output we can get information > from, otherwise we're blind. > > Since you're using Cassandra 2.1, I'd advise switching to our fork since > the original one is compiled against Cassandra 2.0 libraries. If you switch > and use postgres, make sure you update the schema accordingly as we added > fields for incremental repair support. > > Cheers, > > Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> a écrit : > > Cassandra version is 2.1.16 > > In my setup I don't see it is writting to any logs > > On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > > Do you have anything in the reaper logs that would show a failure of some > sort ? > Also, can you tell me which version of Cassandra you're using ? > > Thanks > > On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Thanks Alex, > > Forgot to mention but I did add the cluster. See the status below. It says > the status is running but I don't see any repair happening. this is in the > same state from past 1 days. > b/w there not much of data in cluster. > > [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 > # Report improvements/bugs at > https://github.com/spotify/cassandra-reaper/issues > # > -- > # Repair run with id '3': > { > "cause": "manual spreaper run", > "cluster_name": "production", > "column_families": [], > "creation_time": "2016-11-01T00:39:15Z", > "duration": null, > "end_time": null, > "estimated_time_of_arrival": null, > "id": 3, > "intensity": 0.900, > "keyspace_name": "users", > * "last_event": "no events",* > "owner": "root", > "pause_time": null, > "repair_parallelism": "DATACENTER_AWARE", > "segments_repaired": 0, > "start_time": "2016-11-01T00:39:15Z", > * "state": "RUNNING",* > "total_segments": 301 > } > [root@ machine cassandra-reaper]# > > On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > > Hi, > > The first step in using reaper is to add a cluster to it, as it is a tool > that can manage multiple clusters and does not need to be executed on a > Cassandra node (you can run in on any edge node you want). > > You should run : ./bin/spreaper add-cluster 127.0.0.1 > Where you'll replace 127.0.0.1 by the address of one of the nodes of your > cluster. > > Then you can run : ./bin/spreaper cluster_name keyspace_name > to start repairing a keyspace. > > You might want to drop in the UI made by Stefan Podkowinski which might > ease things up for you, at least at the beginning : > https://github.com/spodkowinski/cassandra-reaper-ui > > Worth mentioning that at The Last Pickle we maintain a fork of Reaper that > handles incremental repair
Re: Cassandra reaper
I noticed that I am not able to add schedules, but I can run repairs. Is there some limitation on the opensource for adding the schedules? On Mon, Nov 21, 2016 at 4:25 PM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Hello Alexander, > > Thanks for the help, I couldn't get around with my issue. > but I started using : https://github.com/thelastpickle/cassandra-reaper > it works like a charm :) > > I am using GUI, I just need to tweak/play with the configuration. > > Thanks again for the help > > > On Tue, Nov 1, 2016 at 12:26 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> ok thank you, >> I will try and update you. >> >> On Tue, Nov 1, 2016 at 10:57 AM, Alexander Dejanovski < >> a...@thelastpickle.com> wrote: >> >>> Running reaper with INFO level logging (that can be configured in the >>> yaml file), you should have a console output telling you what's going on. >>> >>> If you started reaper with memory back end, restarting it will reset it >>> and you'll have to register your cluster again, but if you used postgres it >>> will resume tasks where they were left off. >>> >>> Please restart Reaper to at least have an output we can get information >>> from, otherwise we're blind. >>> >>> Since you're using Cassandra 2.1, I'd advise switching to our fork since >>> the original one is compiled against Cassandra 2.0 libraries. If you switch >>> and use postgres, make sure you update the schema accordingly as we added >>> fields for incremental repair support. >>> >>> Cheers, >>> >>> Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada < >>> jaibheem...@gmail.com> a écrit : >>> >>>> Cassandra version is 2.1.16 >>>> >>>> In my setup I don't see it is writting to any logs >>>> >>>> On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < >>>> a...@thelastpickle.com> wrote: >>>> >>>> Do you have anything in the reaper logs that would show a failure of >>>> some sort ? >>>> Also, can you tell me which version of Cassandra you're using ? >>>> >>>> Thanks >>>> >>>> On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < >>>> jaibheem...@gmail.com> wrote: >>>> >>>> Thanks Alex, >>>> >>>> Forgot to mention but I did add the cluster. See the status below. It >>>> says the status is running but I don't see any repair happening. this is in >>>> the same state from past 1 days. >>>> b/w there not much of data in cluster. >>>> >>>> [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 >>>> # Report improvements/bugs at https://github.com/spotify/cas >>>> sandra-reaper/issues >>>> # >>>> -- >>>> # Repair run with id '3': >>>> { >>>> "cause": "manual spreaper run", >>>> "cluster_name": "production", >>>> "column_families": [], >>>> "creation_time": "2016-11-01T00:39:15Z", >>>> "duration": null, >>>> "end_time": null, >>>> "estimated_time_of_arrival": null, >>>> "id": 3, >>>> "intensity": 0.900, >>>> "keyspace_name": "users", >>>> * "last_event": "no events",* >>>> "owner": "root", >>>> "pause_time": null, >>>> "repair_parallelism": "DATACENTER_AWARE", >>>> "segments_repaired": 0, >>>> "start_time": "2016-11-01T00:39:15Z", >>>> * "state": "RUNNING",* >>>> "total_segments": 301 >>>> } >>>> [root@ machine cassandra-reaper]# >>>> >>>> On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < >>>> a...@thelastpickle.com> wrote: >>>> >>>> Hi, >>>> >>>> The first step in using reaper is to add a cluster to it, as it is a >>>> tool that can manage multiple clusters and does not need to be executed on >>>> a Cassandra node (you can run in on any edge node you want). >>>> >>>> You should run : ./bi
Re: Cassandra reaper
Hello Alexander, Thanks for the help, I couldn't get around with my issue. but I started using : https://github.com/thelastpickle/cassandra-reaper it works like a charm :) I am using GUI, I just need to tweak/play with the configuration. Thanks again for the help On Tue, Nov 1, 2016 at 12:26 PM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > ok thank you, > I will try and update you. > > On Tue, Nov 1, 2016 at 10:57 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > >> Running reaper with INFO level logging (that can be configured in the >> yaml file), you should have a console output telling you what's going on. >> >> If you started reaper with memory back end, restarting it will reset it >> and you'll have to register your cluster again, but if you used postgres it >> will resume tasks where they were left off. >> >> Please restart Reaper to at least have an output we can get information >> from, otherwise we're blind. >> >> Since you're using Cassandra 2.1, I'd advise switching to our fork since >> the original one is compiled against Cassandra 2.0 libraries. If you switch >> and use postgres, make sure you update the schema accordingly as we added >> fields for incremental repair support. >> >> Cheers, >> >> Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> a écrit : >> >>> Cassandra version is 2.1.16 >>> >>> In my setup I don't see it is writting to any logs >>> >>> On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < >>> a...@thelastpickle.com> wrote: >>> >>> Do you have anything in the reaper logs that would show a failure of >>> some sort ? >>> Also, can you tell me which version of Cassandra you're using ? >>> >>> Thanks >>> >>> On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < >>> jaibheem...@gmail.com> wrote: >>> >>> Thanks Alex, >>> >>> Forgot to mention but I did add the cluster. See the status below. It >>> says the status is running but I don't see any repair happening. this is in >>> the same state from past 1 days. >>> b/w there not much of data in cluster. >>> >>> [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 >>> # Report improvements/bugs at https://github.com/spotify/cas >>> sandra-reaper/issues >>> # >>> -- >>> # Repair run with id '3': >>> { >>> "cause": "manual spreaper run", >>> "cluster_name": "production", >>> "column_families": [], >>> "creation_time": "2016-11-01T00:39:15Z", >>> "duration": null, >>> "end_time": null, >>> "estimated_time_of_arrival": null, >>> "id": 3, >>> "intensity": 0.900, >>> "keyspace_name": "users", >>> * "last_event": "no events",* >>> "owner": "root", >>> "pause_time": null, >>> "repair_parallelism": "DATACENTER_AWARE", >>> "segments_repaired": 0, >>> "start_time": "2016-11-01T00:39:15Z", >>> * "state": "RUNNING",* >>> "total_segments": 301 >>> } >>> [root@ machine cassandra-reaper]# >>> >>> On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < >>> a...@thelastpickle.com> wrote: >>> >>> Hi, >>> >>> The first step in using reaper is to add a cluster to it, as it is a >>> tool that can manage multiple clusters and does not need to be executed on >>> a Cassandra node (you can run in on any edge node you want). >>> >>> You should run : ./bin/spreaper add-cluster 127.0.0.1 >>> Where you'll replace 127.0.0.1 by the address of one of the nodes of >>> your cluster. >>> >>> Then you can run : ./bin/spreaper cluster_name keyspace_name >>> to start repairing a keyspace. >>> >>> You might want to drop in the UI made by Stefan Podkowinski which might >>> ease things up for you, at least at the beginning : >>> https://github.com/spodkowinski/cassandra-reaper-ui >>> >>> Worth mentioning that at The Last Pickle we maintain a fork of Reaper >>> that handles incremental repair, works with
Re: Cassandra reaper
ok thank you, I will try and update you. On Tue, Nov 1, 2016 at 10:57 AM, Alexander Dejanovski < a...@thelastpickle.com> wrote: > Running reaper with INFO level logging (that can be configured in the yaml > file), you should have a console output telling you what's going on. > > If you started reaper with memory back end, restarting it will reset it > and you'll have to register your cluster again, but if you used postgres it > will resume tasks where they were left off. > > Please restart Reaper to at least have an output we can get information > from, otherwise we're blind. > > Since you're using Cassandra 2.1, I'd advise switching to our fork since > the original one is compiled against Cassandra 2.0 libraries. If you switch > and use postgres, make sure you update the schema accordingly as we added > fields for incremental repair support. > > Cheers, > > Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> a écrit : > >> Cassandra version is 2.1.16 >> >> In my setup I don't see it is writting to any logs >> >> On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < >> a...@thelastpickle.com> wrote: >> >> Do you have anything in the reaper logs that would show a failure of some >> sort ? >> Also, can you tell me which version of Cassandra you're using ? >> >> Thanks >> >> On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> wrote: >> >> Thanks Alex, >> >> Forgot to mention but I did add the cluster. See the status below. It >> says the status is running but I don't see any repair happening. this is in >> the same state from past 1 days. >> b/w there not much of data in cluster. >> >> [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 >> # Report improvements/bugs at https://github.com/spotify/ >> cassandra-reaper/issues >> # >> -- >> # Repair run with id '3': >> { >> "cause": "manual spreaper run", >> "cluster_name": "production", >> "column_families": [], >> "creation_time": "2016-11-01T00:39:15Z", >> "duration": null, >> "end_time": null, >> "estimated_time_of_arrival": null, >> "id": 3, >> "intensity": 0.900, >> "keyspace_name": "users", >> * "last_event": "no events",* >> "owner": "root", >> "pause_time": null, >> "repair_parallelism": "DATACENTER_AWARE", >> "segments_repaired": 0, >> "start_time": "2016-11-01T00:39:15Z", >> * "state": "RUNNING",* >> "total_segments": 301 >> } >> [root@ machine cassandra-reaper]# >> >> On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < >> a...@thelastpickle.com> wrote: >> >> Hi, >> >> The first step in using reaper is to add a cluster to it, as it is a tool >> that can manage multiple clusters and does not need to be executed on a >> Cassandra node (you can run in on any edge node you want). >> >> You should run : ./bin/spreaper add-cluster 127.0.0.1 >> Where you'll replace 127.0.0.1 by the address of one of the nodes of your >> cluster. >> >> Then you can run : ./bin/spreaper cluster_name keyspace_name >> to start repairing a keyspace. >> >> You might want to drop in the UI made by Stefan Podkowinski which might >> ease things up for you, at least at the beginning : https://github.com/ >> spodkowinski/cassandra-reaper-ui >> >> Worth mentioning that at The Last Pickle we maintain a fork of Reaper >> that handles incremental repair, works with C* 2.x and 3.0, and bundles the >> UI : https://github.com/thelastpickle/cassandra-reaper >> We have a branch that allows using Cassandra as a storage backend instead >> of Postgres : https://github.com/thelastpickle/cassandra- >> reaper/tree/add-cassandra-storage >> It should be merged to master really soon and should be ready to use. >> >> Cheers, >> >> >> On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> wrote: >> >> Hello, >> >> Has anyone played around with the cassandra reaper ( >> https://github.com/spotify/cassandra-reaper)? >> >> if so can some please help me with the set-up, I can't get it working. I >> used the below steps: >> >> 1. create jar file using maven >> 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server >> cassandra-reaper.yaml >> 3. ./bin/spreaper repair production users >> >> -- >> - >> Alexander Dejanovski >> France >> @alexanderdeja >> >> Consultant >> Apache Cassandra Consulting >> http://www.thelastpickle.com >> >> >> -- >> - >> Alexander Dejanovski >> France >> @alexanderdeja >> >> Consultant >> Apache Cassandra Consulting >> http://www.thelastpickle.com >> >> >> -- > - > Alexander Dejanovski > France > @alexanderdeja > > Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com >
Re: Cassandra reaper
Running reaper with INFO level logging (that can be configured in the yaml file), you should have a console output telling you what's going on. If you started reaper with memory back end, restarting it will reset it and you'll have to register your cluster again, but if you used postgres it will resume tasks where they were left off. Please restart Reaper to at least have an output we can get information from, otherwise we're blind. Since you're using Cassandra 2.1, I'd advise switching to our fork since the original one is compiled against Cassandra 2.0 libraries. If you switch and use postgres, make sure you update the schema accordingly as we added fields for incremental repair support. Cheers, Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada <jaibheem...@gmail.com> a écrit : > Cassandra version is 2.1.16 > > In my setup I don't see it is writting to any logs > > On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > > Do you have anything in the reaper logs that would show a failure of some > sort ? > Also, can you tell me which version of Cassandra you're using ? > > Thanks > > On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Thanks Alex, > > Forgot to mention but I did add the cluster. See the status below. It says > the status is running but I don't see any repair happening. this is in the > same state from past 1 days. > b/w there not much of data in cluster. > > [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 > # Report improvements/bugs at > https://github.com/spotify/cassandra-reaper/issues > # > -- > # Repair run with id '3': > { > "cause": "manual spreaper run", > "cluster_name": "production", > "column_families": [], > "creation_time": "2016-11-01T00:39:15Z", > "duration": null, > "end_time": null, > "estimated_time_of_arrival": null, > "id": 3, > "intensity": 0.900, > "keyspace_name": "users", > * "last_event": "no events",* > "owner": "root", > "pause_time": null, > "repair_parallelism": "DATACENTER_AWARE", > "segments_repaired": 0, > "start_time": "2016-11-01T00:39:15Z", > * "state": "RUNNING",* > "total_segments": 301 > } > [root@ machine cassandra-reaper]# > > On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > > Hi, > > The first step in using reaper is to add a cluster to it, as it is a tool > that can manage multiple clusters and does not need to be executed on a > Cassandra node (you can run in on any edge node you want). > > You should run : ./bin/spreaper add-cluster 127.0.0.1 > Where you'll replace 127.0.0.1 by the address of one of the nodes of your > cluster. > > Then you can run : ./bin/spreaper cluster_name keyspace_name > to start repairing a keyspace. > > You might want to drop in the UI made by Stefan Podkowinski which might > ease things up for you, at least at the beginning : > https://github.com/spodkowinski/cassandra-reaper-ui > > Worth mentioning that at The Last Pickle we maintain a fork of Reaper that > handles incremental repair, works with C* 2.x and 3.0, and bundles the UI : > https://github.com/thelastpickle/cassandra-reaper > We have a branch that allows using Cassandra as a storage backend instead > of Postgres : > https://github.com/thelastpickle/cassandra-reaper/tree/add-cassandra-storage > It should be merged to master really soon and should be ready to use. > > Cheers, > > > On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello, > > Has anyone played around with the cassandra reaper ( > https://github.com/spotify/cassandra-reaper)? > > if so can some please help me with the set-up, I can't get it working. I > used the below steps: > > 1. create jar file using maven > 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server > cassandra-reaper.yaml > 3. ./bin/spreaper repair production users > > -- > - > Alexander Dejanovski > France > @alexanderdeja > > Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > > > -- > - > Alexander Dejanovski > France > @alexanderdeja > > Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > > > -- - Alexander Dejanovski France @alexanderdeja Consultant Apache Cassandra Consulting http://www.thelastpickle.com
Re: Cassandra reaper
Cassandra version is 2.1.16 In my setup I don't see it is writting to any logs On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < a...@thelastpickle.com> wrote: > Do you have anything in the reaper logs that would show a failure of some > sort ? > Also, can you tell me which version of Cassandra you're using ? > > Thanks > > On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Thanks Alex, >> >> Forgot to mention but I did add the cluster. See the status below. It >> says the status is running but I don't see any repair happening. this is in >> the same state from past 1 days. >> b/w there not much of data in cluster. >> >> [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 >> # Report improvements/bugs at https://github.com/spotify/ >> cassandra-reaper/issues >> # >> -- >> # Repair run with id '3': >> { >> "cause": "manual spreaper run", >> "cluster_name": "production", >> "column_families": [], >> "creation_time": "2016-11-01T00:39:15Z", >> "duration": null, >> "end_time": null, >> "estimated_time_of_arrival": null, >> "id": 3, >> "intensity": 0.900, >> "keyspace_name": "users", >> * "last_event": "no events",* >> "owner": "root", >> "pause_time": null, >> "repair_parallelism": "DATACENTER_AWARE", >> "segments_repaired": 0, >> "start_time": "2016-11-01T00:39:15Z", >> * "state": "RUNNING",* >> "total_segments": 301 >> } >> [root@ machine cassandra-reaper]# >> >> On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < >> a...@thelastpickle.com> wrote: >> >> Hi, >> >> The first step in using reaper is to add a cluster to it, as it is a tool >> that can manage multiple clusters and does not need to be executed on a >> Cassandra node (you can run in on any edge node you want). >> >> You should run : ./bin/spreaper add-cluster 127.0.0.1 >> Where you'll replace 127.0.0.1 by the address of one of the nodes of your >> cluster. >> >> Then you can run : ./bin/spreaper cluster_name keyspace_name >> to start repairing a keyspace. >> >> You might want to drop in the UI made by Stefan Podkowinski which might >> ease things up for you, at least at the beginning : https://github.com/ >> spodkowinski/cassandra-reaper-ui >> >> Worth mentioning that at The Last Pickle we maintain a fork of Reaper >> that handles incremental repair, works with C* 2.x and 3.0, and bundles the >> UI : https://github.com/thelastpickle/cassandra-reaper >> We have a branch that allows using Cassandra as a storage backend instead >> of Postgres : https://github.com/thelastpickle/cassandra- >> reaper/tree/add-cassandra-storage >> It should be merged to master really soon and should be ready to use. >> >> Cheers, >> >> >> On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada < >> jaibheem...@gmail.com> wrote: >> >> Hello, >> >> Has anyone played around with the cassandra reaper ( >> https://github.com/spotify/cassandra-reaper)? >> >> if so can some please help me with the set-up, I can't get it working. I >> used the below steps: >> >> 1. create jar file using maven >> 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server >> cassandra-reaper.yaml >> 3. ./bin/spreaper repair production users >> >> -- >> - >> Alexander Dejanovski >> France >> @alexanderdeja >> >> Consultant >> Apache Cassandra Consulting >> http://www.thelastpickle.com >> >> >> -- > - > Alexander Dejanovski > France > @alexanderdeja > > Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com >
Re: Cassandra reaper
Do you have anything in the reaper logs that would show a failure of some sort ? Also, can you tell me which version of Cassandra you're using ? Thanks On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Thanks Alex, > > Forgot to mention but I did add the cluster. See the status below. It says > the status is running but I don't see any repair happening. this is in the > same state from past 1 days. > b/w there not much of data in cluster. > > [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 > # Report improvements/bugs at > https://github.com/spotify/cassandra-reaper/issues > # > -- > # Repair run with id '3': > { > "cause": "manual spreaper run", > "cluster_name": "production", > "column_families": [], > "creation_time": "2016-11-01T00:39:15Z", > "duration": null, > "end_time": null, > "estimated_time_of_arrival": null, > "id": 3, > "intensity": 0.900, > "keyspace_name": "users", > * "last_event": "no events",* > "owner": "root", > "pause_time": null, > "repair_parallelism": "DATACENTER_AWARE", > "segments_repaired": 0, > "start_time": "2016-11-01T00:39:15Z", > * "state": "RUNNING",* > "total_segments": 301 > } > [root@ machine cassandra-reaper]# > > On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > > Hi, > > The first step in using reaper is to add a cluster to it, as it is a tool > that can manage multiple clusters and does not need to be executed on a > Cassandra node (you can run in on any edge node you want). > > You should run : ./bin/spreaper add-cluster 127.0.0.1 > Where you'll replace 127.0.0.1 by the address of one of the nodes of your > cluster. > > Then you can run : ./bin/spreaper cluster_name keyspace_name > to start repairing a keyspace. > > You might want to drop in the UI made by Stefan Podkowinski which might > ease things up for you, at least at the beginning : > https://github.com/spodkowinski/cassandra-reaper-ui > > Worth mentioning that at The Last Pickle we maintain a fork of Reaper that > handles incremental repair, works with C* 2.x and 3.0, and bundles the UI : > https://github.com/thelastpickle/cassandra-reaper > We have a branch that allows using Cassandra as a storage backend instead > of Postgres : > https://github.com/thelastpickle/cassandra-reaper/tree/add-cassandra-storage > It should be merged to master really soon and should be ready to use. > > Cheers, > > > On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello, > > Has anyone played around with the cassandra reaper ( > https://github.com/spotify/cassandra-reaper)? > > if so can some please help me with the set-up, I can't get it working. I > used the below steps: > > 1. create jar file using maven > 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server > cassandra-reaper.yaml > 3. ./bin/spreaper repair production users > > -- > - > Alexander Dejanovski > France > @alexanderdeja > > Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > > > -- - Alexander Dejanovski France @alexanderdeja Consultant Apache Cassandra Consulting http://www.thelastpickle.com
Re: Cassandra reaper
Thanks Alex, Forgot to mention but I did add the cluster. See the status below. It says the status is running but I don't see any repair happening. this is in the same state from past 1 days. b/w there not much of data in cluster. [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 # Report improvements/bugs at https://github.com/spotify/cassandra-reaper/issues # -- # Repair run with id '3': { "cause": "manual spreaper run", "cluster_name": "production", "column_families": [], "creation_time": "2016-11-01T00:39:15Z", "duration": null, "end_time": null, "estimated_time_of_arrival": null, "id": 3, "intensity": 0.900, "keyspace_name": "users", * "last_event": "no events",* "owner": "root", "pause_time": null, "repair_parallelism": "DATACENTER_AWARE", "segments_repaired": 0, "start_time": "2016-11-01T00:39:15Z", * "state": "RUNNING",* "total_segments": 301 } [root@ machine cassandra-reaper]# On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski <a...@thelastpickle.com > wrote: > Hi, > > The first step in using reaper is to add a cluster to it, as it is a tool > that can manage multiple clusters and does not need to be executed on a > Cassandra node (you can run in on any edge node you want). > > You should run : ./bin/spreaper add-cluster 127.0.0.1 > Where you'll replace 127.0.0.1 by the address of one of the nodes of your > cluster. > > Then you can run : ./bin/spreaper cluster_name keyspace_name > to start repairing a keyspace. > > You might want to drop in the UI made by Stefan Podkowinski which might > ease things up for you, at least at the beginning : https://github.com/ > spodkowinski/cassandra-reaper-ui > > Worth mentioning that at The Last Pickle we maintain a fork of Reaper that > handles incremental repair, works with C* 2.x and 3.0, and bundles the UI : > https://github.com/thelastpickle/cassandra-reaper > We have a branch that allows using Cassandra as a storage backend instead > of Postgres : https://github.com/thelastpickle/cassandra- > reaper/tree/add-cassandra-storage > It should be merged to master really soon and should be ready to use. > > Cheers, > > > On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Hello, >> >> Has anyone played around with the cassandra reaper ( >> https://github.com/spotify/cassandra-reaper)? >> >> if so can some please help me with the set-up, I can't get it working. I >> used the below steps: >> >> 1. create jar file using maven >> 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server >> cassandra-reaper.yaml >> 3. ./bin/spreaper repair production users >> > -- > - > Alexander Dejanovski > France > @alexanderdeja > > Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com >
Re: Cassandra reaper
Hi, The first step in using reaper is to add a cluster to it, as it is a tool that can manage multiple clusters and does not need to be executed on a Cassandra node (you can run in on any edge node you want). You should run : ./bin/spreaper add-cluster 127.0.0.1 Where you'll replace 127.0.0.1 by the address of one of the nodes of your cluster. Then you can run : ./bin/spreaper cluster_name keyspace_name to start repairing a keyspace. You might want to drop in the UI made by Stefan Podkowinski which might ease things up for you, at least at the beginning : https://github.com/spodkowinski/cassandra-reaper-ui Worth mentioning that at The Last Pickle we maintain a fork of Reaper that handles incremental repair, works with C* 2.x and 3.0, and bundles the UI : https://github.com/thelastpickle/cassandra-reaper We have a branch that allows using Cassandra as a storage backend instead of Postgres : https://github.com/thelastpickle/cassandra-reaper/tree/add-cassandra-storage It should be merged to master really soon and should be ready to use. Cheers, On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Hello, > > Has anyone played around with the cassandra reaper ( > https://github.com/spotify/cassandra-reaper)? > > if so can some please help me with the set-up, I can't get it working. I > used the below steps: > > 1. create jar file using maven > 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server > cassandra-reaper.yaml > 3. ./bin/spreaper repair production users > -- - Alexander Dejanovski France @alexanderdeja Consultant Apache Cassandra Consulting http://www.thelastpickle.com
Cassandra reaper
Hello, Has anyone played around with the cassandra reaper ( https://github.com/spotify/cassandra-reaper)? if so can some please help me with the set-up, I can't get it working. I used the below steps: 1. create jar file using maven 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server cassandra-reaper.yaml 3. ./bin/spreaper repair production users