Re: Cassandra listen port
Be sure, it's for. Test :))) But I just don't want to use ccm. I want to test it manually (manual configuration) for a good understanding. Thnks Vladimir --- Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 499 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com From: "Vladimir Yudovin" <vla...@winguzone.com> To: "user" <user@cassandra.apache.org> Sent: Wednesday, October 5, 2016 6:03:26 AM Subject: Re: Re: Cassandra listen port I hope it's not for production ))) Yes, you need three IP (real or aliases). There is Cassandra Cluster Manager tool for launching several C* on the same host. See also https://academy.datastax.com/getting-started-with-ccm-cassandra-cluster-manager and http://www.datastax.com/dev/blog/ccm-a-development-tool-for-creating-local-cassandra-clusters Best regards, Vladimir Yudovin, Winguzone Inc - Hosted Cloud Cassandra on Azure and SoftLayer. Launch your cluster in minutes. On Tue, 04 Oct 2016 15:36:23 -0400 Mehdi Bada <mehdi.b...@dbi-services.com> wrote I want to run a cluster (3 instances) in a single server. Configuration of my VM: - host-only adapter: static IP 192.168... - bridge adapter I create 3 environments (data dir, admin dir, conf file...) for the 3 instances. But I'm now blocked in the network configuration. I can use 1 IP address for the 3 instances? And just modify the port? If yes, which parameters I have to change? Regards Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 499 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com From: "Vladimir Yudovin" < vla...@winguzone.com > To: "user" < user@cassandra.apache.org > Sent: Tuesday, October 4, 2016 8:53:22 PM Subject: Re: Re: Cassandra listen port >Use multiple IP addresses instead. >Virtual addresses can be possible also? >eth0:0, eth0:1 Why multiple or virtual IP? You can use the same IP for both addresses, as they use different TCP ports. Sure, it's better to use internal IP (like 10... or 192.168...) for internode connect, but it's not demand. Best regards, Vladimir Yudovin, Winguzone Inc - Hosted Cloud Cassandra on Azure and SoftLayer. Launch your cluster in minutes. On Tue, 04 Oct 2016 14:51:59 -0400 Benjamin Roth < benjamin.r...@jaumo.com > wrote BQ_BEGIN Of course, just add aliases to your interfaces (like eth0:0, eth0:1, ...). For example CCM ( https://github.com/pcmanus/ccm ) uses 127.0.0.[1-255] to set up multiple CS instances on a single server. 2016-10-04 20:49 GMT+02:00 Mehdi Bada < mehdi.b...@dbi-services.com > : BQ_BEGIN Virtual addresses can be possible also? Thanks Benjamin Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team - Original Message - From: Benjamin Roth < benjamin.r...@jaumo.com > To: user@cassandra.apache.org Sent: Tue, 04 Oct 2016 20:36:49 +0200 (CEST) Subject: Re: Cassandra listen port As far as I can see, these ports are also used for outgoing connection, so a node expects all other peers also to use that port. Therefore the answer is no. Use multiple IP addresses instead. 2016-10-04 20:03 GMT+02:00 Mehdi Bada < mehdi.b...@dbi-services.com >: > Thanks Vladimir. > It means if I want to run Cassandra on multi instance environment I only > have to change the listen address of each instance and the 9000 CQL port?? > > > --- > Mehdi Bada | Consultant > Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 > dbi services, Rue de la Jeunesse 2, CH-2800 Delémont > mehdi.b...@dbi-services.com www.dbi-services.com > > ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team > > > - Original Message - > From: Vladimir Yudovin < vla...@winguzone.com > > To: user@cassandra.apache.org > Sent: Tue, 04 Oct 2016 18:18:19 +0200 (CEST) > Subject: Re: Cassandra listen port > > Actually the main port is 9042 - for client (CQL) connections and 7000 > (7001 if SSL enabled) for inter node communications. > > Best regards, Vladimir Yudovin, > Winguzone Inc - Hosted Cloud Cassandra on Azure and SoftLayer. > Launch your cluster in minutes. > > > > > On Tue, 04 Oct 2016 11:36:04 -0400 Benjamin > Rothbenjamin.r...@jaumo.com wrote > > There are several ports for several services. They are all set in > cassandra.yaml > > See here for complete d
Re: Cassandra listen port
I want to run a cluster (3 instances) in a single server. Configuration of my VM: - host-only adapter: static IP 192.168... - bridge adapter I create 3 environments (data dir, admin dir, conf file...) for the 3 instances. But I'm now blocked in the network configuration. I can use 1 IP address for the 3 instances? And just modify the port? If yes, which parameters I have to change? Regards Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 499 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com From: "Vladimir Yudovin" <vla...@winguzone.com> To: "user" <user@cassandra.apache.org> Sent: Tuesday, October 4, 2016 8:53:22 PM Subject: Re: Re: Cassandra listen port >Use multiple IP addresses instead. >Virtual addresses can be possible also? >eth0:0, eth0:1 Why multiple or virtual IP? You can use the same IP for both addresses, as they use different TCP ports. Sure, it's better to use internal IP (like 10... or 192.168...) for internode connect, but it's not demand. Best regards, Vladimir Yudovin, Winguzone Inc - Hosted Cloud Cassandra on Azure and SoftLayer. Launch your cluster in minutes. On Tue, 04 Oct 2016 14:51:59 -0400 Benjamin Roth <benjamin.r...@jaumo.com> wrote Of course, just add aliases to your interfaces (like eth0:0, eth0:1, ...). For example CCM ( https://github.com/pcmanus/ccm ) uses 127.0.0.[1-255] to set up multiple CS instances on a single server. 2016-10-04 20:49 GMT+02:00 Mehdi Bada < mehdi.b...@dbi-services.com > : BQ_BEGIN Virtual addresses can be possible also? Thanks Benjamin Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team - Original Message - From: Benjamin Roth < benjamin.r...@jaumo.com > To: user@cassandra.apache.org Sent: Tue, 04 Oct 2016 20:36:49 +0200 (CEST) Subject: Re: Cassandra listen port As far as I can see, these ports are also used for outgoing connection, so a node expects all other peers also to use that port. Therefore the answer is no. Use multiple IP addresses instead. 2016-10-04 20:03 GMT+02:00 Mehdi Bada < mehdi.b...@dbi-services.com >: > Thanks Vladimir. > It means if I want to run Cassandra on multi instance environment I only > have to change the listen address of each instance and the 9000 CQL port?? > > > --- > Mehdi Bada | Consultant > Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 > dbi services, Rue de la Jeunesse 2, CH-2800 Delémont > mehdi.b...@dbi-services.com www.dbi-services.com > > ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team > > > - Original Message - > From: Vladimir Yudovin < vla...@winguzone.com > > To: user@cassandra.apache.org > Sent: Tue, 04 Oct 2016 18:18:19 +0200 (CEST) > Subject: Re: Cassandra listen port > > Actually the main port is 9042 - for client (CQL) connections and 7000 > (7001 if SSL enabled) for inter node communications. > > Best regards, Vladimir Yudovin, > Winguzone Inc - Hosted Cloud Cassandra on Azure and SoftLayer. > Launch your cluster in minutes. > > > > > On Tue, 04 Oct 2016 11:36:04 -0400 Benjamin > Rothbenjamin.r...@jaumo.com wrote > > There are several ports for several services. They are all set in > cassandra.yaml > > See here for complete documentation: > https://docs.datastax.com/en/cassandra/2.1/cassandra/ > configuration/configCassandra_yaml_r.html > > > > 2016-10-04 16:54 GMT+02:00 Mehdi Bada & lt;mehdi.b...@dbi-services.com : > Hi all, > > > > What is the listen port parameter for Apache Cassandra? Does it exist? > > In comparison with MongoDB, in mongo it's possible to set the listen port > in the mongod.conf (configuration file) > > > > Regards > > Mehdi > > > > Mehdi Bada | Consultant > Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 > dbi services, Rue de la Jeunesse 2, CH-2800 Delémont > mehdi.b...@dbi-services.com > www.dbi-services.com > > > > > > > > > > ⇒ dbi services is recruiting Oracle SQL Server experts ! – Join the > team > > > > > > > > > > -- > Benjamin Roth > Prokurist > > Jaumo GmbH · www.jaumo.com > Wehrstraße 46 · 73035 Göppingen · Germany > Phone +49 7161 304880-6 · Fax +49 7161 304880-1 > AG Ulm · HRB 731058 · Managing Director: Jens Ka
Re: Cassandra listen port
Thanks Vladimir. It means if I want to run Cassandra on multi instance environment I only have to change the listen address of each instance and the 9000 CQL port?? --- Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team - Original Message - From: Vladimir Yudovin <vla...@winguzone.com> To: user@cassandra.apache.org Sent: Tue, 04 Oct 2016 18:18:19 +0200 (CEST) Subject: Re: Cassandra listen port Actually the main port is 9042 - for client (CQL) connections and 7000 (7001 if SSL enabled) for inter node communications. Best regards, Vladimir Yudovin, Winguzone Inc - Hosted Cloud Cassandra on Azure and SoftLayer. Launch your cluster in minutes. On Tue, 04 Oct 2016 11:36:04 -0400 Benjamin Rothbenjamin.r...@jaumo.com wrote There are several ports for several services. They are all set in cassandra.yaml See here for complete documentation: https://docs.datastax.com/en/cassandra/2.1/cassandra/configuration/configCassandra_yaml_r.html 2016-10-04 16:54 GMT+02:00 Mehdi Bada mehdi.b...@dbi-services.com: Hi all, What is the listen port parameter for Apache Cassandra? Does it exist? In comparison with MongoDB, in mongo it's possible to set the listen port in the mongod.conf (configuration file) Regards Mehdi Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle SQL Server experts ! – Join the team -- Benjamin Roth Prokurist Jaumo GmbH · www.jaumo.com Wehrstraße 46 · 73035 Göppingen · Germany Phone +49 7161 304880-6 · Fax +49 7161 304880-1 AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
Re: Cassandra listen port
Virtual addresses can be possible also? Thanks Benjamin Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team - Original Message - From: Benjamin Roth <benjamin.r...@jaumo.com> To: user@cassandra.apache.org Sent: Tue, 04 Oct 2016 20:36:49 +0200 (CEST) Subject: Re: Cassandra listen port As far as I can see, these ports are also used for outgoing connection, so a node expects all other peers also to use that port. Therefore the answer is no. Use multiple IP addresses instead. 2016-10-04 20:03 GMT+02:00 Mehdi Bada <mehdi.b...@dbi-services.com>: > Thanks Vladimir. > It means if I want to run Cassandra on multi instance environment I only > have to change the listen address of each instance and the 9000 CQL port?? > > > --- > Mehdi Bada | Consultant > Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 > dbi services, Rue de la Jeunesse 2, CH-2800 Delémont > mehdi.b...@dbi-services.com www.dbi-services.com > > ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team > > > - Original Message - > From: Vladimir Yudovin <vla...@winguzone.com> > To: user@cassandra.apache.org > Sent: Tue, 04 Oct 2016 18:18:19 +0200 (CEST) > Subject: Re: Cassandra listen port > > Actually the main port is 9042 - for client (CQL) connections and 7000 > (7001 if SSL enabled) for inter node communications. > > Best regards, Vladimir Yudovin, > Winguzone Inc - Hosted Cloud Cassandra on Azure and SoftLayer. > Launch your cluster in minutes. > > > > > On Tue, 04 Oct 2016 11:36:04 -0400 Benjamin > Rothbenjamin.r...@jaumo.com wrote > > There are several ports for several services. They are all set in > cassandra.yaml > > See here for complete documentation: > https://docs.datastax.com/en/cassandra/2.1/cassandra/ > configuration/configCassandra_yaml_r.html > > > > 2016-10-04 16:54 GMT+02:00 Mehdi Bada mehdi.b...@dbi-services.com: > Hi all, > > > > What is the listen port parameter for Apache Cassandra? Does it exist? > > In comparison with MongoDB, in mongo it's possible to set the listen port > in the mongod.conf (configuration file) > > > > Regards > > Mehdi > > > > Mehdi Bada | Consultant > Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 > dbi services, Rue de la Jeunesse 2, CH-2800 Delémont > mehdi.b...@dbi-services.com > www.dbi-services.com > > > > > > > > > > ⇒ dbi services is recruiting Oracle SQL Server experts ! – Join the > team > > > > > > > > > > -- > Benjamin Roth > Prokurist > > Jaumo GmbH · www.jaumo.com > Wehrstraße 46 · 73035 Göppingen · Germany > Phone +49 7161 304880-6 · Fax +49 7161 304880-1 > AG Ulm · HRB 731058 · Managing Director: Jens Kammerer > > > > > > > > > -- Benjamin Roth Prokurist Jaumo GmbH · www.jaumo.com Wehrstraße 46 · 73035 Göppingen · Germany Phone +49 7161 304880-6 · Fax +49 7161 304880-1 AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
Re: Cassandra data model right definition
Hi all, Just to refocus the debat (because I'm the at the origin of this very interesting exchanges). I think for a good understanding of the data model of any DMBS, we have (technical experts) to decompose the data objects of the model and understand how the data is precisely stored and what kind of mechanisms is used. In this way, I think, Russell has describe very well the situation, and we can said that Apache Cassandra data model can be defined as a Partitioned Row Store . Many thanks for your all feedbacks and contribution Best Regards Mehdi Bada --- Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 499 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com From: "Edward Capriolo" <edlinuxg...@gmail.com> To: "user" <user@cassandra.apache.org> Sent: Monday, October 3, 2016 4:53:16 PM Subject: Re: Cassandra data model right definition My original point can be summed up as: Do not define cassandra in terms SMILES & METAPHORS. Such words include "like" and "close relative". For the specifics: Any relational db could (and I'm sure one does!) allow for sparse fields as well. MySQL can be backed by rocksdb now, does that make it not a row store? Lets draw some lines, a relational database is clearly defined. https://en.wikipedia.org/wiki/Edgar_F._Codd Codd's theorem , a result proven in his seminal work on the relational model, equates the expressive power of relational algebra and relational calculus (both of which, lacking recursion, are strictly less powerful than first-order logic ). [ citation needed ] As the relational model started to become fashionable in the early 1980s, Codd fought a sometimes bitter campaign to prevent the term being misused by database vendors who had merely added a relational veneer to older technology. As part of this campaign, he published his 12 rules to define what constituted a relational database. This made his position in IBM increasingly difficult, so he left to form his own consulting company with Chris Date and others. Cassandra is not a relational database. I am have attempted to illustrate that a "row store" is defined as well. I do not believe Cassandra is a "row store". " Just because it uses log structured storage, sparse fields, and semi-flexible collections doesn't disqualify it from calling it a "row store"" What is the definition of "row store". Is it a logical construct or a physical one? Why isn't mongo DB a "row store"? I can drop a schema on top of mongo and present it as rows and columns. It seems to pass the litmus test being presented. https://github.com/mongodb/mongo-hadoop/wiki/Hive-Usage On Mon, Oct 3, 2016 at 10:02 AM, Jonathan Haddad < j...@jonhaddad.com > wrote: Sorry Ed, but you're really stretching here. A table in Cassandra is structured by a schema with the data for each row stored together in each data file. Just because it uses log structured storage, sparse fields, and semi-flexible collections doesn't disqualify it from calling it a "row store" Postgres added flexible storage through hstore, I don't hear anyone arguing that it needs to be renamed. Any relational db could (and I'm sure one does!) allow for sparse fields as well. MySQL can be backed by rocksdb now, does that make it not a row store? You're arguing that everything is wrong but you're not proposing an alternative, which is not productive. On Mon, Oct 3, 2016 at 9:40 AM Edward Capriolo < edlinuxg...@gmail.com > wrote: BQ_BEGIN Also every piece of techincal information that describes a rowstore http://cs-www.cs.yale.edu/homes/dna/talks/abadi-sigmod08-slides.pdf https://en.wikipedia.org/wiki/Column-oriented_DBMS#Row-oriented_systems Does it like this: 001:10,Smith,Joe,4; 002:12,Jones,Mary,5; 003:11,Johnson,Cathy,44000; 004:22,Jones,Bob,55000; The never depict a scenario where a the data looks like this on disk: 001:10,Smith 001:10,4; Which is much closer to how Cassandra stores it's data. On Fri, Sep 30, 2016 at 5:12 PM, Benedict Elliott Smith < bened...@apache.org > wrote: BQ_BEGIN Absolutely. A "partitioned row store" is exactly what I would call it. As it happens, our README thinks the same, which is fantastic. I thought I'd take a look at the rest of our cohort, and didn't get far before disappointment. HBase literally calls itself a " column-oriented store" - which is so totally wrong it's simultaneously hilarious and tragic. I guess we can't blame the wider internet for misunderstanding/misnaming us poor "wide column stores" if even one of the major examples doesn't know what it, itself, is! On 30 September 2016 at 21:47, Jonathan Haddad < j...@jonhaddad.com
Cassandra listen port
Hi all, What is the listen port parameter for Apache Cassandra? Does it exist? In comparison with MongoDB, in mongo it's possible to set the listen port in the mongod.conf (configuration file) Regards Mehdi Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team
data file directory path customization
Hi all, With the new apache cassandra 3.7 version, It is possible to setup a customizable path for data_files, saved_caches and commit_log in the configuration file (cassandra.yaml)? I ask the question because during some test, I wanted to setup the path for : - data_files_directories - commitlog_directory - saved_caches_directory After configuring this 3 variables (parameters) in the cassandra-yaml, I had the following issues: [cassandra@test bin]$ ./cassandra -f 18:54:22.443 [main] INFO o.a.c.config.YamlConfigurationLoader - Configuration location: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml 18:54:22.447 [main] DEBUG o.a.c.config.YamlConfigurationLoader - Loading settings from file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: Invalid yaml: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Error: while parsing a block mapping; expected , but found BlockMappingStart; in 'reader', line 188, column 2: data_file_directories: ^ 18:59:30.554 [main] INFO o.a.c.config.YamlConfigurationLoader - Configuration location: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml 18:59:30.558 [main] DEBUG o.a.c.config.YamlConfigurationLoader - Loading settings from file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: Invalid yaml: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Error: while parsing a block mapping; expected , but found BlockMappingStart; in 'reader', line 194, column 2: commitlog_directory: /u01/cassan .. . ^ *** The first issue was for the data_files_directories, after that I commented it out in the cassandra.yaml, and I had the same issue for the commitlog_directory parameter. Below the setting of my 2 variables: *** data_file_directories: - /u01/cassandradata/CSD1/data . commitlog_directory: /u01/cassandradata/CSD1/commitlog *** I also tested the syntax with double quote " " -> Same issue Many thanks in advance for your feedback Best Regards Mehdi Bada ---- Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team
Re: data file directory path customization
Hi Alain, Thank you for your feedback, the problem was the space character before the data_files_directories parameter. As you said the the YAML is very case sensitive. Many thanks for your feedback and have a nice day. Regards --- Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 499 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com From: "Alain RODRIGUEZ" <arodr...@gmail.com> To: "user" <user@cassandra.apache.org> Sent: Friday, September 23, 2016 12:06:09 PM Subject: Re: data file directory path customization Hi Mehdi, After configuring this 3 variables (parameters) in the cassandra-yaml, I had the following issues BQ_BEGIN With the new apache cassandra 3.7 version, It is possible to setup a customizable path for data_files, saved_caches and commit_log in the configuration file (cassandra.yaml)? BQ_END According to the configuration, parameters you're using are still valid in 3.7: https://github.com/apache/cassandra/blob/cassandra-3.7/conf/cassandra.yaml#L184-L194 . BQ_BEGIN Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: Invalid yaml: BQ_END If I had to guess, I would say you have an indentation issue. When you uncommented those properties, did you remove "#" - 1 character - or "# " - 2 characters - including the space? If I remember correctly, YAML is sensitive to this kind of stuff. I would try that or some other similar tool in case of doubts: http://www.yamllint.com/ C*heers, --- Alain Rodriguez - @arodream - al...@thelastpickle.com France The Last Pickle - Apache Cassandra Consulting http://www.thelastpickle.com 2016-09-23 9:58 GMT+02:00 Mehdi Bada < mehdi.b...@dbi-services.com > : BQ_BEGIN Hi all, With the new apache cassandra 3.7 version, It is possible to setup a customizable path for data_files, saved_caches and commit_log in the configuration file (cassandra.yaml)? I ask the question because during some test, I wanted to setup the path for : - data_files_directories - commitlog_directory - saved_caches_directory After configuring this 3 variables (parameters) in the cassandra-yaml, I had the following issues: [cassandra@test bin]$ ./cassandra -f 18:54:22.443 [main] INFO o.a.c.config.YamlConfigurationLoader - Configuration location: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml 18:54:22.447 [main] DEBUG o.a.c.config.YamlConfigurationLoader - Loading settings from file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: Invalid yaml: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Error: while parsing a block mapping; expected , but found BlockMappingStart; in 'reader', line 188, column 2: data_file_directories: ^ 18:59:30.554 [main] INFO o.a.c.config.YamlConfigurationLoader - Configuration location: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml 18:59:30.558 [main] DEBUG o.a.c.config.YamlConfigurationLoader - Loading settings from file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: Invalid yaml: file:/u00/app/cassandra/admin/CSD1/etc/cassandra.yaml Error: while parsing a block mapping; expected , but found BlockMappingStart; in 'reader', line 194, column 2: commitlog_directory: /u01/cassan .. . ^ *** The first issue was for the data_files_directories, after that I commented it out in the cassandra.yaml, and I had the same issue for the commitlog_directory parameter. Below the setting of my 2 variables: *** data_file_directories: - /u01/cassandradata/CSD1/data . commitlog_directory: /u01/cassandradata/CSD1/commitlog *** I also tested the syntax with double quote " " -> Same issue Many thanks in advance for your feedback Best Regards Mehdi Bada Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team BQ_END
Cassandra data model right definition
Hi all, I have a theoritical question: - Is Apache Cassandra really a column store? Column store mean storing the data as column rather than as a rows. In fact C* store the data as row, and data is partionned with row key. Finally, for me, Cassandra is a row oriented schema less DBMS Is it true for you also??? Many thanks in advance for your reply Best Regards Mehdi Bada Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team
Re: Cassandra installation best practices
Hi Brooke, Thank you for your advices. Finally, no technical standards (provided by DataStax or Apache) exists for deploying Cassandra in a production environment? In comparison with some RDBMS (Oracle, MySQL), some standards (OFA for instance) exists and are provided by Oracle. Best regards Mehdi --- Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 499 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com From: "Brooke Jensen" <bro...@instaclustr.com> To: "user" <user@cassandra.apache.org> Sent: Tuesday, October 18, 2016 8:59:14 AM Subject: Re: Cassandra installation best practices Hi Mehdi, In addition, give some thought to your cluster topology. For maximum fault tolerance and availability I would recommend using at least three nodes with a replication factor of three. Ideally, you should also use Cassandra logical racks. This will reduce the risk of outage and make ongoing management of the cluster a lot easier. Brooke Jensen VP Technical Operations & Customer Services www.instaclustr.com | support.instaclustr.com This email has been sent on behalf of Instaclustr Limited (Australia) and Instaclustr Inc (USA). This email and any attachments may contain confidential and legally privileged information. If you are not the intended recipient, do not copy or disclose its content, but please reply to this email immediately and highlight the error to the sender and then immediately delete the message. On 18 October 2016 at 04:02, Anuj Wadehra < anujw_2...@yahoo.co.in > wrote: Hi Mehdi, You can refer https://docs.datastax.com/en/landing_page/doc/landing_page/recommendedSettings.html . Thanks Anuj On Mon, 17 Oct, 2016 at 10:20 PM, Mehdi Bada BQ_BEGIN < mehdi.b...@dbi-services.com > wrote: Hi all, It is exist some best practices when installing Cassandra on production environment? Some standard to follow? For instance, the file system type etc.. BQ_END
unscribe
unscribe Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team
Cassandra installation best practices
Hi all, It is exist some best practices when installing Cassandra on production environment? Some standard to follow? For instance, the file system type etc..
Cassandra Cluster issues
Dear Cassandra Users, I have some issues since few days with the following cluster: - 5 nodes - Cassandra 3.7 - 2 seed nodes - 1 keyspace with RF=2, 300Go / nodes, WRITE_LEVEL=ONE, READ_LEVEL=ONE - 1 enormous table (90% of the keyspace) - TTL for each line insered The cluster is write oriented. All machines are consuming between 5 - 10 % of the CPU and 45 % of RAM. The cluster is very slow since the last repair, not all writes have been done... I don't know how to start the debbuging of my cluster. Do you have any ideas ? Many thanks in advance Regards Mehdi Bada Mehdi Bada | Consultant Phone: +41 32 422 96 00 | Mobile: +41 79 928 75 48 | Fax: +41 32 422 96 15 dbi services, Rue de la Jeunesse 2, CH-2800 Delémont mehdi.b...@dbi-services.com www.dbi-services.com ⇒ dbi services is recruiting Oracle & SQL Server experts ! – Join the team
