Re: Call for participation: Issue triaging and PR review/testing

[Ivan Kudryavtsev]

Hello, devs, users, Rohit. Have a good day.

Rohit, you intend to freeze 4.11 on 8 january and, frankly speaking, I see
risks here. A major risk is that 4.10 is too buggy and it seems nobody uses
it actually right now in production because it's unusable, unfortunately,
so we are planning to freeze 4.11 which stands on untested 4.10 with a lot
of lacks still undiscovered and not reported. I believe it's a very
dangerous way to release one more release with bad quality. Actually,
marvin and units don't cover regressions I meet in 4.10. Ok, let's take a
look at new one our engineers found today in 4.10:

It happens rarely for Domain Admin, probably other roles are affected. We
meet it once a week. It's for resource accounting. Domain admin resource
quota is 200GB of primary storage. During continouos creation of VMs and
removing them it leads to "Maximum number of resources of type
'primary_storage' for domain id=2 has been exceeded", however only 26 GB is
used actually.

I mean smoke tests run well, unit tests run well, but *nobody reported very
obvious bug* which should be met number of times if community use 4.10. I
suppose, there are a lot of undiscovered and unreported regressions in 4.10
and this is a huge risk to the 4.11 release quality and more we move that
way quality decreases. Unfortunately, I'm not able to propose a silver
bullet, but I suppose feature development speed should be decreased until
master is tested very thoroughly and might be 8 january is too early for
4.11 freeze.



2017-12-09 2:00 GMT+07:00 Wido den Hollander :

>
>
> On 12/08/2017 03:24 PM, Rohit Yadav wrote:
>
>> All,
>>
>> Given we've about a month left until 4.11/LTS freeze date of 8th Jan 2018
>> [1], I would like to call our community for active participation.
>>
>> Given a huge pile of open issues, please share on this thread a 'brief'
>> list of top bugs/issues that you would want to see fixed and are
>> applicable
>> to master branch, especially critical/blocker issues and regressions. I
>> would especially like to engage with the users of the community towards
>> this effort. I'll start weekly reporting of open issues by end of next
>> week.
>>
>> Developers - feel free to comment tagging Daan (@DaanHoogland), Paul
>> (@PaulAngus) and me (@rhtyd) in your pull requests if you're seeking
>> review
>> and testing (and merging) of your PR. I hope to work with you all with my
>> committer/contributor hat on.
>>
>> Finally, I look forward to all of your help and support towards the next
>> (LTS) release.
>>
>>
> Let's make it work!
>
> Thoughts, comments?
>>
>>
> With the holiday season coming up we might see things slow down a bit. But
> I think we already have enough PRs open for 4.11
>
> We should be able to get out a proper release again.
>
> Wido
>
>
> [1] http://markmail.org/message/mszlluye35acvn2j
>>
>> Regards,
>> Rohit Yadav
>> http://rohityadav.cloud | @rhtyd
>>
>>__?.o/   Apache CloudStack
>>   ()# The best of CloudStack is yet to come!
>> (___(_)   https://cloudstack.apache.org
>>
>>


-- 
With best regards, Ivan Kudryavtsev
Bitworks Software, Ltd.
Cell: +7-923-414-1515
WWW: http://bitworks.software/ 

CloudStack test result processing

[Paul Angus]

Hi Fellow CloudStack Community Denizens

Do we have any Kibana Gurus out there?
I'm getting results from Marvin tests runs sent to an Elasticsearch database, 
and I'm in need of help figuring out how to process that data in Kibana to get 
useful/meaningful data out.

Anyone with the knowledge and time to help me out, please ping me.

Many thanks

Paul Angus


paul.an...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: MySQL HA

[Rafael Weingärtner]

Alireza,
This is a warning and should not cause you much trouble. I have been trying
to pin point this problem for quite some time now.
If I generate a fix, would you be willing to test it?

On Tue, Dec 12, 2017 at 8:56 AM, Gabriel Beims Bräscher <
gabrasc...@gmail.com> wrote:

> Hi Alireza,
>
> I have production environments with Master to Master replication and
> we have no problems. We may need more details of your configuration.
> Have you configured the slave database? Are you sure that you configured
> correctly the ha heuristic?
>
> Considering that you already configured replication and "my.cnf", I will
> focus on the CloudSack db.properties file.
>
> When configuring Master-Master replication, you should have at
> /etc/cloudstack/management/db.properties something like:
> -
> db.cloud.autoReconnectForPools=true
>
> #High Availability And Cluster Properties
> db.ha.enabled=true
>
> db.cloud.queriesBeforeRetryMaster=5000
> db.usage.failOverReadOnly=false
> db.cloud.slaves=acs-db-02
>
> cluster.node.IP=
>
> db.usage.autoReconnect=true
>
> db.cloud.host=acs-db-01
> db.usage.host=acs-db-01
>
> #db.ha.loadBalanceStrategy=com.mysql.jdbc.SequentialBalanceStrategy
> db.ha.loadBalanceStrategy=com.cloud.utils.db.StaticStrategy
>
> db.cloud.failOverReadOnly=false
> db.usage.slaves=acs-db-02
> -
>
> "db.ha.loadBalanceStrategy" is confiugured with the heuristic
> "com.cloud.utils.db.StaticStrategy"
>
> "db.ha.enabled" need to be “true”
>
> The primary database is configured with the variable “db.cloud.host”. The
> secondary database(s) is(are) configured with the variable
> “db.usage.slaves”. One variable that is different from both Apache
> CloudStack servers is “cluster.node.IP”, being the ACS mgt IP.
> Additionally, you will need to create a folder
> “/usr/share/cloudstack-mysql-ha/lib/” and move the jar file
> “cloud-plugin-database-mysqlha-4.9.3.0.jar” into the new folder.
>
> -
> mkdir -p /usr/share/cloudstack-mysql-ha/lib/
> cp
> /usr/share/cloudstack-management/webapps/client/WEB-
> INF/lib/cloud-plugin-database-mysqlha-4.9.3.0.jar
> /usr/share/cloudstack-mysql-ha/lib/
> -
>
> Cheers,
> Gabriel.
>
> 2017-12-12 6:30 GMT-02:00 Alireza Eskandari :
>
> > I have opened a new jira ticket about this problem:
> > https://issues.apache.org/jira/browse/CLOUDSTACK-10186
> >
>



-- 
Rafael Weingärtner

Re: MySQL HA

[Gabriel Beims Bräscher]

Hi Alireza,

I have production environments with Master to Master replication and
we have no problems. We may need more details of your configuration.
Have you configured the slave database? Are you sure that you configured
correctly the ha heuristic?

Considering that you already configured replication and "my.cnf", I will
focus on the CloudSack db.properties file.

When configuring Master-Master replication, you should have at
/etc/cloudstack/management/db.properties something like:
-
db.cloud.autoReconnectForPools=true

#High Availability And Cluster Properties
db.ha.enabled=true

db.cloud.queriesBeforeRetryMaster=5000
db.usage.failOverReadOnly=false
db.cloud.slaves=acs-db-02

cluster.node.IP=

db.usage.autoReconnect=true

db.cloud.host=acs-db-01
db.usage.host=acs-db-01

#db.ha.loadBalanceStrategy=com.mysql.jdbc.SequentialBalanceStrategy
db.ha.loadBalanceStrategy=com.cloud.utils.db.StaticStrategy

db.cloud.failOverReadOnly=false
db.usage.slaves=acs-db-02
-

"db.ha.loadBalanceStrategy" is confiugured with the heuristic
"com.cloud.utils.db.StaticStrategy"

"db.ha.enabled" need to be “true”

The primary database is configured with the variable “db.cloud.host”. The
secondary database(s) is(are) configured with the variable
“db.usage.slaves”. One variable that is different from both Apache
CloudStack servers is “cluster.node.IP”, being the ACS mgt IP.
Additionally, you will need to create a folder
“/usr/share/cloudstack-mysql-ha/lib/” and move the jar file
“cloud-plugin-database-mysqlha-4.9.3.0.jar” into the new folder.

-
mkdir -p /usr/share/cloudstack-mysql-ha/lib/
cp
/usr/share/cloudstack-management/webapps/client/WEB-INF/lib/cloud-plugin-database-mysqlha-4.9.3.0.jar
/usr/share/cloudstack-mysql-ha/lib/
-

Cheers,
Gabriel.

2017-12-12 6:30 GMT-02:00 Alireza Eskandari :

> I have opened a new jira ticket about this problem:
> https://issues.apache.org/jira/browse/CLOUDSTACK-10186
>

Re: MySQL HA

[Alireza Eskandari]

I have opened a new jira ticket about this problem:
https://issues.apache.org/jira/browse/CLOUDSTACK-10186