Re: [openstack-dev] [all]-ish : Updates required for readthedocs publishers

2018-09-06 Thread Ilya Shakhat
What is the process once webhook_id is added to project's zuul.yaml? Should I propose a change into project-config/zuul.d/projects.yaml or it will be done automatically? BTW (not completely related to this topic, but since I'm touching zuul.yaml anyway) - what are the best practices for

[openstack-dev] [DriverLog] DriverLog future

2018-03-01 Thread Ilya Shakhat
Hi! For those who do not know, DriverLog is a community registry of 3rd-party drivers for OpenStack hosted together with Stackalytics [1]. The project started 4 years ago and by now contains information about 220 drivers. The data from DriverLog is also consumed by official Marketplace [2]. Here

Re: [openstack-dev] Pike release update on driverlog/etc/default_data.json

2017-09-06 Thread Ilya Shakhat
Hi Sumit, It's just been done in https://review.openstack.org/#/c/500670/3 ("Update Dell EMC drivers info"). Best regards, Ilya 2017-09-06 10:43 GMT+02:00 Shatwara, Sumit : > Hi Team, > > > > When will the details related to Pike release be added in “releases” > section

Re: [openstack-dev] [QA][LCOO] MEX-ops-meetup: OpenStack Extreme Testing

2017-08-14 Thread Ilya Shakhat
/performance-docs/latest/test_plans/reliability/version_2/plan.html#reliability-testing-version-2 * example of report: https://docs.openstack.org/performance-docs/latest/test_results/reliability/version_2/reports/neutron/create_and_l

Re: [openstack-dev] [oslo][performance] Proposing tail-based sampling in OSProfiler

2017-08-04 Thread Ilya Shakhat
tps://www.elastic.co/guide/en/logstash/current/plugins-inputs-udp.html [2] https://www.elastic.co/guide/en/beats/libbeat/current/beats-reference.html Best regards, Ilya Shakhat 2017-08-04 4:04 GMT+02:00 vin...@vn.fujitsu.com <vin...@vn.fujitsu.com>: > Hi Rajul, > > > > For the `agent i

Re: [openstack-dev] [FEMDC][MassivelyDistributed] Strawman proposal for message bus analysis

2017-06-21 Thread Ilya Shakhat
Hi Ken, Please check scenarios and reports that exist in Performance Docs. In particular you may be interested in: * O.M.Simulator - https://github.com/openstack/oslo.messaging/blob/master/tools/simulator.py * MQ performance scenario -

Re: [openstack-dev] [Shaker] Shaker Image Builder fails in Ocata due to OS::Glance::Image deprecation

2017-03-03 Thread Ilya Shakhat
is not available. The behavior can also be enforced by --image-builder-mode parameter. Thanks, Ilya 2017-02-03 13:16 GMT+04:00 Ilya Shakhat <ishak...@mirantis.com>: > Starting Ocata, looks like only glance v2 is enabled by default. This >> breaks the shaker image builder templat

Re: [openstack-dev] [karbor][stackalytics] Karbor Missing Commits in Stackalytics

2017-02-09 Thread Ilya Shakhat
Sure, I'll take a look at this. --Ilya 2017-02-09 13:47 GMT+04:00 Zhenguo Niu : > After the rename of Nimble to Mogan, all git-related stats are lost as > well. > > http://stackalytics.com/?metric=commits_type=opensta > ck-others=mogan > > Ilya, Can you please assist with

Re: [openstack-dev] [Shaker] Shaker Image Builder fails in Ocata due to OS::Glance::Image deprecation

2017-02-03 Thread Ilya Shakhat
> > Starting Ocata, looks like only glance v2 is enabled by default. This > breaks the shaker image builder template since we make use of the resource > type OS::Glance::Image and creating images from url links is not > supported in v2. How do we want deal with this? Maybe have the user pass in >

Re: [openstack-dev] [Performance][Shaker]

2017-01-23 Thread Ilya Shakhat
Hi Sai, In UDP testing PPS represents packets sent by iperf client to server. Loss is the percentage of packets that were not received by server (more specifically the server tracks packets and sums gaps between of them, https://github.com/esnet/iperf/blob/3.0.7/src/iperf_udp.c#L64). While

Re: [openstack-dev] [Performance][shaker] Triangular topology

2016-12-06 Thread Ilya Shakhat
gt; Matt > > ps : I just realized that I missed a proper subjet to the thread :(. > If this thread continue it's maybe better to change that. > > - Mail original - > > De: "Ilya Shakhat" <ishak...@mirantis.com> > > À: "OpenStack Development Mailing

Re: [openstack-dev] [stackalytics][neutron] some big tent projects included into 'Neutron Official'

2016-11-28 Thread Ilya Shakhat
Hi Ihar, This sounds like a bug - the contents of official group should be in sync with the governance repo. I'll take a look what went wrong with it. Thanks, Ilya 2016-11-26 2:28 GMT+03:00 Ihar Hrachyshka : > Hi all, > > I am looking at

Re: [openstack-dev] [Performance][shaker]

2016-11-24 Thread Ilya Shakhat
Hi Matt, Out of the box Shaker doesn't support such topology. It shouldn't be hard to implement though. Let me check what needs to be done. Thanks, Ilya 2016-11-24 13:49 GMT+03:00 Matthieu Simonin : > Hello, > > I'm looking to shaker capabilities and I'm wondering if

[openstack-dev] [QA][os-faults] OpenStack destructive and reliability testing announcement

2016-10-21 Thread Ilya Shakhat
Hello, A while ago we've introduced a new library called os-faults [1]. The main purpose of the library is to provide a unified API to perform different destructive actions in OpenStack cloud. The library can do service-related operations (e.g. kill particular service) and node-related (e.g.

Re: [openstack-dev] [stackalytics]

2016-09-29 Thread Ilya Shakhat
Roman, There are certainly exist a bug in stackalytics [1]. Current contribution > to different openstack/* projects was counted for deb-* . Now all affected > commit records on stackalytics are removed from deb-* projects, but they > should be moved to proper non-deb projects. Is there any one

Re: [openstack-dev] [stackalytics] [deb] [packaging] OpenStack contribution stats skewed by deb-* projects

2016-09-21 Thread Ilya Shakhat
2016-09-21 14:37 GMT+03:00 Thierry Carrez <thie...@openstack.org>: > Ilya Shakhat wrote: > > Hi, > > > > tldr; Commits stats are significantly skewed by deb-* projects > > (http://stackalytics.com/?metric=commits=packaging-deb-group) > > > > B

[openstack-dev] [stackalytics] [deb] [packaging] OpenStack contribution stats skewed by deb-* projects

2016-09-20 Thread Ilya Shakhat
Hi, tldr; Commits stats are significantly skewed by deb-* projects ( http://stackalytics.com/?metric=commits=packaging-deb-group) By default Stackalytics processes commits from project's master branch. For some "old core" projects there is configuration to process stable branches as well. If

Re: [openstack-dev] Cloud Reliability and Resilience for OpenStack (Fault Injection, Chaos Engineering, and Google SRE)

2016-09-01 Thread Ilya Shakhat
Hi Jorge, Reliability testing automation is the thing that OpenStack Performance team [1] is working right now. The whole solution will consist of: * Fault injection library os-failures [2] that provides an API to do different kind of faults on different OpenStack clouds. The lib is currently

Re: [openstack-dev] [stackalytics] Proposal for some code/feature changes

2016-04-12 Thread Ilya Shakhat
Hi Nikhil, 2016-04-12 5:59 GMT+03:00 Nikhil Komawar : > Hello, > > I was hoping to make some changes to the stackalytics dashboard > specifically of this type [1] following my requested suggestions here > [2]; possibly add a few extra columns for +0s and just Bot +1s. I

Re: [openstack-dev] [i18n][stackalytics] Translations metrics

2016-02-26 Thread Ilya Shakhat
2016-02-25 13:42 GMT+03:00 Ying Chun Guo : > Is it possible to link two IDs with email ? > > The link is possible by adding user profile into Stackalytics default_data.json. The patch needs to be similar to https://review.openstack.org/#/c/284638/1/etc/default_data.json.

Re: [openstack-dev] [i18n][stackalytics] Translations metrics

2016-02-25 Thread Ilya Shakhat
Hi Shu, Thanks for bringing attention to this. The reason is that Stackalytics tries to match Zanata id with LP id, and expects both to be the same. But if they are different (or point to different people) then a static profile should help. I will add the one for you soon. Best regards, Ilya

Re: [openstack-dev] [infra][stackalytics] some projects not visible in stackalytics now

2016-01-11 Thread Ilya Shakhat
;Unofficial". Will be renamed soon: https://review.openstack.org/#/c/265741/ Thanks, Ilya Shakhat > -- > Thierry Carrez (ttx) > > __ > OpenStack Development Mailing List (not for usage ques

Re: [openstack-dev] [OpenStack-Infra] [infra][stackalytics] some projects not visible in stackalytics now

2016-01-11 Thread Ilya Shakhat
Hi everyone! It appears that Stackalytics host is banned by review.openstack.org. It gets "Received disconnect from 2001:4800:7818:102:be76:4eff:fe05:9b12: 7: Too many concurrent connections" while attempting to execute "gerrit" command. As consequence Stackalytics fails to retrieve list of

Re: [openstack-dev] [all] how to add/list drivers @ https://www.openstack.org/marketplace/drivers/

2015-11-25 Thread Ilya Shakhat
Community-maintained list of drivers exists within the project DriverLog. The UI is available at http://stackalytics.com/report/driverlog , it has all options to filter the data. Thanks, Ilya 2015-11-25 11:48 GMT+03:00 Mohan Kumar : > Hi Team, > > In the following

Re: [openstack-dev] [stackalytics] [metrics] Review metrics: average numbers

2015-11-12 Thread Ilya Shakhat
Hi Mike, > Do I understand right, that average numbers > > here are calculated out of open reviews, not total number of reviews? Average numbers are calculated for reviews within the group. But I'd expect them to be "time since the last vote", not "time when patch proposed" as they do now. >

Re: [openstack-dev] [release][stackalytics] possibly breaking bug closing statistics?

2015-11-11 Thread Ilya Shakhat
2015-11-11 16:38 GMT+03:00 Thierry Carrez : > > date_fix_committed is probably not set if we directly switch the bug to > "Fix released", and that is what we plan to do now with Launchpad bugs. > > We might therefore need a backward-compatible patch to Stackalytics so >

Re: [openstack-dev] [release][stackalytics] possibly breaking bug closing statistics?

2015-11-10 Thread Ilya Shakhat
Doug, You are right, there should not be any changes in the stats. Bugs are mapped to release only by date, target milestone is not taken into account. For resolved bugs metric Stackalytics uses 'date_fix_commited' field, for filed bugs metric - 'date_created'. Thanks, Ilya 2015-11-10 0:53

[openstack-dev] Stackalytics 0.9: new features and improvements

2015-10-23 Thread Ilya Shakhat
Hi all, During the last month we've made a number of changes and improvements in Stackalytics that deserve version tag and special announcement. The most important feature is tracking history of official projects list - highly demanded after shift to 'big tent' model. The full list of changes

Re: [openstack-dev] [stackalytics] Broken stats after project rename

2015-09-30 Thread Ilya Shakhat
Hi Jesse, Thanks for letting know. Stackalytics team will fix the issue during the day. --Ilya 2015-09-30 12:19 GMT+03:00 Jesse Pretorius : > Hi everyone, > > After the rename of os-ansible-deployment to openstack-ansible it appears > that all git-related stats (eg:

Re: [openstack-dev] [Stackalytics] Complementary projects

2015-06-19 Thread Ilya Shakhat
Some reasons of having complementary projects in Stackalytics: * to compare efforts in other communities with OpenStack - just to feed curiosity on what is larger OpenStack or Kubernetes? * to light interest to contribute to projects that OpenStack depends on, like OVS and Ansible. * to keep an

[openstack-dev] [Neutron] Data-plane performance testing with Shaker

2015-05-14 Thread Ilya Shakhat
Hi all! Let me introduce you Shaker - a tool for data-plane performance testing in OpenStack. The motivation behind it is to have a simple way for measuring networking bandwidth between instances. Shaker key features are: 1. *User-defined topology*. The topology is specified as Heat template,

Re: [openstack-dev] [Fuel] Logstash and grok patterns

2015-03-10 Thread Ilya Shakhat
Hi, Here are some suggestions from my experience: 1. Input patterns could be simplified by * matches, e.g.: file { path = [ /var/log/remote/*.domain.tld/neutron* ] exclude = *.gz } 2. Logs could be parsed by the following pattern: grok { patterns_dir = patterns match = {

Re: [openstack-dev] EOL and Stable Contributions (was Juno is flubber at the gate)

2015-02-10 Thread Ilya Shakhat
Secondly, it's difficult to get stack-analytics credit for back ports, as the preferred method is to cherry pick the code, and that keeps the original author's name. I've personally gotten a few commits into stable, but have nothing to show for it in stack-analytics (if I'm doing it

[openstack-dev] [Rally] Load testing of dependent resources

2014-09-18 Thread Ilya Shakhat
Ralliers, I'd like to share with you an idea on how to test dependent resources. Let's consider the following example: there is a network and ports belonging to it and we would like to test port creation process. Currently I see 2 options of writing scenario: a) The scenario creates network and

Re: [openstack-dev] [all] 3rd Party CI vs. Gerrit

2014-06-30 Thread Ilya Shakhat
2014-06-30 19:17 GMT+04:00 Kurt Taylor krtay...@us.ibm.com: Dan Smith d...@danplanet.com wrote on 06/27/2014 12:33:48 PM: If it really does show up right in Gerrit as if it were integrated, then that would be fine with me. I think the biggest problem we have right now is that a lot of the

[openstack-dev] [neutron] [third-party] Neutron 3rd Party CI status dashboard

2014-06-29 Thread Ilya Shakhat
Hi! During last couple weeks there is an increasing demand on tracking 3rd-party CI statuses. We at Stackalytics decided to be in trend and (with some inspiration from Salvatore's proposal) implemented report that shows summary on external CI status. The initial version is available for Neutron -

Re: [openstack-dev] [neutron] [third-party] Current status of Neutron 3rd Party CI and how to move forward

2014-06-16 Thread Ilya Shakhat
However, it would be great if we could start devising a solution for having health reports from the various CI systems. This report should report the following kind of information: - timestamp of last run - timestamp of last vote (a system might start job which then get aborted for

Re: [openstack-dev] [metrics] How to group activity in git/gerrit repositories

2014-06-16 Thread Ilya Shakhat
Let me explain how Stackalytics grouping works. Most of groups are created from the official programs http://programs.yaml .yaml. Every program turns into item in the module list (colored in violet), for example 'Nova Compute' is a group containing 'nova', 'python-novaclient' and 'nova-specs'.

Re: [openstack-dev] [DriverLog] What to fix and when

2014-06-11 Thread Ilya Shakhat
Anita, I put the meeting on my schedule. Jay, can you be a back-up person? Thanks, Ilya 2014-06-10 22:18 GMT+04:00 Anita Kuno ante...@anteaya.info: On 06/10/2014 01:58 PM, Jay Pipes wrote: Stackers, OK, we are fully aware that there are problems with the early DriverLog data that is

Re: [openstack-dev] [neutron] [driverlog] Tail-f CI and it's lack of running and it's DriverLog status

2014-06-10 Thread Ilya Shakhat
Hi! Tail-f driver seems to be configured correctly. DriverLog will poll Gerrit in the next 4 hours and update driver details screen. Regarding green mark on summary screen - it is shown for those drivers that have configured CI and CI ran at least once. But it doesn't take into account when the

Re: [openstack-dev] [DriverLog][nova][neutron][cinder] Call for vendor participation please

2014-05-07 Thread Ilya Shakhat
Hi Akihiro, Please see my comments inline. 2014-05-07 10:35 GMT+04:00 Akihiro Motoki mot...@da.jp.nec.com: Hi, Thanks for the effort. While I am looking the website and the driver database, I have a couple of questions and suggestions. - Is it better to include trunk (= Juno) in releases

[openstack-dev] [Fuel] Rabbit in HA mode for Glance

2014-04-10 Thread Ilya Shakhat
Hi, Recently Glance switched to oslo.messaging library and as benefit got support of HA for Rabbit queues (parameter 'rabbit_ha_queues'). There are similar parameters in other projects (Nova, Heat, Ceilometer) and they are configured in corresponding manifest files. Are there plans to add the

Re: [openstack-dev] [savanna] Nominate Andrew Lazarew for savanna-core

2014-02-21 Thread Ilya Shakhat
2014-02-21 16:46 GMT+04:00 Matthew Farrellee m...@redhat.com: fyi, some of those links don't work, but these do, http://stackalytics.com/report/contribution/savanna-group/30 http://stackalytics.com/report/contribution/savanna-group/90

[openstack-dev] [WSME] Can't install WSME 0.6 due to ipaddr library

2014-02-07 Thread Ilya Shakhat
Hi Doug, I'm trying to install WSME 0.6, but today it fails due to inability to install ipaddr dependency. Pip output: Downloading/unpacking ipaddr (from WSME) You are installing a potentially insecure and unverifiable file. Future versions of pip will default to disallowing insecure files.

Re: [openstack-dev] Reviewing reviewers

2014-01-24 Thread Ilya Shakhat
And it is worth mentioning activity report in Stackalytics, the link to it is located in contribution summary block on user's statistics screen. The report looks like http://stackalytics.com/report/users/zaneb and contains all reviews, posted patches, commits, emails and blueprints. Thanks, Ilya

[openstack-dev] Stackalytics 0.4 released!

2013-12-12 Thread Ilya Shakhat
Hello everyone! Stackalytics team is happy to announce the release of version 0.4. This release is completely dedicated to different types of reports. We added highly demanded top reviewers chart acknowledged as an essential tool for finding most active reviewers (ex.

Re: [openstack-dev] [infra] How to determine patch set load for a given project

2013-11-19 Thread Ilya Shakhat
Matt, As an option you may estimate the load using Stackalytics data on number of commits - http://stackalytics.com/?release=icehousemetric=commitsproject_type=allmodule=sqlalchemy-migrateNumber of commits is certainly less than number of patches, but for project sqlalchemy-migrate the multiplier

Re: [openstack-dev] [stackalytics] Official Programs tag?

2013-11-01 Thread Ilya Shakhat
Sean, Currently the grouping is two-layer: the higher is to split between openstack-hosted and stackforge-hosted projects, the lower is to split core, incubation, docs, etc. The grouping may be not so accurate since it needs to comply with the latest changes in integrated / incubated projects

[openstack-dev] [stackalytics] team meeting minutes October 21

2013-10-22 Thread Ilya Shakhat
.txt Log: http://eavesdrop.openstack.org/meetings/stackalytics/2013/stackalytics.2013-10-21-15.01.log.html Sincerely yours, Ilya Shakhat ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo

Re: [openstack-dev] [Tuskar] Weekly IRC meetings

2013-09-05 Thread Ilya Shakhat
Oleg, Savanna meeting is on Thursdays at 18:00 UTC ( https://wiki.openstack.org/wiki/Meetings#Savanna_.28Hadoop.29_meeting) Ilya. 2013/9/5 Oleg Gelbukh ogelb...@mirantis.com Tomas, Thanks for very interesting project and this meeting as opportunity to follow its progress! Just to

[openstack-dev] [Stackalytics] 0.2 release

2013-08-21 Thread Ilya Shakhat
Hello everyone! We are excited to present the new release of Stackalyticshttp://www.stackalytics.com/- 0.2. One of major features of this release is review processing. It gives data on who reviews most, distribution of reviews by engineers or by modules, what is the ratio of positive to negative