jayvdb added a comment.

I am basically giving up on coveralls support.  I've added Appveyor support 
<https://github.com/jayvdb/coveralls-python/tree/appveyor> to the python 
library <https://github.com/coagulant/coveralls-python>, using their mostly 
undocumented API, but it refuses to group Appveyor multiple builds  together 
(using the same git hash) like it does for Travis.  If I try to group them 
manually using the same build identifier in the data submission, all builds in 
all branches are grouped together into one ever growing build which references 
the initial commit.

Anyway, a sample of the coveralls.io output.

https://coveralls.io/builds/2766042

While debugging their crappy service, as I noted on 
https://phabricator.wikimedia.org/T101807,  I found that they are not an open 
source kinda company, so it isnt easy to find and fix problems.

What I did find is an open source equivalent which Wikimedia could install
https://github.com/localytics/shamer

And I am giving the lesser known https://codecov.io a try, and I am quite 
impressed so far.  Their github has more stuff in it, and they also offer their 
product for closed environments: https://github.com/codecov/enterprise - it 
looks very empty, so maybe it is closed source also.

But https://codecov.io/ provides a public service as well, and they have a 
lovely interface, and lots of useful features.

Most importantly, they merge multiple coverage reports for the same git hash 
together, even merging Appveyor (Win32) and Travis (Linux), which means we can 
reach 100% without adding `# pragma: nocover` to the code for branches which 
are versions / platform specific.

One feature that I like is the coverage reports can be filtered on codecov.io , 
so the builds can send all coverage data, and the default view would only 
include pywikibot/ and maybe scripts/ , but we can still look at data related 
to other parts of the codebase on our personal accounts by removing some of the 
filters.

Without further ado, here it is 
https://codecov.io/github/jayvdb/pywikibot-core/commits

Also worth looking at are the suggestions : 
https://codecov.io/github/jayvdb/pywikibot-core/features/suggestions?ref=codecov
 , which are currently drowned in scripts/ so I have excluded scripts using a 
filter.

Note that Appveyor builds didnt send data for that build, due to coverage not 
collecting the data. (should be fixed now, but waiting for Appveyor builds to 
run again).


TASK DETAIL
  https://phabricator.wikimedia.org/T74863

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: jayvdb, pywikibot-bugs



_______________________________________________
pywikibot-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

Reply via email to