Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-07 Thread malc 
Yup - nothing I can do about mailmap without commit access. On the
dates - I was just spitting out what git gave me... I've delved into
git help log => PRETTY FORMATS and changed it to use a unix timestamp
and reverted to the old (python default) format.
Updated script in https://bugs.gentoo.org/show_bug.cgi?id=559894

Output now looks like:

Removals:
dev-java/antenna2015-09-03 14:45:07  monsieurp
   b4215f4
dev-java/jjtraveler 2015-09-03 14:46:28  monsieurp
   0bda332
net-misc/netcf  2015-09-06 20:49:42  cardoe
   b32b14c

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread Patrice Clement 
Friday 04 Sep 2015 09:59:07, James Le Cuirot wrote :
> On Fri, 4 Sep 2015 09:53:38 +0100
> malc  wrote:
> 
> > James - you're right - I hadn't paid attention to MTA wrapping...
> > Patrice - even though it's counter to what James asked, I added short
> > sha-1s [ i.e. the output of git rev-parse --short
> > f1cb2b98f62fa9cbf1ef5a0f149dd47fee6964be ]
> > Now the output looks like below (or attached txt file)
> 
> That looks very nice, thanks. I don't know what will happen if
> something doesn't fit but hopefully it's something sensible. :)
> 
> -- 
> James Le Cuirot (chewi)
> Gentoo Linux Developer
> 
+1

It looks nice indeed. Thanks.

@infra: do you guys have a public git repo hosted under 
http://github.com/gentoo ? 

-- 
Patrice Clement
Gentoo Linux developer
http://www.gentoo.org

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread James Le Cuirot 
On Fri, 4 Sep 2015 09:53:38 +0100
malc  wrote:

> James - you're right - I hadn't paid attention to MTA wrapping...
> Patrice - even though it's counter to what James asked, I added short
> sha-1s [ i.e. the output of git rev-parse --short
> f1cb2b98f62fa9cbf1ef5a0f149dd47fee6964be ]
> Now the output looks like below (or attached txt file)

That looks very nice, thanks. I don't know what will happen if
something doesn't fit but hopefully it's something sensible. :)

-- 
James Le Cuirot (chewi)
Gentoo Linux Developer

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread Aaron W. Swenson 
On 2015-09-04 09:53, malc wrote:
> James - you're right - I hadn't paid attention to MTA wrapping...
> Patrice - even though it's counter to what James asked, I added short
> sha-1s [ i.e. the output of git rev-parse --short
> f1cb2b98f62fa9cbf1ef5a0f149dd47fee6964be ]
> Now the output looks like below (or attached txt file)
> 
> Removals:
> dev-java/antenna   2015-09-03 13:45:07 +  monsieurp  
> b4215f4

Would you consider dropping the TZ offset? If the script were to translate
the DT to UTC, that'd remove some noise and shorten the line by 5.

dev-java/antenna   2015-09-03 13:45:07Z  monsieurp  b4215f4

And I know what my offset is from UTC so I know the above example
happened at 11:45am my time, but having to do more math on the others
before figuring out my time is a little annoying. I can live with it,
but I'm lazy.

- Aaron


signature.asc
Description: Digital signature

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread Kent Fredric 
On 5 September 2015 at 01:12, Aaron W. Swenson  wrote:
> Would you consider dropping the TZ offset? If the script were to translate
> the DT to UTC, that'd remove some noise and shorten the line by 5.

+1

> dev-java/antenna   2015-09-03 13:45:07Z  monsieurp  b4215f4
>
> And I know what my offset is from UTC so I know the above example
> happened at 11:45am my time, but having to do more math on the others
> before figuring out my time is a little annoying. I can live with it,
> but I'm lazy.

I'm curious why the time part is even necessary, or at least,
necessary at that accuracy.
Day seems to be all that is necessary at most, and even then, you
could reduce that down to a single number ( because its assumed to be
from "now" to "a weekago" and the inference can be made, and maybe for
convenience, use "days ago", or somethig.

If you're needing the timestamps to try work out which commit
something happened, the SHA1 is going to prove far more useful at
that.


>dev-java/antenna   2015-09-03 13:45:07Z  monsieurp  b4215f4
dev-java/antenna   Sep 3, 13:45Z monsieurp  b4215f4



-- 
Kent

KENTNL - https://metacpan.org/author/KENTNL

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread Matthew Thode 
On 09/04/2015 01:51 PM, Michał Górny wrote:
> Dnia 2015-09-04, o godz. 19:43:41
> James Le Cuirot  napisał(a):
> 
>> On Fri, 4 Sep 2015 13:15:57 -0500
>> Matthew Thode  wrote:
>>
>>> uh, this is wrong btw :P
>>>
>>> I am both mthode and prometheanfire
>>
>> Your fault for committing with the wrong e-mail address? :P Perhaps
>> they're linked in GitHub but I wouldn't want to use that as a source of
>> information. How else would we determine this?
> 
> PGP key matching?
> 
that's what I was expecting

-- 
-- Matthew Thode (prometheanfire)



signature.asc
Description: OpenPGP digital signature

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread Michał Górny 
Dnia 2015-09-04, o godz. 19:43:41
James Le Cuirot  napisał(a):

> On Fri, 4 Sep 2015 13:15:57 -0500
> Matthew Thode  wrote:
> 
> > uh, this is wrong btw :P
> > 
> > I am both mthode and prometheanfire
> 
> Your fault for committing with the wrong e-mail address? :P Perhaps
> they're linked in GitHub but I wouldn't want to use that as a source of
> information. How else would we determine this?

PGP key matching?

-- 
Best regards,
Michał Górny



pgp6hRUS0yhpX.pgp
Description: OpenPGP digital signature

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread Kent Fredric 
On 5 September 2015 at 06:51, Michał Górny  wrote:
>> information. How else would we determine this?
>
> PGP key matching?


/.mailmap

git help shortlog -> MAPPING AUTHORS


This system allows displaying committers under spellings/aliases/email
addresses other than the one they committed as for any tools that
utilize them. ( like git shortlog  -e ).

This is better than having to find a time machine and destroy the tree
just because somebody has a different email address or some committer
had utf8 encoding problems in their name once upon a time before
anybody noticed.





-- 
Kent

KENTNL - https://metacpan.org/author/KENTNL

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread Matthew Thode 
On 09/04/2015 03:53 AM, malc wrote:
> James - you're right - I hadn't paid attention to MTA wrapping...
> Patrice - even though it's counter to what James asked, I added short
> sha-1s [ i.e. the output of git rev-parse --short
> f1cb2b98f62fa9cbf1ef5a0f149dd47fee6964be ]
> Now the output looks like below (or attached txt file)
> 
> Removals:
> dev-java/antenna   2015-09-03 13:45:07 +  monsieurp  
> b4215f4
> dev-java/jjtraveler2015-09-03 13:46:28 +  monsieurp  
> 0bda332
> www-servers/skunkweb   2015-09-03 13:52:51 +  monsieurp  
> 2dc8314
> x11-drivers/radeon-ucode   2015-09-02 00:17:33 +0200  chithanh   
> 7b60c95
> 
> Additions:
> dev-python/cachetools  2015-09-03 16:17:35 -0500  mthode 
> 3dca3ff
> dev-python/debtcollector   2015-09-01 10:24:15 -0500  mthode 
> 8513c3c
> dev-python/fasteners   2015-09-02 21:56:24 -0500  prometheanfire 
> cfc49c9
> dev-python/functools32 2015-09-02 13:01:45 +0200  jlec   
> 2933703
> dev-python/futurist2015-09-03 16:24:23 -0500  mthode 
> 4a5f1c0
> 
> Updated scripts attached.
> 
> malc.
> 
uh, this is wrong btw :P

I am both mthode and prometheanfire

-- 
Matthew Thode (prometheanfire)



signature.asc
Description: OpenPGP digital signature

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread James Le Cuirot 
On Fri, 4 Sep 2015 13:15:57 -0500
Matthew Thode  wrote:

> uh, this is wrong btw :P
> 
> I am both mthode and prometheanfire

Your fault for committing with the wrong e-mail address? :P Perhaps
they're linked in GitHub but I wouldn't want to use that as a source of
information. How else would we determine this?

-- 
James Le Cuirot (chewi)
Gentoo Linux Developer


pgp09BGHR5ZAz.pgp
Description: OpenPGP digital signature

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-04 Thread malc 
James - you're right - I hadn't paid attention to MTA wrapping...
Patrice - even though it's counter to what James asked, I added short
sha-1s [ i.e. the output of git rev-parse --short
f1cb2b98f62fa9cbf1ef5a0f149dd47fee6964be ]
Now the output looks like below (or attached txt file)

Removals:
dev-java/antenna   2015-09-03 13:45:07 +  monsieurp  b4215f4
dev-java/jjtraveler2015-09-03 13:46:28 +  monsieurp  0bda332
www-servers/skunkweb   2015-09-03 13:52:51 +  monsieurp  2dc8314
x11-drivers/radeon-ucode   2015-09-02 00:17:33 +0200  chithanh   7b60c95

Additions:
dev-python/cachetools  2015-09-03 16:17:35 -0500  mthode 3dca3ff
dev-python/debtcollector   2015-09-01 10:24:15 -0500  mthode 8513c3c
dev-python/fasteners   2015-09-02 21:56:24 -0500  prometheanfire cfc49c9
dev-python/functools32 2015-09-02 13:01:45 +0200  jlec   2933703
dev-python/futurist2015-09-03 16:24:23 -0500  mthode 4a5f1c0

Updated scripts attached.

malc.
Removals:
dev-java/antenna   2015-09-03 13:45:07 +  monsieurp  b4215f4
dev-java/jjtraveler2015-09-03 13:46:28 +  monsieurp  0bda332
www-servers/skunkweb   2015-09-03 13:52:51 +  monsieurp  2dc8314
x11-drivers/radeon-ucode   2015-09-02 00:17:33 +0200  chithanh   7b60c95

Additions:
dev-python/cachetools  2015-09-03 16:17:35 -0500  mthode 3dca3ff
dev-python/debtcollector   2015-09-01 10:24:15 -0500  mthode 8513c3c
dev-python/fasteners   2015-09-02 21:56:24 -0500  prometheanfire cfc49c9
dev-python/functools32 2015-09-02 13:01:45 +0200  jlec   2933703
dev-python/futurist2015-09-03 16:24:23 -0500  mthode 4a5f1c0
dev-python/os-testr2015-09-01 10:57:37 -0500  mthode 6407898
dev-python/oslo-service2015-09-03 16:55:42 -0500  mthode b76edcf
dev-python/pytest-django   2015-09-02 08:46:59 +0200  jlec   2b2fb2d
dev-python/pytest-pythonpath   2015-09-02 09:11:44 +0200  jlec   63ac3c2
dev-python/strict-rfc3339  2015-09-02 12:31:00 +0200  jlec   abec25e
dev-python/webcolors   2015-09-02 12:38:44 +0200  jlec   8ba7f41
media-fonts/hack   2015-08-31 08:36:17 +0200  amadio f1cb2b9
sci-geosciences/qmapshack  2015-09-03 22:38:02 +0600  grozin 3fa0482
sys-firmware/amdgpu-ucode  2015-09-02 04:16:35 +0200  chithanh   5bd3914
sys-firmware/radeon-ucode  2015-09-02 00:17:33 +0200  chithanh   7b60c95
x11-drivers/xf86-video-amdgpu  2015-09-02 03:25:56 +0200  chithanh   b53f89f
#!/usr/bin/env python2
# Authored by Alec Warner 
# Significent modifications by Robin H Johnson 
# Modified for Git support by Malcolm Lashley 
# Released under the GPL Version 2
# Copyright Gentoo Foundation 2006

# Changelog: Initial release 2006/10/27
#Git Support 2015/08/25

doc = """
# Purpose: This script analyzes the git log output in an attempt to locate package
# additions and removals.  It takes 3 arguments; two of which are optional.  It needs
# the path to the repository to read.  If a start_date is not provided it will read
# the entire log and match any addition/removal.  If you provide a start date it will
# only match things that are after that start_date.  If you provide an end date you can
# find matches over date ranges.  If an end date is not provided it defaults to now()
"""

import sys, os, re, time, datetime, subprocess

new_package = re.compile("^A\s+(.*)\/(.*)\/Manifest$")
removed_package = re.compile("^D\s+(.*)\/(.*)\/Manifest$")
author_re  = re.compile("^Author: .*<(.*)@.*>")
date_re= re.compile("^Date:\s+(.*)")
commit_re= re.compile("^commit (.*)")

class record(object):
	def __init__(self, who, date, cp, op, commit ):
		"""
		Who is a string
		date is whatever the crap git outputs for date string :)
		cp is a category/package
		op is "added", "removed", "moved"
commit is the git sha1
		"""
		self.who = who
		self.date = date
		self.package = cp
		self.op = op
self.commit = commit

	def __str__( self ):
		#return "Package %s was %s by %s on %s" % (self.package, self.op, self.who, self.date)
		return "%s,%s,%s,%s,%s" % (self.package, self.op, self.who, self.date, self.commit)

	def cat (self):
		return self.package.split("/")[0]
	
	def pn (self):
		return self.package.split("/")[1]

	def date (self):
		return self.date
	
	def who (self):
		return self.who
	
	def op (self):
		return self.op

	def commit (self):
		return self.commit


def main():
	if (len(sys.argv) < 2):
		usage()
		sys.exit(1)

	args = sys.argv[1:]
	repo_path = args[0]
	os.chdir(repo_path)

	if len(args) >= 2: 
		start_date = ["--after", args[1] ]
	else:
		start_date = []

	if len(args) >= 3:

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-03 Thread Patrice Clement 
Thursday 03 Sep 2015 18:01:55, James Le Cuirot wrote :
> On Thu, 3 Sep 2015 18:49:05 +0200
> Róbert Čerňanský  wrote:
> 
> > Can it be *please* modified so that one removal/addition fits on a
> > single line?  It is very hard to eye-parse when lines are split in
> > two.  Or maybe leave the length as is and do not break the lines?
> 
> I agree but it's because it used to just have the CVS username rather
> than the full name and e-mail address. I'd be happy with just the
> e-mail address. If that's still too long, maybe we could replace
> @gentoo.org with @g.o and that would deal with most cases.
> 
> -- 
> James Le Cuirot (chewi)
> Gentoo Linux Developer
> 
Can we also get the SHA1 of each commit/removal?

Thanks!

-- 
Patrice Clement
Gentoo Linux developer
http://www.gentoo.org

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-03 Thread James Le Cuirot 
On Thu, 3 Sep 2015 18:49:05 +0200
Róbert Čerňanský  wrote:

> Can it be *please* modified so that one removal/addition fits on a
> single line?  It is very hard to eye-parse when lines are split in
> two.  Or maybe leave the length as is and do not break the lines?

I agree but it's because it used to just have the CVS username rather
than the full name and e-mail address. I'd be happy with just the
e-mail address. If that's still too long, maybe we could replace
@gentoo.org with @g.o and that would deal with most cases.

-- 
James Le Cuirot (chewi)
Gentoo Linux Developer

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-09-03 Thread Róbert Čerňanský 
On Mon, 31 Aug 2015 15:06:05 +0100
malc  wrote:

> dev-java/burlap Mon Aug 24 17:21:42 2015 +0200
>  Patrice Clement 
> dev-java/caucho-servicesMon Aug 24 17:21:42 2015 +0200
>  Patrice Clement 

Can it be *please* modified so that one removal/addition fits on a
single line?  It is very hard to eye-parse when lines are split in
two.  Or maybe leave the length as is and do not break the lines?

(I hope it's not settings of my MUA, but I have checked the raw message
and it's the same also there.)

Robert 


-- 
Róbert Čerňanský
E-mail: ope...@tightmail.com
Jabber: h...@jabber.sk

Re: [gentoo-dev] Automated Package Removal and Addition Tracker, for the week ending 2015-08-30 23:59 UTC

2015-08-31 Thread malc 
Using the scripts I updated and provided in the previous thread:

Robin - any change you can drop these into your cron?

Removals:
dev-java/burlap Mon Aug 24 17:21:42 2015 +0200
 Patrice Clement 
dev-java/caucho-servicesMon Aug 24 17:21:42 2015 +0200
 Patrice Clement 
dev-java/cocoon Fri Aug 28 20:52:28 2015 +0100
 James Le Cuirot 
dev-java/jldap  Mon Aug 24 17:19:44 2015 +0200
 Patrice Clement 
dev-java/openspml   Mon Aug 24 17:19:44 2015 +0200
 Patrice Clement 
dev-java/openspml2  Mon Aug 24 17:19:44 2015 +0200
 Patrice Clement 
dev-java/soap   Mon Aug 24 17:19:44 2015 +0200
 Patrice Clement 
games-emulation/handy   Thu Aug 27 15:26:46 2015 -0400
 Michael Sterrett 
kde-base/baloo-widgets  Thu Aug 27 21:02:43 2015 +1000
 Michael Palimaka 
kde-plasma/balooWed Aug 26 00:36:59 2015 +1000
 Michael Palimaka 
kde-plasma/kfilemetadataWed Aug 26 00:40:03 2015 +1000
 Michael Palimaka 
kde-plasma/kio-extras   Wed Aug 26 00:55:39 2015 +1000
 Michael Palimaka 
sci-biology/embassy-memenew Thu Aug 27 15:33:41 2015 +0200
 Justin Lecher 
sci-biology/embassy-miraThu Aug 27 15:30:39 2015 +0200
 Justin Lecher 

Additions:
app-shells/hstr Fri Aug 28 14:59:35 2015 +0200
 Justin Lecher 
dev-go/blackfriday  Mon Aug 24 17:48:35 2015 -0500
 William Hubbs 
dev-go/go-md2manMon Aug 24 17:59:21 2015 -0500
 William Hubbs 
dev-go/sanitized-anchor-nameMon Aug 24 17:43:23 2015 -0500
 William Hubbs 
dev-libs/gf-completeThu Aug 27 16:20:34 2015 -0500
 Matthew Thode 
dev-libs/jerasure   Thu Aug 27 16:20:34 2015 -0500
 Matthew Thode 
dev-python/CacheControl Mon Aug 24 08:46:41 2015 +0200
 Justin Lecher 
dev-python/cookies  Wed Aug 26 11:09:30 2015 +0200
 Manuel Rüger 
dev-python/distlib  Mon Aug 24 08:41:12 2015 +0200
 Justin Lecher 
dev-python/packagingMon Aug 24 09:15:07 2015 +0200
 Justin Lecher 
dev-python/progress Mon Aug 24 09:06:06 2015 +0200
 Justin Lecher 
dev-python/pykwalifyThu Aug 27 17:35:56 2015 +0200
 Justin Lecher 
dev-python/responsesWed Aug 26 11:09:56 2015 +0200
 Manuel Rüger 
kde-apps/baloo-widgets  Thu Aug 27 21:02:43 2015 +1000
 Michael Palimaka 
kde-apps/kaccounts-integration  Fri Aug 28 13:57:14 2015 +0200
 Johannes Huber 
kde-apps/kde-l10n   Wed Aug 26 00:18:37 2015 +0200
 Johannes Huber 
kde-apps/kio-extras Wed Aug 26 00:53:39 2015 +1000
 Michael Palimaka 
kde-plasma/kgamma   Wed Aug 26 00:10:39 2015 +1000
 Michael Palimaka 
kde-plasma/kwallet-pam  Wed Aug 26 00:10:39 2015 +1000
 Michael Palimaka 
kde-plasma/kwayland-integration Wed Aug 26 00:10:39 2015 +1000
 Michael Palimaka 
kde-plasma/plasma-paWed Aug 26 00:10:39 2015 +1000
 Michael Palimaka 
kde-plasma/user-manager Wed Aug 26 00:10:39 2015 +1000
 Michael Palimaka 
net-libs/accounts-qtThu Aug 27 14:47:19 2015 +0200
 Johannes Huber 
net-libs/libaccounts-glib   Thu Aug 27 14:40:25 2015 +0200
 Johannes Huber 
net-libs/libsignon-glib Thu Aug 27 14:24:48 2015 +0200
 Johannes Huber 
net-libs/signon-oauth2  Thu Aug 27 14:09:51 2015 +0200
 Johannes Huber 
net-libs/signon-ui  Thu Aug 27 14:53:45 2015 +0200
 Johannes Huber 
net-libs/signondThu Aug 27 13:31:29 2015 +0200
 Johannes Huber 
net-libs/telepathy-accounts-signon  Thu Aug 27 15:03:24 2015 +0200
 Johannes Huber 
net-mail/muchsync   Sat Aug 22 15:45:51 2015 +0100
 Amadeusz Żołnowski 
sci-physics/herwig++Thu Aug 27 00:20:55 2015 +0200
 Jauhien Piatlicki