Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-11-17 Thread Corentin Chary
> Right, having a stable API and a special euscan tag on the wiki could
> solve that.


Speeking of API, I found some time to play with django-piston this
week, and here is the result:

- http://euscan.iksaif.net/about/api

Some examples:
- http://euscan.iksaif.net/api/1.0/packages/by-maintainer/1.json
- http://euscan.iksaif.net/api/1.0/packages/by-herd/openoffice.json
- http://euscan.iksaif.net/api/1.0/packages/by-category/app-office.xml
- http://euscan.iksaif.net/api/1.0/package/app-office/libreoffice-bin.json


-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-27 Thread Corentin Chary
On Mon, Sep 26, 2011 at 8:42 PM, Hans de Graaff  wrote:
> On Tue, 2011-09-20 at 10:00 +0200, Corentin Chary wrote:
>> On Mon, Sep 19, 2011 at 9:23 PM, Hans de Graaff  wrote:
>
>> > One integration that might also be useful is what we track on the ruby
>> > wiki currently: https://overlays.gentoo.org/proj/ruby/wiki/PendingBumps
>> > which is a collection of quick notes on problems encountered while
>> > bumping packages. The ability to attach notes to packages and to
>> > acknowledge version bumps (and e.g. make them yellow instead of red)
>> > could help with larger lists for herds.
>
>> You can already use that page: http://euscan.iksaif.net/herds/ruby/
>
> I think you missed my point. This page is more like what we have at
> http://moving-innovations.com/~graaff/outdated-gems/ which is an
> automated list based on what is in the tree and upstream. Your page is a
> good replacement for that so we may just use that in the future.
>
> What our wiki page does it keep *notes* on these bumps, so all of that
> relies on manual input. (e.g. "we tried to bump this but it needs a new
> dependency that we don't have yet.") The euscan page doesn't support
> that yet. Arguably I should open bugs for each of these bumps, but that
> seems like a lot of overhead for some quick notes.

Right, having a stable API and a special euscan tag on the wiki could
solve that.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-26 Thread Hans de Graaff
On Tue, 2011-09-20 at 10:00 +0200, Corentin Chary wrote:
> On Mon, Sep 19, 2011 at 9:23 PM, Hans de Graaff  wrote:

> > One integration that might also be useful is what we track on the ruby
> > wiki currently: https://overlays.gentoo.org/proj/ruby/wiki/PendingBumps
> > which is a collection of quick notes on problems encountered while
> > bumping packages. The ability to attach notes to packages and to
> > acknowledge version bumps (and e.g. make them yellow instead of red)
> > could help with larger lists for herds.

> You can already use that page: http://euscan.iksaif.net/herds/ruby/

I think you missed my point. This page is more like what we have at
http://moving-innovations.com/~graaff/outdated-gems/ which is an
automated list based on what is in the tree and upstream. Your page is a
good replacement for that so we may just use that in the future.

What our wiki page does it keep *notes* on these bumps, so all of that
relies on manual input. (e.g. "we tried to bump this but it needs a new
dependency that we don't have yet.") The euscan page doesn't support
that yet. Arguably I should open bugs for each of these bumps, but that
seems like a lot of overhead for some quick notes.

Kind regards,

Hans


signature.asc
Description: This is a digitally signed message part


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-25 Thread Corentin Chary
>> Open a bug, attach your ebuilds ( are there any releases besides the
>> git code? ) and I will take it from there
>
> Here it is: https://bugs.gentoo.org/show_bug.cgi?id=383937
> There are no "released" version, and the project have no homepage
> (except http://euscan.iksaif.net).

euscan ebuild is now in portage,
Thanks Markos !

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-21 Thread Corentin Chary
On Wed, Sep 21, 2011 at 12:58 PM, Markos Chandras  wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
>
> On 09/21/11 11:57, Corentin Chary wrote:
>> On Tue, Sep 20, 2011 at 9:04 PM, Donnie Berkholz
>>  wrote:
>>> On 10:00 Tue 20 Sep     , Corentin Chary wrote:
 Could someone write ebuilds for euscan and euscanwww ? It
 should not take a lot of time, but my ebuilds skills are
 probably not good enought to do that.
>>>
>>> Sounds like good practice for when you become a Gentoo dev. =)
>>
>> Hehe :). Maybe someday, but honestly I don't have any time right
>> now to fill the quizz seriously.
>>
>> Anyway, here is an ebuild for euscan:
>> http://git.iksaif.net/?p=portage.git;a=blob;f=app-portage/euscan/euscan-.ebuild;h=760f3ad025a009e3c336b1e7b08b31b72b6fec1f;hb=45b37c438f3cc20325d03ada666834b9db53d7b1
>>
>>
> for those who want to test.
>> Writing one for euscanwww is probably less interesting since
>> anyway you'll have to configure most of it by hand (database, cron,
>> etc..) and it's clearly not something more than 2-3 people will
>> install.
>>
> Hi,
>
> Open a bug, attach your ebuilds ( are there any releases besides the
> git code? ) and I will take it from there

Here it is: https://bugs.gentoo.org/show_bug.cgi?id=383937
There are no "released" version, and the project have no homepage
(except http://euscan.iksaif.net).
 Thanks,

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-21 Thread Markos Chandras
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

On 09/21/11 11:57, Corentin Chary wrote:
> On Tue, Sep 20, 2011 at 9:04 PM, Donnie Berkholz
>  wrote:
>> On 10:00 Tue 20 Sep , Corentin Chary wrote:
>>> Could someone write ebuilds for euscan and euscanwww ? It
>>> should not take a lot of time, but my ebuilds skills are
>>> probably not good enought to do that.
>> 
>> Sounds like good practice for when you become a Gentoo dev. =)
> 
> Hehe :). Maybe someday, but honestly I don't have any time right
> now to fill the quizz seriously.
> 
> Anyway, here is an ebuild for euscan: 
> http://git.iksaif.net/?p=portage.git;a=blob;f=app-portage/euscan/euscan-.ebuild;h=760f3ad025a009e3c336b1e7b08b31b72b6fec1f;hb=45b37c438f3cc20325d03ada666834b9db53d7b1
>
> 
for those who want to test.
> Writing one for euscanwww is probably less interesting since
> anyway you'll have to configure most of it by hand (database, cron,
> etc..) and it's clearly not something more than 2-3 people will
> install.
> 
Hi,

Open a bug, attach your ebuilds ( are there any releases besides the
git code? ) and I will take it from there

- -- 
Regards,
Markos Chandras / Gentoo Linux Developer / Key ID: B4AFF2C2
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.18 (GNU/Linux)

iQIcBAEBCgAGBQJOecNIAAoJEPqDWhW0r/LC6DYP/jDR0fB94keAOKKLjLtsf/7K
/ViCI7dePybD7LIDA/q/Wz8KwB+DAM15hO+i6wEvGTUqTXqAexmYRA4GKqUuA/1a
pLYm80PDvumzT8m2Q42z2+9MJfpwIezT3LreFce1WbYB/kWLhXPr0cTiGY94nVpU
kWOF2vR+zNBtwcYZilPXdan4dvcnRtL/xx9FHuFO8HwonCmgYee/42vV4ywxnM7b
1Fs7YTk2CcN1BAIU3cPm5aREoDQ1z0b+9gPpf5q1ONNmQmqyimw7b6sTLBQy0zfR
1YA2FBLfsEZseV5/BmwsLVQWjOOLkpCixakwVjyS9j/GSOX+5Biss4JC+fXhsom9
feoF45Ugk+DMWNsMeINAjvTIRmUSuESFh9xQKtjlMJSOem/MkLJJJ1JMqE+LdbV4
KEn1cxo+qwYVHnK7yRpJiC6s125aX05APClusd8Hbhb7tF8iEqw90BuE5Iz8ruDf
DtwfyY5klYDhuLMXe5I2oWed6trOi+hm3ppIBXm0q+D+HmTOG0R6h3v75Iopvykm
tGc77jzFsP4/aVcx0XWELWitR4BLG75+bcYpV2myibUf2L4rcwsl/c6hoaLUpVpY
1VeBWhpbIuKe5Ccai5R/DeRPqgVjny40gbn7oAjWeGJjAxD0x/BIj6lzRZT4cvOq
vQV/heWskEHZopj0gPnm
=km3U
-END PGP SIGNATURE-



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-21 Thread Corentin Chary
On Tue, Sep 20, 2011 at 9:04 PM, Donnie Berkholz  wrote:
> On 10:00 Tue 20 Sep     , Corentin Chary wrote:
>> Could someone write ebuilds for euscan and euscanwww ? It should not
>> take a lot of time, but my ebuilds skills are probably not good
>> enought to do that.
>
> Sounds like good practice for when you become a Gentoo dev. =)

Hehe :). Maybe someday, but honestly I don't have any time right now
to fill the quizz seriously.

Anyway, here is an ebuild for euscan:
http://git.iksaif.net/?p=portage.git;a=blob;f=app-portage/euscan/euscan-.ebuild;h=760f3ad025a009e3c336b1e7b08b31b72b6fec1f;hb=45b37c438f3cc20325d03ada666834b9db53d7b1
for those who want to test.
Writing one for euscanwww is probably less interesting since anyway
you'll have to configure most of it by hand (database, cron, etc..)
and it's clearly not something more than 2-3 people will install.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-20 Thread Donnie Berkholz
On 10:00 Tue 20 Sep , Corentin Chary wrote:
> Could someone write ebuilds for euscan and euscanwww ? It should not 
> take a lot of time, but my ebuilds skills are probably not good 
> enought to do that.

Sounds like good practice for when you become a Gentoo dev. =)

-- 
Thanks,
Donnie

Donnie Berkholz
Council Member / Sr. Developer
Gentoo Linux
Blog: http://dberkholz.com


pgp3w1etPQaXu.pgp
Description: PGP signature


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-20 Thread Corentin Chary
On Mon, Sep 19, 2011 at 9:23 PM, Hans de Graaff  wrote:
> On Wed, 2011-08-31 at 15:41 +0200, Corentin Chary wrote:
>> Hi,
>>
>> some news about euscan (still available at http://euscan.iksaif.net)
>>
>> - New design (yay !)
>> - Atom feeds available for each herd/category/maintainer/package
>> (http://euscan.iksaif.net/maintainers/59/feed/)
>> - Specific handlers for PyPi, RubyGems, pecl and PEAR packages (check
>> http://git.iksaif.net/?p=euscan.git;a=tree;f=pym/euscan/handlers;h=9a995dfcebe6beecce71851abb84a875cf6e5979;hb=HEAD
>> ).
>>
>> Now, maybe we should find a way to integrate that with the GSoC
>> statistic project and with http://packages.gentoo.org/ (like done at
>> http://packages.qa.debian.org/p/php-net-ipv4.html ). A quick way would
>> be to host euscan on a gentoo server, and add some webservices to
>> publish the data in json or xml, then packages.gentoo.org and others
>> could parse that and display it.
>
> One integration that might also be useful is what we track on the ruby
> wiki currently: https://overlays.gentoo.org/proj/ruby/wiki/PendingBumps
> which is a collection of quick notes on problems encountered while
> bumping packages. The ability to attach notes to packages and to
> acknowledge version bumps (and e.g. make them yellow instead of red)
> could help with larger lists for herds.
>
> Kind regards,
>
> Hans
>

Yep,
You can already use that page: http://euscan.iksaif.net/herds/ruby/
And ruby packages are well tracked by euscan thanks to the rubygem
site handler, see how it helped to find new upstream versions while
http://euscan.iksaif.net/herds/ruby/charts/versions-monthly.png

Could someone write ebuilds for euscan and euscanwww ? It should not
take a lot of time, but my ebuilds skills are probably not good
enought to do that.

Thanks,

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-19 Thread Hans de Graaff
On Wed, 2011-08-31 at 15:41 +0200, Corentin Chary wrote:
> Hi,
> 
> some news about euscan (still available at http://euscan.iksaif.net)
> 
> - New design (yay !)
> - Atom feeds available for each herd/category/maintainer/package
> (http://euscan.iksaif.net/maintainers/59/feed/)
> - Specific handlers for PyPi, RubyGems, pecl and PEAR packages (check
> http://git.iksaif.net/?p=euscan.git;a=tree;f=pym/euscan/handlers;h=9a995dfcebe6beecce71851abb84a875cf6e5979;hb=HEAD
> ).
> 
> Now, maybe we should find a way to integrate that with the GSoC
> statistic project and with http://packages.gentoo.org/ (like done at
> http://packages.qa.debian.org/p/php-net-ipv4.html ). A quick way would
> be to host euscan on a gentoo server, and add some webservices to
> publish the data in json or xml, then packages.gentoo.org and others
> could parse that and display it.

One integration that might also be useful is what we track on the ruby
wiki currently: https://overlays.gentoo.org/proj/ruby/wiki/PendingBumps
which is a collection of quick notes on problems encountered while
bumping packages. The ability to attach notes to packages and to
acknowledge version bumps (and e.g. make them yellow instead of red)
could help with larger lists for herds.

Kind regards,

Hans


signature.asc
Description: This is a digitally signed message part


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-07 Thread Michał Górny
On Wed, 7 Sep 2011 09:32:30 +0200
Corentin Chary  wrote:

> On Tue, Sep 6, 2011 at 8:20 PM, Matt Turner 
> wrote:
> > On Sun, Apr 3, 2011 at 1:20 PM, Corentin Chary
> >  wrote:
> >> Hi again,
> >
> > Found a little problem: it's not finding a newer version of
> > wireless-regdb, which uses a date-based versioning system. If euscan
> > tried to view/parse the directory index where the distfiles are
> > located, it would find this new file.
> >
> > http://euscan.iksaif.net/package/net-wireless/wireless-regdb/
> 
> Hi,
> If you try to run euscan on that, you'll get:
> 
> >  * Url doesn't seems to depend on version: 20101124 not found in
> > http://wireless.kernel.org/download/wireless-regdb/wireless-regdb-2010.11.24.tar.bz2
> 
> What's happenning here is that the version can be found in the url, so
> even a directory scan won't find anything because it won't be able to
> match files.
> It would work correctly if the version was 2010.11.24 or the file was
> named wireless-regdb-20101124.tar.bz2.
> 
> Unfortunatly, making that work would probably introduce a lot of false
> positive in other cases.

To be honest, you should be possible to preset PN, PV and other ebuild
variables and run the ebuild afterwards to see what SRC_URI it gives.
But that's a significant amount of work.

-- 
Best regards,
Michał Górny


signature.asc
Description: PGP signature


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-07 Thread Corentin Chary
On Tue, Sep 6, 2011 at 8:20 PM, Matt Turner  wrote:
> On Sun, Apr 3, 2011 at 1:20 PM, Corentin Chary  
> wrote:
>> Hi again,
>
> Found a little problem: it's not finding a newer version of
> wireless-regdb, which uses a date-based versioning system. If euscan
> tried to view/parse the directory index where the distfiles are
> located, it would find this new file.
>
> http://euscan.iksaif.net/package/net-wireless/wireless-regdb/

Hi,
If you try to run euscan on that, you'll get:

>  * Url doesn't seems to depend on version: 20101124 not found in 
> http://wireless.kernel.org/download/wireless-regdb/wireless-regdb-2010.11.24.tar.bz2

What's happenning here is that the version can be found in the url, so
even a directory scan won't find anything because it won't be able to
match files.
It would work correctly if the version was 2010.11.24 or the file was
named wireless-regdb-20101124.tar.bz2.

Unfortunatly, making that work would probably introduce a lot of false
positive in other cases.

Thanks,

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-06 Thread Matt Turner
On Sun, Apr 3, 2011 at 1:20 PM, Corentin Chary  wrote:
> Hi again,

Found a little problem: it's not finding a newer version of
wireless-regdb, which uses a date-based versioning system. If euscan
tried to view/parse the directory index where the distfiles are
located, it would find this new file.

http://euscan.iksaif.net/package/net-wireless/wireless-regdb/

Matt



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Corentin Chary
On Wed, Aug 31, 2011 at 3:41 PM, Corentin Chary
 wrote:
> Hi,
>
> some news about euscan (still available at http://euscan.iksaif.net)
>
> - New design (yay !)
> - Atom feeds available for each herd/category/maintainer/package
> (http://euscan.iksaif.net/maintainers/59/feed/)
> - Specific handlers for PyPi, RubyGems, pecl and PEAR packages (check
> http://git.iksaif.net/?p=euscan.git;a=tree;f=pym/euscan/handlers;h=9a995dfcebe6beecce71851abb84a875cf6e5979;hb=HEAD
> ).

A quick example of what a custom site handler can bring (rubygems
here): http://euscan.iksaif.net/categories/dev-ruby/charts/versions-weekly.png
:)

> Now, maybe we should find a way to integrate that with the GSoC
> statistic project and with http://packages.gentoo.org/ (like done at
> http://packages.qa.debian.org/p/php-net-ipv4.html ). A quick way would
> be to host euscan on a gentoo server, and add some webservices to
> publish the data in json or xml, then packages.gentoo.org and others
> could parse that and display it.
>
> Thanks,
>
> --
> Corentin Chary
> http://xf.iksaif.net
>



-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Corentin Chary
2011/9/1 Tomáš Chvátal :
> Dne 1.9.2011 09:55, Corentin Chary napsal(a):
>>>
>>> Btw I have feature request, could it remember the sorting method i set?
>>> (so I don't have to click and reorder it every time i refresh)
>>
>>  Per-page or globally ?
>>
> I would say globaly i smore sane here

I did that per-page, as it was only one  line to add, I'll try to do
it globally later.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Corentin Chary
On Thu, Sep 1, 2011 at 10:31 AM, Michał Górny  wrote:
> On Wed, 31 Aug 2011 15:41:51 +0200
> Corentin Chary  wrote:
>
>> - Specific handlers for PyPi, RubyGems, pecl and PEAR packages (check
>> http://git.iksaif.net/?p=euscan.git;a=tree;f=pym/euscan/handlers;h=9a995dfcebe6beecce71851abb84a875cf6e5979;hb=HEAD
>> ).
>
> AFAICS that specific handlers are required to grab a list of versions.
> Is it or will it be possible to add a kind of semi-handlers which would
> just grab a list of all URIs (e.g. on github project) and let euscan
> match them with SRC_URI?

Yep, it's possible, you can do some specific stuff and import
functions from euscan.helpers for euscan.handlers.generic to do a
"generic" scan, then return a correct list of version.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Michał Górny
On Wed, 31 Aug 2011 15:41:51 +0200
Corentin Chary  wrote:

> - Specific handlers for PyPi, RubyGems, pecl and PEAR packages (check
> http://git.iksaif.net/?p=euscan.git;a=tree;f=pym/euscan/handlers;h=9a995dfcebe6beecce71851abb84a875cf6e5979;hb=HEAD
> ).

AFAICS that specific handlers are required to grab a list of versions.
Is it or will it be possible to add a kind of semi-handlers which would
just grab a list of all URIs (e.g. on github project) and let euscan
match them with SRC_URI?

-- 
Best regards,
Michał Górny


signature.asc
Description: PGP signature


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Tomáš Chvátal

Dne 1.9.2011 09:55, Corentin Chary napsal(a):

Btw I have feature request, could it remember the sorting method i set?
(so I don't have to click and reorder it every time i refresh)


  Per-page or globally ?


I would say globaly i smore sane here

Tom



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Corentin Chary
> Btw I have feature request, could it remember the sorting method i set?
> (so I don't have to click and reorder it every time i refresh)

 Per-page or globally ?

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Tomáš Chvátal

Dne 1.9.2011 09:44, Corentin Chary napsal(a):

On Thu, Sep 1, 2011 at 9:23 AM, Alex Legler  wrote:

On Wednesday 31 August 2011 15:41:51 Corentin Chary wrote:

Hi,

some news about euscan (still available at http://euscan.iksaif.net)

- New design (yay !)


Glad you like it. Be sure to credit where you got it from, though.


Sorry, that was done in the dev version, but I forgot to push it
(http://euscan.iksaif.net/about/).
Thanks,

So now we just need to put this onto gentoo infrastructure and make you 
dev :P


Btw I have feature request, could it remember the sorting method i set?
(so I don't have to click and reorder it every time i refresh)

Cheers

Tom



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Corentin Chary
On Thu, Sep 1, 2011 at 9:23 AM, Alex Legler  wrote:
> On Wednesday 31 August 2011 15:41:51 Corentin Chary wrote:
>> Hi,
>>
>> some news about euscan (still available at http://euscan.iksaif.net)
>>
>> - New design (yay !)
>
> Glad you like it. Be sure to credit where you got it from, though.

Sorry, that was done in the dev version, but I forgot to push it
(http://euscan.iksaif.net/about/).
Thanks,

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-09-01 Thread Alex Legler
On Wednesday 31 August 2011 15:41:51 Corentin Chary wrote:
> Hi,
> 
> some news about euscan (still available at http://euscan.iksaif.net)
> 
> - New design (yay !)

Glad you like it. Be sure to credit where you got it from, though.

-- 
Alex Legler 
Gentoo Security / Ruby

signature.asc
Description: This is a digitally signed message part.


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-08-31 Thread Alec Warner
On Wed, Aug 31, 2011 at 6:41 AM, Corentin Chary
 wrote:
> Hi,
>
> some news about euscan (still available at http://euscan.iksaif.net)
>
> - New design (yay !)
> - Atom feeds available for each herd/category/maintainer/package
> (http://euscan.iksaif.net/maintainers/59/feed/)
> - Specific handlers for PyPi, RubyGems, pecl and PEAR packages (check
> http://git.iksaif.net/?p=euscan.git;a=tree;f=pym/euscan/handlers;h=9a995dfcebe6beecce71851abb84a875cf6e5979;hb=HEAD
> ).
>
> Now, maybe we should find a way to integrate that with the GSoC
> statistic project and with http://packages.gentoo.org/ (like done at
> http://packages.qa.debian.org/p/php-net-ipv4.html ). A quick way would
> be to host euscan on a gentoo server, and add some webservices to
> publish the data in json or xml, then packages.gentoo.org and others
> could parse that and display it.

The Gentoostats app supports fetching data with json (just put 'json'
in the HTTP_ACCEPT header in your GET.

-A

>
> Thanks,
>
> --
> Corentin Chary
> http://xf.iksaif.net
>
>



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-08-31 Thread Corentin Chary
Hi,

some news about euscan (still available at http://euscan.iksaif.net)

- New design (yay !)
- Atom feeds available for each herd/category/maintainer/package
(http://euscan.iksaif.net/maintainers/59/feed/)
- Specific handlers for PyPi, RubyGems, pecl and PEAR packages (check
http://git.iksaif.net/?p=euscan.git;a=tree;f=pym/euscan/handlers;h=9a995dfcebe6beecce71851abb84a875cf6e5979;hb=HEAD
).

Now, maybe we should find a way to integrate that with the GSoC
statistic project and with http://packages.gentoo.org/ (like done at
http://packages.qa.debian.org/p/php-net-ipv4.html ). A quick way would
be to host euscan on a gentoo server, and add some webservices to
publish the data in json or xml, then packages.gentoo.org and others
could parse that and display it.

Thanks,

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-05-05 Thread Patrick Nagel
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi Corentin,

On 2011-05-05 23:54, Corentin Chary wrote:
> New dynamic charts:
> 
> - http://euscan.iksaif.net/maintainers/2/charts/versions-weekly.png
> - 
> http://euscan.iksaif.net/categories/app-accessibility/charts/packages-weekly.png
> - 
> http://euscan.iksaif.net/categories/app-accessibility/charts/packages-weekly-small.png
> 
> Feel free to use them in a plasma-applet, or whatever you want !

I just wanted to thank you for your work on euscan, it's a great tool.

Patrick.

- -- 
Key ID: 0x86E346D4http://patrick-nagel.net/key.asc
Fingerprint: 7745 E1BE FA8B FBAD 76AB 2BFC C981 E686 86E3 46D4
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk3DWToACgkQyYHmhobjRtRe9gCgivcJc0Ljyzh+TaYsmo6Pbguv
CsAAoL3ekUpjdMyHtwVWyV8Jsis+CEBL
=61hV
-END PGP SIGNATURE-



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-05-05 Thread Corentin Chary
New dynamic charts:

- http://euscan.iksaif.net/maintainers/2/charts/versions-weekly.png
- 
http://euscan.iksaif.net/categories/app-accessibility/charts/packages-weekly.png
- 
http://euscan.iksaif.net/categories/app-accessibility/charts/packages-weekly-small.png

Feel free to use them in a plasma-applet, or whatever you want !



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-05-02 Thread Corentin Chary
On Thu, Apr 28, 2011 at 2:34 PM, Corentin Chary
 wrote:
> 2011/4/27 Tomáš Chvátal :
>> -BEGIN PGP SIGNED MESSAGE-
>> Hash: SHA1
>>
>> Dne 27.4.2011 10:04, Corentin Chary napsal(a):
>>> I updated http://euscan.iksaif.net yesterday.
>>>
>>> I also added some overlays, and I now use local portage portage trees
>>> instead of system trees (a script to do that is available in
>>> euscanwww/script).
>>>
>>> New features:
>>> - Handle overlays correctly (special column for overlays)
>>> - Add some charts (small bar charts in table, pies at the bottom)
>>> - Less false positives with euscan
>>>
>>> I'll try to add "all time" line charts this week.
>>>
>>> Thanks,
>> Found another issue, package stays there even if it was removed from the
>> portage tree (kde-misc/plasmaboard is a good example).
>
> Good catch, I'll add a --purge option to scan-portage.

Done, 
http://git.iksaif.net/?p=euscan.git;a=commitdiff;h=120ae425af82061fee4e0d7f18104595c551a144;hp=244e7d64fdc6ddeb31ad54dfcc415c50672bdebb


-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-28 Thread Corentin Chary
2011/4/27 Tomáš Chvátal :
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Dne 27.4.2011 10:04, Corentin Chary napsal(a):
>> I updated http://euscan.iksaif.net yesterday.
>>
>> I also added some overlays, and I now use local portage portage trees
>> instead of system trees (a script to do that is available in
>> euscanwww/script).
>>
>> New features:
>> - Handle overlays correctly (special column for overlays)
>> - Add some charts (small bar charts in table, pies at the bottom)
>> - Less false positives with euscan
>>
>> I'll try to add "all time" line charts this week.
>>
>> Thanks,
> Found another issue, package stays there even if it was removed from the
> portage tree (kde-misc/plasmaboard is a good example).

Good catch, I'll add a --purge option to scan-portage.


-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-27 Thread Tomáš Chvátal
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Dne 27.4.2011 10:04, Corentin Chary napsal(a):
> I updated http://euscan.iksaif.net yesterday.
> 
> I also added some overlays, and I now use local portage portage trees
> instead of system trees (a script to do that is available in
> euscanwww/script).
> 
> New features:
> - Handle overlays correctly (special column for overlays)
> - Add some charts (small bar charts in table, pies at the bottom)
> - Less false positives with euscan
> 
> I'll try to add "all time" line charts this week.
> 
> Thanks,
Found another issue, package stays there even if it was removed from the
portage tree (kde-misc/plasmaboard is a good example).

Cheers

Tom
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk24WiAACgkQHB6c3gNBRYeUEwCgwGaQUFSJQ3WyEYqNrsuE3XQE
I7IAnR/5srqiiin56N/sK2mO+uMuk4ew
=FzoM
-END PGP SIGNATURE-



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-27 Thread Corentin Chary
I updated http://euscan.iksaif.net yesterday.

I also added some overlays, and I now use local portage portage trees
instead of system trees (a script to do that is available in
euscanwww/script).

New features:
- Handle overlays correctly (special column for overlays)
- Add some charts (small bar charts in table, pies at the bottom)
- Less false positives with euscan

I'll try to add "all time" line charts this week.

Thanks,
-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-20 Thread Corentin Chary
2011/4/19 Tomáš Chvátal :
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Dne 16.4.2011 08:29, Corentin Chary napsal(a):
>> New website is up and running at
>>
>> http://euscan.iksaif.net/
>>
>> The git tree is still at http://git.iksaif.net/?p=euscan.git;a=summary
>>
>> TODO:
>> - Make some charts to see how it's going
>> - Finish the "scan my world" feature
>> - Add a way to subsribe to herds/maintainer/packages in order to
>> receive weekly/monthly reports
>>
>> I'll gladly accept any patch ! :)
>>
> Hello found another issue,
>
> http://euscan.iksaif.net/package/media-video/kmplayer/
>
> 0.11.2c IS newer than 0.11.2 :)
>
> Cheers

Should be fixed this evening. I'll now use portage.vercmp() by
default, and fallback to pkg_resources.
Thanks for the report.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-19 Thread Tomáš Chvátal
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Dne 16.4.2011 08:29, Corentin Chary napsal(a):
> New website is up and running at
> 
> http://euscan.iksaif.net/
> 
> The git tree is still at http://git.iksaif.net/?p=euscan.git;a=summary
> 
> TODO:
> - Make some charts to see how it's going
> - Finish the "scan my world" feature
> - Add a way to subsribe to herds/maintainer/packages in order to
> receive weekly/monthly reports
> 
> I'll gladly accept any patch ! :)
> 
Hello found another issue,

http://euscan.iksaif.net/package/media-video/kmplayer/

0.11.2c IS newer than 0.11.2 :)

Cheers

Tom
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk2t6AgACgkQHB6c3gNBRYeF3ACfReU6gKMMgX3VsuTB43QLGTcl
XAQAn2zPs9zmKEyTcgwKDinKurmuZQsr
=bktf
-END PGP SIGNATURE-



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-19 Thread Corentin Chary
On Tue, Apr 19, 2011 at 9:29 AM, Dirkjan Ochtman  wrote:
> On Wed, Apr 13, 2011 at 08:47, Corentin Chary  
> wrote:
>> Better, what about a per-herd/per-maintainer rss feed ?
>
> This is what I'd most want, would be very cool to have.
>
> Perhaps it would be possible for some classes of packages to fine-tune
> the algorithm, e.g. check PyPI for Python things, PECL for PHP things,
> etc.
>

Thanks,
Added to TODO, but if you got some time, feel free to give it a try :).

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-19 Thread Dirkjan Ochtman
On Wed, Apr 13, 2011 at 08:47, Corentin Chary  wrote:
> Better, what about a per-herd/per-maintainer rss feed ?

This is what I'd most want, would be very cool to have.

Perhaps it would be possible for some classes of packages to fine-tune
the algorithm, e.g. check PyPI for Python things, PECL for PHP things,
etc.

Cheers,

Dirkjan



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Corentin Chary
> The list is missing amarok-2.4.0.90. You need to look both on stable and
> unstable trees to find all versions.
> ftp://ftp.kde.org/pub/kde/unstable/amarok/2.4.0.90/src

Hum, it's hard to guess the "unstable" url from the "stable" one
automatically. But maybe a custom "site handler" for ftp.kde.org would
do it.

> http://euscan.iksaif.net/package/dev-db/mariadb/
>
> You're missing quite a few versions of mariadb. They can be found in the
> official mysql overlay (
> http://git.overlays.gentoo.org/gitweb/?p=proj/mysql.git;a=tree;f=dev-db/mariadb
> )

I'll add some "officials" overlay soon.

> http://downloads.askmonty.org/mariadb/5.1/
> http://downloads.askmonty.org/mariadb/5.2/

The 5.2 is hard to find, because all mirrors redirect to
"http://downloads.askmonty.org/mariadb/"; when trying to list the top
directory. And I can't guess the version from this page.

Brute force would be able to find it, if 5.2.0 archive was still available.

> http://euscan.iksaif.net/package/dev-db/mysql/
>
> You're missing many of the new releases of mysql.

MySQL case may be easier to deal with than MariaDB;

I added these to my TODO. I'll try to find a generic way, but I don't
know if there is really one.

Thanks !
-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Corentin Chary
On Mon, Apr 18, 2011 at 7:45 PM, Donnie Berkholz  wrote:
> On 15:48 Mon 18 Apr     , Corentin Chary wrote:
>> On Mon, Apr 18, 2011 at 3:32 PM, Donnie Berkholz  
>> wrote:
>> > - Another useful thing would be a way to supply CPV tokens for any
>> >  "unstable" upstream series that we'll never add to the tree.
>>
>> There is already some kind of blacklist in euscan. Could you provide
>> examples so I can implement that ?
>
> Sorry, forgot about this bit. I'm just talking about standard package
> tokens, the same kind used in package.mask or wherever:
>
> =x11-drivers/xf86-video-intel-2.14.90*
>>=x11-base/xorg-server-1.10.900
>
I'll try to implement that,
Thanks for the suggestion.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Jorge Manuel B. S. Vicetto
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi.

On 16-04-2011 06:29, Corentin Chary wrote:
> New website is up and running at
> 
> http://euscan.iksaif.net/

This site is providing interesting data and to me reinforces how much I
need to work on desktop-effects ebuilds.
However, I've found a few "glitches" in the checking of new versions:

http://euscan.iksaif.net/package/media-sound/amarok/

The list is missing amarok-2.4.0.90. You need to look both on stable and
unstable trees to find all versions.
ftp://ftp.kde.org/pub/kde/unstable/amarok/2.4.0.90/src

http://euscan.iksaif.net/package/dev-db/mariadb/

You're missing quite a few versions of mariadb. They can be found in the
official mysql overlay (
http://git.overlays.gentoo.org/gitweb/?p=proj/mysql.git;a=tree;f=dev-db/mariadb
)
http://downloads.askmonty.org/mariadb/5.1/
http://downloads.askmonty.org/mariadb/5.2/

http://euscan.iksaif.net/package/dev-db/mysql/

You're missing many of the new releases of mysql. Some can be found in
the official mysql overlay (
http://git.overlays.gentoo.org/gitweb/?p=proj/mysql.git;a=tree;f=dev-db/mysql
)
http://downloads.mysql.com/archives/

Keep up the great work.

- -- 
Regards,

Jorge Vicetto (jmbsvicetto) - jmbsvicetto at gentoo dot org
Gentoo- forums / Userrel / Devrel / KDE / Elections / RelEng
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJNrKhbAAoJEC8ZTXQF1qEPAGcQANTpChBIAcmEiifx1rrIumqy
6h6iBO97vInSqVWrdwGF/ZQ2FzA4QV01xxQyUbAFRTVcQPVnMXTDnX+oOZFipNAZ
Um/dE3oP4tTwlhYnt/iqXWG5Xf/jBX0r4IQ+JInxC4vSm7p2cSrIQz77yx4P8zUz
ysFEWicrq2TdqfWeV1Sp72fdfWafDmSBBEg6SBaZXstTIOVehUqVgGhi75SnE7tp
KCkHWLeFZsMMVyiQpTsX6P67JQVWtgBwO7YiE2FnE7BfJWdoqj2akWijO6gPWjOb
VOUAOSIXqNj/SCdUsnskR6jdJxNB1XI6S25m26zXkkTt10IQGNAfLkYl2dWJtvRR
C4m4eeHUQkWoq0ZYXXvMJENNkFPpWOg5d36hRycdwtPwsSY8whMF2ajXYZn+oqNj
49Nx3UzTyxI2eKAv5+I2ll5s7ZgXgR2owxDb7l2I6hFJmt6dJE5sEsWfThFW/U+v
f9EVoIgZlsbMEzYWHcMUR5Gkv5Tktl+UNhXczIgu9Bga6slrrxIoT3T0OrYz+YPK
A3mPgTP9RpJq86jhVlguNGAnEcW5TIHo2y/xeNNWF1G2PsHlw+8Ix65nQI5I8dm7
OPftwL9ouKq6V/nz9FZrlAP2S1iEcX6uXNHeuUILl7XoC9xo6t0VoJ2tzQAAmRmE
HQ2LbqLWAxsbWOd8bJi0
=YAbh
-END PGP SIGNATURE-



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Donnie Berkholz
On 15:48 Mon 18 Apr , Corentin Chary wrote:
> On Mon, Apr 18, 2011 at 3:32 PM, Donnie Berkholz  wrote:
> > - Another useful thing would be a way to supply CPV tokens for any
> >  "unstable" upstream series that we'll never add to the tree.
> 
> There is already some kind of blacklist in euscan. Could you provide
> examples so I can implement that ?

Sorry, forgot about this bit. I'm just talking about standard package 
tokens, the same kind used in package.mask or wherever:

=x11-drivers/xf86-video-intel-2.14.90*
>=x11-base/xorg-server-1.10.900

etc.

-- 
Thanks,
Donnie

Donnie Berkholz
Sr. Developer, Gentoo Linux
Blog: http://dberkholz.com


pgplh0Kf14xcm.pgp
Description: PGP signature


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Donnie Berkholz
On 15:48 Mon 18 Apr , Corentin Chary wrote:
> On Mon, Apr 18, 2011 at 3:32 PM, Donnie Berkholz  wrote:
> > - Some teams have "official" overlays. Supporting those as an additional
> >  source of ebuilds would be pretty nice.
> 
> I'll just checkout these trees on my machine (and only enable them for 
> euscan).
> euscan use portage, gentoolkit and eix internaly, so overlays are not
> a problem :).
> 
> Where could I get a list of "official" overlays that should be added ?

It will be a little tricky to get this perfect automatically. I would 
start with anything in the layman repository file [1] that has  and .


1. 
http://sources.gentoo.org/cgi-bin/viewvc.cgi/gentoo/xml/htdocs/proj/en/overlays/repositories.xml?view=log

-- 
Thanks,
Donnie

Donnie Berkholz
Sr. Developer, Gentoo Linux
Blog: http://dberkholz.com


pgp6LKmU7A8XS.pgp
Description: PGP signature


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Corentin Chary
On Mon, Apr 18, 2011 at 5:22 PM, Daniel Pielmeier  wrote:
> Corentin Chary schrieb am 18.04.2011 11:05:
>>
>> Fyi: I ran a new scan this morning. It only took 3 hours !
>>
>> GNU's Parallel is really a great tool:
>> `python manage.py list-packages | gparallel --eta --progress --jobs
>> 400% euscan | python manage.py scan-upstream --feed > /dev/null`
>>
>> I'll try to implement charts as soon as I've got enought data.
>
> I really like it. Keep up the good work. It gives a warm and fuzzy
> feeling if there are no unpackaged releases for the own packages :)
>
> There is one issue I recognized. How do you get the links for the
> unpackaged upstream versions and do you verify if the listed tarballs
> exist? I am asking because for app-editors/bluefish [1] there are eleven
> unpackaged versions listed but only sources for the three 2.0.3 releases
> exist and there are no releases for 2.1.x and 2.2.x.
>
> http://euscan.iksaif.net/package/app-editors/bluefish/

For bluefish, it's because when you try to download
http://www.bennewitz.com/bluefish/stable/source/bluefish-2.2.3.tar.bz2
it redirects you to an earlier version.

Fixed here: 
http://git.iksaif.net/?p=euscan.git;a=commitdiff;h=d74b2c505619306ab1ce3d4af3f66084b4faeed9;hp=a7a15c0ac72178bf2f3a73f94a70113ed9856e5c

Thanks !

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Corentin Chary
On Mon, Apr 18, 2011 at 1:48 PM, Corentin Chary
 wrote:
> On Mon, Apr 18, 2011 at 3:32 PM, Donnie Berkholz  wrote:
>> On 06:29 Sat 16 Apr     , Corentin Chary wrote:
>>> New website is up and running at
>>>
>>> http://euscan.iksaif.net/
>>>
>>> The git tree is still at http://git.iksaif.net/?p=euscan.git;a=summary
>>>
>>> TODO:
>>> - Make some charts to see how it's going
>>> - Finish the "scan my world" feature
>>> - Add a way to subsribe to herds/maintainer/packages in order to
>>> receive weekly/monthly reports
>>>
>>> I'll gladly accept any patch ! :)
>>
>> This is cool! I just looked through the x11-team packages and it seems
>> very useful already. I have a few suggestions if you have time. =)
>>
>> - Some teams have "official" overlays. Supporting those as an additional
>>  source of ebuilds would be pretty nice.
>
> I'll just checkout these trees on my machine (and only enable them for 
> euscan).
> euscan use portage, gentoolkit and eix internaly, so overlays are not
> a problem :).
>
> Where could I get a list of "official" overlays that should be added ?
>
>> - Another useful thing would be a way to supply CPV tokens for any
>>  "unstable" upstream series that we'll never add to the tree.
>
> There is already some kind of blacklist in euscan. Could you provide
> examples so I can implement that ?
>
>> - This looks like a problem (a versioned tarball named cairo-5c):
>>  http://euscan.iksaif.net/package/x11-libs/cairo/
>
> Hum ... yes, I'll try to use better regex :).

Fixed in 
http://git.iksaif.net/?p=euscan.git;a=commitdiff;h=a7a15c0ac72178bf2f3a73f94a70113ed9856e5c;hp=e5278e0e0f8cf617dff15f84540d0d6604081e82



-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Daniel Pielmeier
Corentin Chary schrieb am 18.04.2011 11:05:
>
> Fyi: I ran a new scan this morning. It only took 3 hours !
> 
> GNU's Parallel is really a great tool:
> `python manage.py list-packages | gparallel --eta --progress --jobs
> 400% euscan | python manage.py scan-upstream --feed > /dev/null`
> 
> I'll try to implement charts as soon as I've got enought data.

I really like it. Keep up the good work. It gives a warm and fuzzy
feeling if there are no unpackaged releases for the own packages :)

There is one issue I recognized. How do you get the links for the
unpackaged upstream versions and do you verify if the listed tarballs
exist? I am asking because for app-editors/bluefish [1] there are eleven
unpackaged versions listed but only sources for the three 2.0.3 releases
exist and there are no releases for 2.1.x and 2.2.x.

http://euscan.iksaif.net/package/app-editors/bluefish/

-- 
Daniel Pielmeier



signature.asc
Description: OpenPGP digital signature


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Corentin Chary
On Mon, Apr 18, 2011 at 3:32 PM, Donnie Berkholz  wrote:
> On 06:29 Sat 16 Apr     , Corentin Chary wrote:
>> New website is up and running at
>>
>> http://euscan.iksaif.net/
>>
>> The git tree is still at http://git.iksaif.net/?p=euscan.git;a=summary
>>
>> TODO:
>> - Make some charts to see how it's going
>> - Finish the "scan my world" feature
>> - Add a way to subsribe to herds/maintainer/packages in order to
>> receive weekly/monthly reports
>>
>> I'll gladly accept any patch ! :)
>
> This is cool! I just looked through the x11-team packages and it seems
> very useful already. I have a few suggestions if you have time. =)
>
> - Some teams have "official" overlays. Supporting those as an additional
>  source of ebuilds would be pretty nice.

I'll just checkout these trees on my machine (and only enable them for euscan).
euscan use portage, gentoolkit and eix internaly, so overlays are not
a problem :).

Where could I get a list of "official" overlays that should be added ?

> - Another useful thing would be a way to supply CPV tokens for any
>  "unstable" upstream series that we'll never add to the tree.

There is already some kind of blacklist in euscan. Could you provide
examples so I can implement that ?

> - This looks like a problem (a versioned tarball named cairo-5c):
>  http://euscan.iksaif.net/package/x11-libs/cairo/

Hum ... yes, I'll try to use better regex :).

Thanks !
-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Donnie Berkholz
On 06:29 Sat 16 Apr , Corentin Chary wrote:
> New website is up and running at
> 
> http://euscan.iksaif.net/
> 
> The git tree is still at http://git.iksaif.net/?p=euscan.git;a=summary
> 
> TODO:
> - Make some charts to see how it's going
> - Finish the "scan my world" feature
> - Add a way to subsribe to herds/maintainer/packages in order to
> receive weekly/monthly reports
> 
> I'll gladly accept any patch ! :)

This is cool! I just looked through the x11-team packages and it seems 
very useful already. I have a few suggestions if you have time. =)

- Some teams have "official" overlays. Supporting those as an additional 
  source of ebuilds would be pretty nice.

- Another useful thing would be a way to supply CPV tokens for any 
  "unstable" upstream series that we'll never add to the tree.

- This looks like a problem (a versioned tarball named cairo-5c):
  http://euscan.iksaif.net/package/x11-libs/cairo/


-- 
Thanks,
Donnie

Donnie Berkholz
Sr. Developer, Gentoo Linux
Blog: http://dberkholz.com


pgpKu9VoK0Qtd.pgp
Description: PGP signature


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Corentin Chary
On Mon, Apr 18, 2011 at 10:26 AM, Marijn  wrote:
> Nice work!

Thanks !

Fyi: I ran a new scan this morning. It only took 3 hours !

GNU's Parallel is really a great tool:
`python manage.py list-packages | gparallel --eta --progress --jobs
400% euscan | python manage.py scan-upstream --feed > /dev/null`

I'll try to implement charts as soon as I've got enought data.
-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-18 Thread Marijn
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi Corentin,

On 04/16/11 08:29, Corentin Chary wrote:
> New website is up and running at
> 
> http://euscan.iksaif.net/
> 
> The git tree is still at http://git.iksaif.net/?p=euscan.git;a=summary
> 
> TODO:
> - Make some charts to see how it's going
> - Finish the "scan my world" feature
> - Add a way to subsribe to herds/maintainer/packages in order to
> receive weekly/monthly reports
> 
> I'll gladly accept any patch ! :)

Nice work!

Marijn
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk2r9ckACgkQp/VmCx0OL2zW3ACfUiw+r/FIkAoUxFyBuD/73mYl
Fl4An2ngYC06EXM5vYq6vkiam6FRtBQQ
=69Nh
-END PGP SIGNATURE-



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-15 Thread Corentin Chary
New website is up and running at

http://euscan.iksaif.net/

The git tree is still at http://git.iksaif.net/?p=euscan.git;a=summary

TODO:
- Make some charts to see how it's going
- Finish the "scan my world" feature
- Add a way to subsribe to herds/maintainer/packages in order to
receive weekly/monthly reports

I'll gladly accept any patch ! :)

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-13 Thread Corentin Chary
On Wed, Apr 13, 2011 at 4:58 PM, Corentin Chary
 wrote:
>> Hi Corentin,
>>
>> Do you have a public repo for your django code/site available? I would
>> really enjoy taking a look at what you have here, sounds cool.
>>
>> Thanks,
>> Matt

Just pushed scan-upstream command (with --parallel support !).
Now, it's time to do a full scan and implement the views.
I staying on #gentoo-unregistered (iksaif) if someone want to get
involved in euscan :).

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-13 Thread Corentin Chary
> Hi Corentin,
>
> Do you have a public repo for your django code/site available? I would
> really enjoy taking a look at what you have here, sounds cool.
>
> Thanks,
> Matt

Hi,
Yes, my git repo is here: http://git.iksaif.net/?p=euscan.git;a=summary
Current dependencies are: eix-0.22.5, gentoolkit-0.3.0 and portage of course.

I didn't took the time to write any kind of documentation, but here is
what you'll find in the repo:
- euscan standalone utility
- euscanwww

Currently euscanwww only have basic templates, models and view. But
you can alreay run these commands to fill the database:

$ emerge --sync
$ eix-update
$ python manage.py scan-portage --all
$ python manage.py scan-metadata --all

I'll implement scan-upstream soon.

The old index.php is still available in earlier revisions.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-13 Thread Matthew Summers
On Wed, Apr 13, 2011 at 1:47 AM, Corentin Chary
 wrote:
> On Sun, Apr 10, 2011 at 8:43 AM, Hans de Graaff  wrote:
>> On Sun, 2011-04-03 at 17:20 +, Corentin Chary wrote:
>>
>>> misc:
>>> - automatic bug report
>>> - automatic email report for maintainer/herds
>>
>> I'm not sure if this makes sense. For example, it gets dev-lang/ruby
>> wrong, thinking that our old patch files are missing versions. Also, for
>> exiftool I only add production releases, so there will almost always be
>> newer upstream intermediate releases. My point here is that there are
>> often additional considerations in considering new releases, so fully
>> automating this is going to be hard. Perhaps a weekly/monthly opt-in
>> mail to the herd/maintainer with an overview would be useful?
>
> Better, what about a per-herd/per-maintainer rss feed ?
>
>> The website is nice to have as another source of scanning for updates,
>> bookmarked.
>
> The current site won't be updated, I'm working on a new django-based
> website that should be up and running next week.
> The url will probably be euscan.iksaif.net, but I'll post it here.
>
> --
> Corentin Chary
> http://xf.iksaif.net
>
>

Hi Corentin,

Do you have a public repo for your django code/site available? I would
really enjoy taking a look at what you have here, sounds cool.

Thanks,
Matt
-- 
Matthew W. Summers



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-12 Thread Corentin Chary
On Sun, Apr 10, 2011 at 8:43 AM, Hans de Graaff  wrote:
> On Sun, 2011-04-03 at 17:20 +, Corentin Chary wrote:
>
>> misc:
>> - automatic bug report
>> - automatic email report for maintainer/herds
>
> I'm not sure if this makes sense. For example, it gets dev-lang/ruby
> wrong, thinking that our old patch files are missing versions. Also, for
> exiftool I only add production releases, so there will almost always be
> newer upstream intermediate releases. My point here is that there are
> often additional considerations in considering new releases, so fully
> automating this is going to be hard. Perhaps a weekly/monthly opt-in
> mail to the herd/maintainer with an overview would be useful?

Better, what about a per-herd/per-maintainer rss feed ?

> The website is nice to have as another source of scanning for updates,
> bookmarked.

The current site won't be updated, I'm working on a new django-based
website that should be up and running next week.
The url will probably be euscan.iksaif.net, but I'll post it here.

-- 
Corentin Chary
http://xf.iksaif.net



Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-04-10 Thread Hans de Graaff
On Sun, 2011-04-03 at 17:20 +, Corentin Chary wrote:

> misc:
> - automatic bug report
> - automatic email report for maintainer/herds

I'm not sure if this makes sense. For example, it gets dev-lang/ruby
wrong, thinking that our old patch files are missing versions. Also, for
exiftool I only add production releases, so there will almost always be
newer upstream intermediate releases. My point here is that there are
often additional considerations in considering new releases, so fully
automating this is going to be hard. Perhaps a weekly/monthly opt-in
mail to the herd/maintainer with an overview would be useful?

The website is nice to have as another source of scanning for updates,
bookmarked.

Kind regards,

Hans



signature.asc
Description: This is a digitally signed message part


Re: [gentoo-dev] Re: euscan proof of concept (like debian's uscan)

2011-03-26 Thread Corentin Chary
On Sat, Mar 26, 2011 at 5:35 PM, Christian Faulhammer  wrote:
> Hi,
>
> Corentin Chary :
>> I started this mostly to see if it was possible, and I don't know if
>> i'll have the time to continue to work on that project, but I think
>> gentoo really needs an automated way to detect outdated packages.
>> This could also be a 2011 GSOC project (finishing euscan, and adding a
>> web based interface to browse the results).
>
>  Have you applied for a place in GSoC?
>
> V-Li

I can't apply to GSoC, I was suggesting that another student could work on that.

-- 
Corentin Chary
http://xf.iksaif.net