Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-04-02 Thread Fredrik Lundh
  Fredrik, if you would like to help move this all forward, great; I
  would appreciate the help.  You can write a page scraper to get the
  data out of SF

 challenge accepted ;-)

 http://effbot.python-hosting.com/browser/stuff/sandbox/sourceforge/

 contains three basic tools; getindex to grab index information from a
 python tracker, getpages to get raw xhtml versions of the item pages,
 and getfiles to get attached files.

 I'm currently downloading a tracker snapshot that could be useful for
 testing; it'll take a few more hours before all data are downloaded
 (provided that SF doesn't ban me, and I don't stumble upon more
 cases where a certain rhettinger has pasted binary gunk into an
 iso-8859-1 form ;-).

alright, it took my poor computer nearly eight hours to grab all the
data, and some tracker items needed special treatment to work around
some interesting SF bugs, but I've finally managed to download *all*
items available via the SF tracker index, and *all* data files available
via the item pages:

tracker-105470 (bugs)
6682 items
6682 pages (100%)
1912 files
tracker-305470 (patches)
3610 items
3610 pages (100%)
4663 files
tracker-355470 (feature requests)
430 items
430 pages (100%)
80 files

the complete data set is about 300 megabytes uncompressed, and ~85
megabytes zipped.

the scripts are designed to make it easy to update the dataset; adding
new items and files only takes a couple of minutes; refreshing the item
information may take a few hours.

:::

I've also added a basic extract module which parses the XHTML
pages and the data files.  this module can be used by import scripts,
or be used to convert the dataset into other formats (e.g. a single
XML file) for further processing.

the source code is available via the above link; I'll post the ZIP file some-
where tomorrow (drop me a line if you want the URL).

/F



___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-04-02 Thread Brett Cannon
On 4/2/06, Fredrik Lundh [EMAIL PROTECTED] wrote:
   Fredrik, if you would like to help move this all forward, great; I
   would appreciate the help.  You can write a page scraper to get the
   data out of SF
 
  challenge accepted ;-)
 

Woohoo!

  http://effbot.python-hosting.com/browser/stuff/sandbox/sourceforge/
 
  contains three basic tools; getindex to grab index information from a
  python tracker, getpages to get raw xhtml versions of the item pages,
  and getfiles to get attached files.
 
  I'm currently downloading a tracker snapshot that could be useful for
  testing; it'll take a few more hours before all data are downloaded
  (provided that SF doesn't ban me, and I don't stumble upon more
  cases where a certain rhettinger has pasted binary gunk into an
  iso-8859-1 form ;-).

 alright, it took my poor computer nearly eight hours to grab all the
 data, and some tracker items needed special treatment to work around
 some interesting SF bugs, but I've finally managed to download *all*
 items available via the SF tracker index, and *all* data files available
 via the item pages:

 tracker-105470 (bugs)
 6682 items
 6682 pages (100%)
 1912 files
 tracker-305470 (patches)
 3610 items
 3610 pages (100%)
 4663 files
 tracker-355470 (feature requests)
 430 items
 430 pages (100%)
 80 files

 the complete data set is about 300 megabytes uncompressed, and ~85
 megabytes zipped.

 the scripts are designed to make it easy to update the dataset; adding
 new items and files only takes a couple of minutes; refreshing the item
 information may take a few hours.

 :::

 I've also added a basic extract module which parses the XHTML
 pages and the data files.  this module can be used by import scripts,
 or be used to convert the dataset into other formats (e.g. a single
 XML file) for further processing.

 the source code is available via the above link; I'll post the ZIP file some-
 where tomorrow (drop me a line if you want the URL).


Wonderful, Fredrik!  Thank you for  doing this!When the data is
available I will arrange to get it put on python.org somewhere and
then start drafting the tracker announcement with where the data is
and how to get at it.

-Brett
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-31 Thread Brett Cannon
On 3/30/06, Fredrik Lundh [EMAIL PROTECTED] wrote:
 Brett Cannon wrote:

  Same here.  Please move any more comments about infrastructure to the
  infrastructure list 
  (http://mail.python.org/mailman/listinfo/infrastructure/).  But
  do realize the committee is not discussing trackers yet.  We are still
  trying to get our SF data out so that can be imported into a tracker
  to test its use

 oh, I forgot that the Procrastination  Stop energy Foundation was involved
 in this.


Fredrik, if you would like to help move this all forward, great; I
would appreciate the help.  You can write a page scraper to get the
data out of SF if you don't believe SF will cooperate fast enough for
your tastes or I am giving them too long to try to fix things on their
end (I don't expect they will fix things fast enough either, but
because of school ending soon I don't have time right now to start
working on a scraper myself plus I am willing to give them a little
time to try to fix the XML export so we can minimize headaches on our
end).

If you would rather contribute by collecting a list of possible
trackers along with who will maintain it, then please do.  I am not
going to dive into that quite yet, but if you want to parallelize the
work needed then I would appreciate the help.  The tracker will need
to be able to import the SF data somehow (probably will require a
custom tool so the volunteers need to be aware of this), be able to
export data (so we can back it up on a regular basis so we don't have
to go through this again), and an email interface for at least
replying to tracker items.  A community-wide announcement will
probably be needed to get a good group of volunteers together for any
one non-commercial tracker.

But I am not procrastinating.  I don't think I have ever come off as a
procrastinator on this list and I don't think I deserve the label.  I
am not putting more time in now because I am near the end of term here
at school and thus passing my courses takes precendent over a new bug
tracker.  I ended up the chairman at the infrastructure committee
during one of my busiest school terms I have ever had.  But I will see
this through and it will be done in a timely manner.

-Brett
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-31 Thread Martin v. Löwis
Robert Kern wrote:
 FWIW: Trac has a Sourceforge bug tracker import script:
 
 http://projects.edgewall.com/trac/browser/trunk/contrib/sourceforge2trac.py
 
 Apologies: for the other blank reply.

That isn't actually worth that much: somebody would need to operate it,
too. Mere existence doesn't help.

Regards,
Martin
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-30 Thread Fredrik Lundh
Brett Cannon wrote:

 Same here.  Please move any more comments about infrastructure to the
 infrastructure list 
 (http://mail.python.org/mailman/listinfo/infrastructure/).  But
 do realize the committee is not discussing trackers yet.  We are still
 trying to get our SF data out so that can be imported into a tracker
 to test its use

oh, I forgot that the Procrastination  Stop energy Foundation was involved
in this.

see you all in 2015.

/F



___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-30 Thread Robert Kern
Brett Cannon wrote:
 On 3/28/06, Martin v. Löwis [EMAIL PROTECTED] wrote:
 
[EMAIL PROTECTED] wrote:

Roundup is there now, right (sans SF export)?

Richard Jones has an SF importer for one of the two XML-like formats,
the one that is correct XML but with incomplete data. The other format,
which has complete data but is ill-formed XML, has no importer into
roundup at the moment.


Trac is being used by the
folks doing the new website.  What other candidates are being considered?

My view is that nothing should be considered unless there is
a) a volunteer to operate the tracker (or, failing that, somebody who
   does it for money), and
b) an importer of whatever data SF can provide.

 
 
 And as the chair of the infrastructure committee, those are the base
 requirements for a tracker to be considered.
 
 Once we have the complete SF data I will put out a call for proposals
 for trackers along with who has volunteered to manage them so that
 people can band together to help push their favorite tracker.
 
 But as of right now the committe just wants to get a clean dump of our
 SF data to work off of (yes, we could start a tracker from scratch but
 we want the SF data anyway and so we are going through the hassle of
 getting it off now and as a test data set for the various trackers).
 
 -Brett
 ___
 Python-Dev mailing list
 Python-Dev@python.org
 http://mail.python.org/mailman/listinfo/python-dev
 Unsubscribe: 
 http://mail.python.org/mailman/options/python-dev/python-python-dev%40m.gmane.org


-- 
Robert Kern
[EMAIL PROTECTED]

I have come to believe that the whole world is an enigma, a harmless enigma
 that is made terrible by our own mad attempt to interpret it as though it had
 an underlying truth.
  -- Umberto Eco

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-30 Thread Fredrik Lundh
Guido van Rossum wrote:

   I can ask them for a test py3k account, if there's any interest.
 
  I'm personally not very much interested in a Py3k tracker; I don't
  see myself using it. So I'm not interested in a trac-based one,
  either.

 Me neither. It's too early.

I wasn't really expecting you to start collecting *bug reports* for Py3k at
this time; you can use Trac for a lot more than that, if you want (including
todo/totry/tothinkabout lists, milestones, pep editing sandboxes, etc).

/F



___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-30 Thread Robert Kern
Brett Cannon wrote:
 On 3/28/06, Martin v. Löwis [EMAIL PROTECTED] wrote:

My view is that nothing should be considered unless there is
a) a volunteer to operate the tracker (or, failing that, somebody who
   does it for money), and
b) an importer of whatever data SF can provide.
 
 And as the chair of the infrastructure committee, those are the base
 requirements for a tracker to be considered.
 
 Once we have the complete SF data I will put out a call for proposals
 for trackers along with who has volunteered to manage them so that
 people can band together to help push their favorite tracker.

FWIW: Trac has a Sourceforge bug tracker import script:

http://projects.edgewall.com/trac/browser/trunk/contrib/sourceforge2trac.py

Apologies: for the other blank reply.

-- 
Robert Kern
[EMAIL PROTECTED]

I have come to believe that the whole world is an enigma, a harmless enigma
 that is made terrible by our own mad attempt to interpret it as though it had
 an underlying truth.
  -- Umberto Eco

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Georg Brandl
Anthony Baxter wrote:
 On Tuesday 28 March 2006 19:35, Giovanni Bajo wrote:
 Anthony Baxter [EMAIL PROTECTED] wrote:
  Another option would be Bugzilla, which is proven to be stable,
  maintained and used succesfully by large open source projects
  (like GCC+RedHat+Binutils+Classpath).
 
  Please god no. No bugzilla, no no no. Please!

 Care to elaborate?
 
 Unbelievably complicated to setup and run.
 Awful default user interface (how many form fields can you get??)
 Awful code.

Perl.

Georg ;)

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Just van Rossum
Wolfgang Langner wrote:

 what about trac:
 
 http://www.edgewall.com/trac/
 
 It is based on python and has a very good svn integration.

We started using it recently and so far it's working really well. I love
the svn (and wiki!) integration. However, I have no idea how well it
scales to a project the size of Python.

Just
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Thomas Wouters
On 3/28/06, Wolfgang Langner [EMAIL PROTECTED] wrote:
what about trac:http://www.edgewall.com/trac/It is based on python and has a very good svn integration.Sorry, I should have realized more than half of python-dev lacked the context in which I made my suggestion. At PyCon and in a few other select groups, there's been talk about swapping SF for 'something else'. (Actually, there's been a lot of talk about that everywhere, but I'm talking about concrete proposals ;) The problem is 'which 'something else''. There is a PSF committee that is charged with proposing and trying out, but it got somewhat stuck at trying to get information from SourceForge. My suggestion is to use the existing, installed, configured roundup installation so we can give it a whirl. Obviously, we will also want to give trac and jira and any other serious alternatives a try. (But Bugzilla and RT have already been veto'd.)
-- Thomas Wouters [EMAIL PROTECTED]Hi! I'm a .signature virus! copy me into your .signature file to help me spread!
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Barry Warsaw
On Tue, 2006-03-28 at 10:13 +0200, Giovanni Bajo wrote:

 Another option would be Bugzilla, which is proven to be stable, maintained
 and used succesfully by large open source projects (like
 GCC+RedHat+Binutils+Classpath).

The infrastructure committee (of which I'm a member but not the chair)
is examining the alternatives and trying to put up some live demos for
people to check out.  Getting the data out of SourceForge has been the
sticky issue though, and last I recall, we were waiting for some
response from them about export bugs we'd encountered.

-Barry



signature.asc
Description: This is a digitally signed message part
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread skip

Barry The infrastructure committee (of which I'm a member but not the
Barry chair) is examining the alternatives and trying to put up some
Barry live demos for people to check out.  

Roundup is there now, right (sans SF export)?  Trac is being used by the
folks doing the new website.  What other candidates are being considered?
Based on my brief experience as a Bugzilla user (just trying to be a good
citizen and report Mozilla bugs a few years ago), I would vote -1.  I'd hate
to think the bug reporting interface was *so* bad that it alone would
discourage people from reporting bugs.  Still, I gave up reporting Mozilla
bugs because of it.

Skip

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Jan Claeys
Op di, 28-03-2006 te 09:23 -0600, schreef [EMAIL PROTECTED]:
 Based on my brief experience as a Bugzilla user (just trying to be a good
 citizen and report Mozilla bugs a few years ago), I would vote -1.  I'd hate
 to think the bug reporting interface was *so* bad that it alone would
 discourage people from reporting bugs.  Still, I gave up reporting Mozilla
 bugs because of it. 

GNOME uses a Bugzilla fork that's more user-friendly...

(But other people say Bugzilla is also difficult for admins, so that's
probably not the only important thing.)


-- 
Jan Claeys

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Josiah Carlson

Anthony Baxter [EMAIL PROTECTED] wrote:
 
 On Tuesday 28 March 2006 19:13, Giovanni Bajo wrote:
  Another option would be Bugzilla, which is proven to be stable,
  maintained and used succesfully by large open source projects (like
  GCC+RedHat+Binutils+Classpath).
 
 Please god no. No bugzilla, no no no. Please!

I second the god no.  No bugzilla sentiment.

 - Josiah

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Martin v. Löwis
[EMAIL PROTECTED] wrote:
 Roundup is there now, right (sans SF export)?  

Richard Jones has an SF importer for one of the two XML-like formats,
the one that is correct XML but with incomplete data. The other format,
which has complete data but is ill-formed XML, has no importer into
roundup at the moment.

 Trac is being used by the
 folks doing the new website.  What other candidates are being considered?

My view is that nothing should be considered unless there is
a) a volunteer to operate the tracker (or, failing that, somebody who
   does it for money), and
b) an importer of whatever data SF can provide.

Regards,
Martin
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Georg Brandl
Martin v. Löwis wrote:
 [EMAIL PROTECTED] wrote:
 Roundup is there now, right (sans SF export)?  
 
 Richard Jones has an SF importer for one of the two XML-like formats,
 the one that is correct XML but with incomplete data. The other format,
 which has complete data but is ill-formed XML, has no importer into
 roundup at the moment.
 
 Trac is being used by the
 folks doing the new website.  What other candidates are being considered?
 
 My view is that nothing should be considered unless there is
 a) a volunteer to operate the tracker (or, failing that, somebody who
does it for money), and
 b) an importer of whatever data SF can provide.

There exists a Trac importer for SF data at
http://projects.edgewall.com/trac/browser/trunk/contrib/sourceforge2trac.py
though I don't know which format it does expect.

Generally, I like Trac very much, especially for its interconnected subsystems.
I've used it with smaller projects, and there it works perfectly.

Having said that, I don't know if the Trac ticket system (which would be the
most important subsystem for us) scales up well enough.

Of course, if there are only a few bits missing, instead of paying someone
to operate a complicated tracker, perhaps the money could be used to pay
someone to improve Trac...

Georg

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] I'm not getting email from SF when assigned abug/patch

2006-03-28 Thread Brett Cannon
On 3/28/06, Martin v. Löwis [EMAIL PROTECTED] wrote:
 [EMAIL PROTECTED] wrote:
  Roundup is there now, right (sans SF export)?

 Richard Jones has an SF importer for one of the two XML-like formats,
 the one that is correct XML but with incomplete data. The other format,
 which has complete data but is ill-formed XML, has no importer into
 roundup at the moment.

  Trac is being used by the
  folks doing the new website.  What other candidates are being considered?

 My view is that nothing should be considered unless there is
 a) a volunteer to operate the tracker (or, failing that, somebody who
does it for money), and
 b) an importer of whatever data SF can provide.


And as the chair of the infrastructure committee, those are the base
requirements for a tracker to be considered.

Once we have the complete SF data I will put out a call for proposals
for trackers along with who has volunteered to manage them so that
people can band together to help push their favorite tracker.

But as of right now the committe just wants to get a clean dump of our
SF data to work off of (yes, we could start a tracker from scratch but
we want the SF data anyway and so we are going through the hassle of
getting it off now and as a test data set for the various trackers).

-Brett
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com