[Python-Dev] Split up the c-api documentation in smaller files?

2007-12-07 Thread Christian Heimes
Good afternoon everybody!

The new C API documentation contains some large files:

105K abstract.html
300K concrete.html
183K newtypes.html

The concrete.html takes noticeable time to render on my computer (P4 2.4
with 1GB RAM, Firefox 2.0 and Ubuntu Linux). I estimate the load and
rendering time is about 4-5 seconds! It also takes long to search for a
string and scrolling isn't smooth, too.

Can we split the files in smaller chunks, please?

Christian

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Signals+Threads (PyGTK waking up 10x/sec).

2007-12-07 Thread Facundo Batista
2007/12/7, Sean Reifschneider [EMAIL PROTECTED]:

 FYI: I have no real interest in this, a friend of mine is interested in
 this, just from a why is powertop saying pygtk is waking up 10 times a
 second on my laptop? standpoint.  So I'm just trying to shepherd this.

As a Gnome user, I'm personally +1 for these improvements.

But, in a general point of view, I'd hate to see a article somewhere
in the future saying something like using GTK is ok, but if you want
to be power-friendly, avoid using it from Python...

Regards,

-- 
.Facundo

Blog: http://www.taniquetil.com.ar/plog/
PyAr: http://www.python.org/ar/
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Split up the c-api documentation in smaller files?

2007-12-07 Thread Georg Brandl
Steve Holden schrieb:
 Christian Heimes wrote:
 Good afternoon everybody!
 
 The new C API documentation contains some large files:
 
 105K abstract.html
 300K concrete.html
 183K newtypes.html
 
 The concrete.html takes noticeable time to render on my computer (P4 2.4
 with 1GB RAM, Firefox 2.0 and Ubuntu Linux). I estimate the load and
 rendering time is about 4-5 seconds! It also takes long to search for a
 string and scrolling isn't smooth, too.
 
 Can we split the files in smaller chunks, please?

Yes! It's in the TODO list since the beginning. Other than the C API, there's
also stdtypes.rst which needs quite a bit of splitting and refactoring.

 This might make a good GHOP project, though as Titus has just uploaded 
 about seventy (70!) new projects I am unsure as to how long it would 
 have to wait ti get in the queue.

Oh, provided the students stay as eager as they are at the moment, the
task won't be unclaimed for long. However, I'm not sure if that isn't too
dull for GHOP though... remember, we want to show them how interesting
Open Source development is ;)

Georg

-- 
Thus spake the Lord: Thou shalt indent with four spaces. No more, no less.
Four shall be the number of spaces thou shalt indent, and the number of thy
indenting shall be four. Eight shalt thou not indent, nor either indent thou
two, excepting that thou then proceed to four. Tabs are right out.

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Signals+Threads (PyGTK waking up 10x/sec).

2007-12-07 Thread Sean Reifschneider
On Thu, Dec 06, 2007 at 10:55:12PM -0700, Adam Olsen wrote:
That's pretty much what issue1564547 does.  I think there's two marks

Good point, I hadn't seen that before.

* Using poll and fd's is pretty platform specific for what should be a
general-purpose API

I would say that this is an optimization that helps a specific set of
platforms, including one that I think we really care about, the OLPC which
needs it for decreased battery use.  It doesn't cause breakage of
other platforms, it just may not help them.

Thanks,
Sean
-- 
 Linux, because eventually you grow up enough to be trusted with a fork().
Sean Reifschneider, Member of Technical Staff [EMAIL PROTECTED]
tummy.com, ltd. - Linux Consulting since 1995: Ask me about High Availability
  Back off man. I'm a scientist.   http://HackingSociety.org/

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Split up the c-api documentation in smaller files?

2007-12-07 Thread Steve Holden
Christian Heimes wrote:
 Good afternoon everybody!
 
 The new C API documentation contains some large files:
 
 105K abstract.html
 300K concrete.html
 183K newtypes.html
 
 The concrete.html takes noticeable time to render on my computer (P4 2.4
 with 1GB RAM, Firefox 2.0 and Ubuntu Linux). I estimate the load and
 rendering time is about 4-5 seconds! It also takes long to search for a
 string and scrolling isn't smooth, too.
 
 Can we split the files in smaller chunks, please?
 
This might make a good GHOP project, though as Titus has just uploaded 
about seventy (70!) new projects I am unsure as to how long it would 
have to wait ti get in the queue.

regards
  Steve
-- 
Steve Holden+1 571 484 6266   +1 800 494 3119
Holden Web LLC  http://www.holdenweb.com/

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Signals+Threads (PyGTK waking up 10x/sec).

2007-12-07 Thread Gustavo Carneiro
On 07/12/2007, Sean Reifschneider [EMAIL PROTECTED] wrote:

 On Thu, Dec 06, 2007 at 10:55:12PM -0700, Adam Olsen wrote:
 That's pretty much what issue1564547 does.  I think there's two marks

 Good point, I hadn't seen that before.

 * Using poll and fd's is pretty platform specific for what should be a
 general-purpose API

 I would say that this is an optimization that helps a specific set of
 platforms, including one that I think we really care about, the OLPC which
 needs it for decreased battery use.  It doesn't cause breakage of
 other platforms, it just may not help them.


Not only that, but current python signal handling is not theorethically
async safe; there are race conditions in the Py_AddPendingCalls API, and it
just happens to work most of the time.

BTW, the problem is described here:
http://mail.python.org/pipermail/python-dev/2006-September/068569.html

Think of even python select.poll and multiple threads.  If you have dozens
of threads, each blocked in some system call, when a signal arrives it will
interrupt one of the system calls, causing it to return EINTR, and then
python checks for signals.  Now imagine all the non-main threads are not
created by python; then one of the threads that wakes up could very well be
non-python one, and so python will never realize a signal was delivered.

The solution of blocking signals in all but the python thread(s) is not
feasible as we cannot control all threads that are created, some are created
by C libraries...

-- 
Gustavo J. A. M. Carneiro
INESC Porto, Telecommunications and Multimedia Unit
The universe is always one step beyond logic. -- Frank Herbert
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


[Python-Dev] Summary of Tracker Issues

2007-12-07 Thread Tracker

ACTIVITY SUMMARY (11/30/07 - 12/07/07)
Tracker at http://bugs.python.org/

To view or respond to any of the issues listed below, click on the issue 
number.  Do NOT respond to this message.


 1324 open (+22) / 11727 closed (+19) / 13051 total (+41)

Open issues with patches:   417

Average duration of open issues: 700 days.
Median duration of open issues: 858 days.

Open Issues Breakdown
   open  1317 (+22)
pending 7 ( +0)

Issues Created Or Reopened (42)
___

Management of KeyboardInterrupt in cmd.py12/04/07
   http://bugs.python.org/issue1294reopened gvanrossum   
   patch   

Add os.fchmod11/30/07
CLOSED http://bugs.python.org/issue1528created  gvanrossum   
   

Error when passing a file object to tarfile.open()   11/30/07
CLOSED http://bugs.python.org/issue1529created  GeorgeNotaras
   

doctest should return error if not all tests passed  11/30/07
   http://bugs.python.org/issue1530created  tebeka   
   

tarfile.open(fileobj=f) and bad metadata of the first file withi 11/30/07
CLOSED http://bugs.python.org/issue1531created  GeorgeNotaras
   

Refleak run of test_tcl fails11/30/07
   http://bugs.python.org/issue1532created  tiran
   py3k

Bug in range() function for large values 12/01/07
   http://bugs.python.org/issue1533created  robertwb 
   

sys.maxfloat patch   12/01/07
CLOSED http://bugs.python.org/issue1534created  tiran
   py3k, patch 

Rename __builtin__ to builtins   12/01/07
CLOSED http://bugs.python.org/issue1535created  georg.brandl 
   py3k, patch 

pickle's documentation is severely outdated  12/01/07
   http://bugs.python.org/issue1536created  alexandre.vassalotti 
   

Change GeneratorExit's base class from Exception to BaseExceptio 12/02/07
CLOSED http://bugs.python.org/issue1537created  aegis
   patch   

Avoid string copy when split char doesn't match  12/02/07
   http://bugs.python.org/issue1538created  skip.montanaro   
   patch   

test_collections: failing refleak test   12/02/07
CLOSED http://bugs.python.org/issue1539created  tiran
   py3k

Refleak tests: test_doctest and test_gc are failing  12/02/07
   http://bugs.python.org/issue1540created  tiran
   py3k

Bad OOB data management when using asyncore with select.poll()   12/02/07
   http://bugs.python.org/issue1541created  billiejoex   
   

Ship 32 and 64bit libs with MSI installer12/02/07
   http://bugs.python.org/issue1542created  tiran
   

MSI installer needs to be updated to install x86 and x64 version 12/02/07
CLOSED http://bugs.python.org/issue1543created  Dude-X   
   

IDLE installation problems and no message errors 12/03/07
   http://bugs.python.org/issue1544created  danicyber
   

shutil fails when copying to NTFS in Linux   12/03/07
   http://bugs.python.org/issue1545reopened gvanrossum   
   patch   

Win32 Platform SDK conflict  

Re: [Python-Dev] Py3k code freeze imminent; 3.0a2 release Friday

2007-12-07 Thread Guido van Rossum
As people have been disregarding the freeze anyway, I declare the py3k
branch back open. I tagged it with r30a2 yesterday morning and that's
the version that I'll be releasing shortly (waiting for Crys  me to
sort out some things around the Windows MSI installer).

--Guido

On Dec 5, 2007 8:43 PM, Guido van Rossum [EMAIL PROTECTED] wrote:
 I've built and tested the latest py3k from scratch on Ubuntu, Fedora
 7, OSX 10.4 and OSX 10.5, and found no issues.

 So the code freeze is a fact. Don't check anything into the py3k
 branch unless I tell you to. Please file high-priority bugs and assign
 them to me if you think you've found a showstopper.

 The buildbot is green for Solaris also, so I think we're in good
 shape. I don't see any green buildbots for Windows though, but Windows
 is always a flakey situation; Christian, what's your assessment?

 I see a few tests leaking; in particular test_ssl (1522 refs leaned
 per run!) and test_urllib2_localnet (3 per run). Anyone interested in
 researching these feel free to do so; just upload a patch and file a
 bug if you've squashed the leaks (or some).

 We're on for a 3.0a2 release Friday!

 --Guido


 On Dec 5, 2007 5:46 PM, Guido van Rossum [EMAIL PROTECTED] wrote:
  I'm planning to freeze the py3k branch in 2-3 hours, some time
  after/around 8pm PST (midnight UTC).
 
  If someone wants to do another svnmerge from the trunk please do it
  before then -- though we're nearly current so I don't mind not having
  the last few changes merged into this release (it's only Raymond's
  refactoring of __length_hint__ implementations).
 
  If there's anything you think really should be in this release, please
  speak up ASAP. Filing a high priority bug and assigning it to me would
  be a great way to get my attention.
 
  --
  --Guido van Rossum (home page: http://www.python.org/~guido/)
 



 --
 --Guido van Rossum (home page: http://www.python.org/~guido/)




-- 
--Guido van Rossum (home page: http://www.python.org/~guido/)
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


[Python-Dev] Python 3.0a2 is out

2007-12-07 Thread Christian Heimes
A new alpha of Python 3000 was released a few minutes ago!

http://www.python.org/download/releases/3.0/

Have fun and don't forget to report bugs at http://bugs.python.org/

Christian



signature.asc
Description: OpenPGP digital signature
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Split up the c-api documentation in smaller files?

2007-12-07 Thread Titus Brown
On Fri, Dec 07, 2007 at 07:24:04AM -0500, Steve Holden wrote:
- Christian Heimes wrote:
-  Good afternoon everybody!
-  
-  The new C API documentation contains some large files:
-  
-  105K abstract.html
-  300K concrete.html
-  183K newtypes.html
-  
-  The concrete.html takes noticeable time to render on my computer (P4 2.4
-  with 1GB RAM, Firefox 2.0 and Ubuntu Linux). I estimate the load and
-  rendering time is about 4-5 seconds! It also takes long to search for a
-  string and scrolling isn't smooth, too.
-  
-  Can we split the files in smaller chunks, please?
-  
- This might make a good GHOP project, though as Titus has just uploaded 
- about seventy (70!) new projects I am unsure as to how long it would 
- have to wait ti get in the queue.

At the current rate, approximately 10 days.

;)

--titus
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


[Python-Dev] Subversion forbidden error while committing to trunk

2007-12-07 Thread Alexandre Vassalotti
Hi,

I tried a few times to commit a patch (for issue #1530) to the trunk,
but I always get this error:

  alex:python% svn commit Lib/doctest.py --file svn-commit.tmp
  svn: Commit failed (details follow):
  svn: MKACTIVITY of
'/projects/!svn/act/53683b5b-99d8-497e-bc98-6d07f9401f50': 403
Forbidden (http://svn.python.org)

I first thought that was related to the Py3k freeze. However, I tried
again a few minutes ago and I still got this error. Is possible that
my commit rights are limited to the py3k branches? Or this is a
genuine error?

Thanks,
--  Alexandre
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


[Python-Dev] Bug Day in January?

2007-12-07 Thread Georg Brandl
Hi,

there wasn't much response to the bug day proposal, but I still think it's
a good idea. I'd propose a date in January, when Christmas etc. is over.
It would also be nice if someone did the organizing who hasn't got a
daily batch of GHOP tasks to review and commit :)

Georg

-- 
Thus spake the Lord: Thou shalt indent with four spaces. No more, no less.
Four shall be the number of spaces thou shalt indent, and the number of thy
indenting shall be four. Eight shalt thou not indent, nor either indent thou
two, excepting that thou then proceed to four. Tabs are right out.

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Python tickets summary

2007-12-07 Thread Facundo Batista
2007/11/1, Facundo Batista [EMAIL PROTECTED]:

  I think the keyword and keywords interface can be improved.  Do you have
  any plans in that direction?

 Surely!

 But, no, I have no plans to do it, as I can not make cgi scripts in my
 hosting, so these pages are statics, generated every night, and that's
 all...

Well, after my hosting allowing CGI, I now improved *a lot* the
interface of this page.

Now you have more columns:

- Id
- Summary
- Priority
- Severity
- Components
- Versions
- Keywords
- Opened by (when)
- Temporal location
- Last update by (when)

And, the biggest enhancement, you can filter by any combination of:

- Priority
- Severity
- Component
- Version
- Keyword

As before, you have everything paged, and with a graph of activity per
day at the bottom.

Enjoy it!:

http://www.taniquetil.com.ar/facundo/py_tickets.html

Regards,

-- 
.Facundo

Blog: http://www.taniquetil.com.ar/plog/
PyAr: http://www.python.org/ar/
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Subversion forbidden error while committing to trunk

2007-12-07 Thread Guido van Rossum
On Dec 7, 2007 8:35 PM, Alexandre Vassalotti [EMAIL PROTECTED] wrote:
 I tried a few times to commit a patch (for issue #1530) to the trunk,
 but I always get this error:

   alex:python% svn commit Lib/doctest.py --file svn-commit.tmp
   svn: Commit failed (details follow):
   svn: MKACTIVITY of
 '/projects/!svn/act/53683b5b-99d8-497e-bc98-6d07f9401f50': 403
 Forbidden (http://svn.python.org)

 I first thought that was related to the Py3k freeze. However, I tried
 again a few minutes ago and I still got this error. Is possible that
 my commit rights are limited to the py3k branches? Or this is a
 genuine error?

I just successfully committed something to the trunk, so the server is
not screwed.

I'm not aware of an access control mechanism that would prevent anyone
from checking in to the trunk while allowing them to check in to a
branch.

I suspect your workspace may be corrupt.

-- 
--Guido van Rossum (home page: http://www.python.org/~guido/)
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Signals+Threads (PyGTK waking up 10x/sec).

2007-12-07 Thread Adam Olsen
On Dec 7, 2007 2:35 PM,  [EMAIL PROTECTED] wrote:

 On 02:48 pm, [EMAIL PROTECTED] wrote:
 Not only that, but current python signal handling is not theorethically
 async safe; there are race conditions in the Py_AddPendingCalls API,
 and it
 just happens to work most of the time.

[This refers to the internal datastructures used by
Py_AddPendingCalls, which aren't updated in a safe way.
Hard/impossible to fix in C, but fairly easy with embedded assembly.]


 Twisted has encountered one such issue, described here:

 http://twistedmatrix.com/trac/ticket/1997#comment:12

[This refers to the overall design, which is inherently racey.]


 Unfortunately, I don't know enough about signals to suggest or comment
 on the solution.  Any Python/C wrapper around a syscall which can be
 interrupted needs to somehow atomically check for the presence of
 pending python signal handlers; I don't know of any POSIX API to do
 that.

Overall, what you'd need to do is register a wakeup function (to be
called by a signal handler or another thread), and have that wakeup
function cancel whatever you're doing.  The hard part is it needs to
work at *ANY* time while it's registered, before you've even called
the library function or syscall you intend to cancel!

I currently know of two methods of achieving this:
1) If reading a file or socket, first poll the fd, then do a
non-blocking read.  The wakeup function writes to a wakeup pipe you
also poll, which then wakes you up.  A wakeup after poll completes is
ignored, but the non-blocking read will finish promptly enough anyway.
2) Use sigsetjmp before a syscall (I wouldn't trust a library call),
then have the signal handler jump completely out of the operation.
This is evil and unportable, but probably works.

Additionally, this only gets SIGINT with the default behaviour to work
right, as it can be entirely implemented in C.  If you want to handle
arbitrary signals running arbitrary python code you really need a
second thread to run them in.

-- 
Adam Olsen, aka Rhamphoryncus
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Bug Day in January?

2007-12-07 Thread Giampaolo Rodola'
O.T. - I noticed that the PEP-3 still refers to the old sourceforge
bug tracker. Shouldn't it be rewritten?
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com


Re: [Python-Dev] Subversion forbidden error while committing to trunk

2007-12-07 Thread Alexandre Vassalotti
Thanks Guido.

I just found what was the problem. My checkout of the trunk was the
read-only one (i.e., over http).

-- Alexandre

On Dec 7, 2007 11:40 PM, Guido van Rossum [EMAIL PROTECTED] wrote:

 On Dec 7, 2007 8:35 PM, Alexandre Vassalotti [EMAIL PROTECTED] wrote:
  I tried a few times to commit a patch (for issue #1530) to the trunk,
  but I always get this error:
 
alex:python% svn commit Lib/doctest.py --file svn-commit.tmp
svn: Commit failed (details follow):
svn: MKACTIVITY of
  '/projects/!svn/act/53683b5b-99d8-497e-bc98-6d07f9401f50': 403
  Forbidden (http://svn.python.org)
 
  I first thought that was related to the Py3k freeze. However, I tried
  again a few minutes ago and I still got this error. Is possible that
  my commit rights are limited to the py3k branches? Or this is a
  genuine error?

 I just successfully committed something to the trunk, so the server is
 not screwed.

 I'm not aware of an access control mechanism that would prevent anyone
 from checking in to the trunk while allowing them to check in to a
 branch.

 I suspect your workspace may be corrupt.

 --
 --Guido van Rossum (home page: http://www.python.org/~guido/)

___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com