Antoine Pitrou <pit...@free.fr> added the comment: > > Well, first, this would only work for large objects. [...] > > Why do you think you might have such duplication in your workload? > > Some of the projects with which I work involve multiple manipulations > of large datasets. Often, we use Python scripts as "first and third" > stages in a pipeline. For example, in one current workflow, we read a > large file into a cStringIO object, do a few manipulations with it, > pass it off to a second process, and await the results.
Why do you read it into a cStringIO? A cStringIO has the same interface as a file, so you could simply operate on the file directly. (you could also try mmap if you need quick random access to various portions of the file) ---------- _______________________________________ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue9942> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
