Antoine Pitrou <[email protected]> added the comment: > > Well, first, this would only work for large objects. [...] > > Why do you think you might have such duplication in your workload? > > Some of the projects with which I work involve multiple manipulations > of large datasets. Often, we use Python scripts as "first and third" > stages in a pipeline. For example, in one current workflow, we read a > large file into a cStringIO object, do a few manipulations with it, > pass it off to a second process, and await the results.
Why do you read it into a cStringIO? A cStringIO has the same interface as a file, so you could simply operate on the file directly. (you could also try mmap if you need quick random access to various portions of the file) ---------- _______________________________________ Python tracker <[email protected]> <http://bugs.python.org/issue9942> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
