On Dec 3, 2008, at 3:11 PM, Greg Ewing wrote:

> Stefan Behnel wrote:
>
>> Cython already keeps track of module dependencies (a Pyrex  
>> feature). But
>> I'm not sure if that extends to inter-pxd dependencies. It should  
>> be easy
>> to support that, though. Then the dependency list would tell you  
>> if you
>> have to re-parse a pickled .pxd.
>
> The difficulty as I see it would be figuring out how to
> pickle just the declarations that came from a particular
> .pxd file. Simply pickling the symbol table as it's
> currently implemented would end up pickling far too much,
> and unpickling it would create duplicates of objects
> that you don't want duplicated.

Yes, these are *exactly* the kind of issues that I've been looking  
at, and it's not simple. Things were interconnected enough that it  
felt like I was pickling the entire state of the compiler. Extracting  
just the new declarations (and then making sure when they're  
unpickled that uniqueness and consistency is preserved) is a messy task.

Pickling the (unprocessed) parse tree is not as optimal, but has  
shown some hope.

- Robert

_______________________________________________
Cython-dev mailing list
[email protected]
http://codespeak.net/mailman/listinfo/cython-dev

Reply via email to