Christian Grobmeier wrote:
    There has, in the past, been some interest in a "lightweight"
    forrest. However, I suspect for you to gather interest here it would
    have to reuse much of what is going on in the Forrest world, i.e. be
    able to use existing plugins (or at least substantial parts of
    them). Certainly that would be the case for me.


Interesting point. I would have to figure out how that would work. In fact, due to the scripting engines in Java, it would be possible to integrate a Java-Forrest with PIWI. One could use the old Java-Plugins, while using PIWI then.
PIWI could be used as a forrest plugin or standalone.

That doesn't sound lightweight. You just added a layer of complexity for all existing users without adding any real benefit (that I can see at present).

    I'd also be concerned about the apparant lack of static generation
    in PIWI - this is a main feature of Forrest.


That's true. Here could also help the Forrest-Piwi plugin mentioned above, or a Java-Crawler which also uses PIWI. Java is great for that stuff meanwhile and the resin php implementation works very good. I am not sure about the license stuff here.

There is a standalone crawler (Droids) being developed in Apache labs. Another solution would be to use wget, but that is not an ideal solution.

    However, your proposal is interesting, it's just impossible for me
    to say whether *I* would be interested because your site does not
    provide enough information about what it can and cannot do. Putting
    together a sample site demonstrating all the features would be good.


I will put such a site together, with more documentation and then come back to this list. If some of you are interested in trying out: after downloading and putting the code into a php5 host a sample site is allready configured.

That would be good. Keep us informed of your progress.

Ross