Walter:
You may find that the threads and exceptions in Python more than make up for anything you are missing in Perl. The Python libraries are not as extensive, but that is mostly because they have one of everything instead of five or six of everything.
SsolSsinclair:
this conclusional statement [above] comes from Walter which outlines the coding
advantages of using Python. A person capable of inventing these statements on the spot would know them to be true. I am unclear, therefore, why Portions of Verity UltraSeek [a commercial product] would need to use C or C++ modules.
Well, Walter compared Python and Perl not Python and C or C++. I can see why portions of a bot would be written in C or C++. Performance issues would perhaps not be too wild a guess.
.I am unclear and have an uninformed opinion about the intent of "finding" web-pages in
which the original author did not wish to b e found. i, cannot perceive there being any possibility these pages to be of any interest to the general public, or to the corporate citizenship. However, this statement by Walter: <Q>This tends to overestimate the links (e.g., pulling out references in comments, etc.), and often yields fragments that are not really followable, but it is at least a possibility.</Q> seems to indicate there is a difference between the # o9f pages retrieved, and the "possible number of pages that could be retrieved". This numerical difference is QUITE noteable, and of interest to competing coders. It is, however, A privately held #. Thanks Alex.
Sorry, but what you're discussing is a quite different matter than the discussion you're quoting. Overestimation by for example regexps is just that the bot may, for example, mistakingly store some things as tags that really aren't. Overestimating what you may need in more general terms is a different (alebeit interesting) matter.
Primary concern of Petter::<Q>Still wunder how to handle logins, though...</Q>
<Me>This is really your determination to make. Taking anyone's opinion on the matter would end in your system being less secure. I would guess some method of encryptian. I am not really clear on why the need of a PassWrdMgr is necessary with the development of a Search Engine, crawler. This system should really already be in place in your work environment. Maybe even a firewall?
The reason I need some password management is that my app has to login to a secure site. Encryption would certainly be nice!
/Petter
_______________________________________________ Robots mailing list [EMAIL PROTECTED] http://www.mccmedia.com/mailman/listinfo/robots
