Hi everyone,

I have tried to look for an answer before writing this email, no luck.
Sorry for the inconvenience if it is already answered.

I need to set a cookie at the begining of the web crawling. The cookie
rules the language you get the content, and while there are several
choices, if no cookie is found there will be a "default language".

I made a JSP which sets the cookie and contains several links (href), and
pointed ManifoldCF to this page as the repository seed. I expected to get
the crawling engine starting to capture links with correct language
indicated by the cookie, but what I really got is a lot of content shown in
default language.

What I think about that is that cookies are not shared between thread
spiders, so it is not possible to get cookies remain between links. Cookie
domain is correct, also cookie expiration

I would appreciate so much  if you can help me on this.

Thanks in advance!

Reply via email to