Hi, I need to crawl around 30000 URLs per day. In which i need to set dynamic depth and topN . Is there any configuration where i can set up depth and topN dynamically for different URLs?
Thanks and Regards Deepa Devi Jayaveer ____________________________________________ =====-----=====-----===== Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dissemination, use, review, distribution, printing or copying of the information contained in this e-mail message and/or attachments to it are strictly prohibited. If you have received this communication in error, please notify us by reply e-mail or telephone and immediately and permanently delete the message and any attachments. Thank you
