This is actually content from the customer's database. Most of the content in the database is real (it's actually in live deployment). Problem seems to be that they have created a number of test pages in the beginning that is still there.
How do I as a developer ensure that the content isn't of a form that Ferret chokes on? I mean, even if I take the test data out now, I cannot guarantee someone else will put similar data into the database again. Then it's me, the developer, who will take the blame when search isn't working. It must be possible to either: - Somehow test the data before indexing to ensure it's not "deadly" - The indexing algorithm should skip after a (configurable) time if it's stuck on a small chunk of data. (or something like it) Would it help in this case to replace <html>-tags with spaces (as those aren't significant anyway)? Regards Marcus ps. Thanks for the comments. -- Posted via http://www.ruby-forum.com/. _______________________________________________ Ferret-talk mailing list [email protected] http://rubyforge.org/mailman/listinfo/ferret-talk
