The site is completely dynamic, and parameter-laden links go several levels deep. We know how far SE's crawl down and this -- coupled to a lot of code using form posts where they are not necessary -- hides a lot of potential SE food. About 20,000 pages worth.
By changing a link named report.cfm?Startrow=50 to report_next_50.cfm (or report_prev_50.cfm) large numbers of pages formerly uncrawled are now being crawled. Likewise a page linked there that was named detail.cfm?listing=12345 is now named mfrname_model_98765.cfm and these pages are now showing up in SE results. The theory is that the use of the product manufacturer and model in the url is helpful to ranking and this appears to be the case, as other pages not using this scheme don't float up as high, or as fast. Eventually the idea is to use a static, published page and consume zero CF resources. But that is months away and there's a lot of income that can be generated in the interim by a better-crawled site. I can accomplish the goal -- at a price -- in an afternoon of coding. Without anywhere near as much penalty as I would have thought, now that I'm measuring it. On a page that runs between 80ms and 250 ms I am seeing added load ranging from 30-60ms. I'm also running SeeFusion Enterprise and logging slow pages, and these aren't geting flagged. It seems crazy, and it certainly is the long way to a destination, but CF is handling it like its no big deal. -- --mattRobertson-- Janitor, MSB Web Systems mysecretbase.com ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Logware (www.logware.us): a new and convenient web-based time tracking application. Start tracking and documenting hours spent on a project or with a client with Logware today. Try it for free with a 15 day trial account. http://www.houseoffusion.com/banners/view.cfm?bannerid=67 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:227492 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
