Hello everyone. I'm indexing a bunch of websites for a personal project (about 10k URLs), and have the URL's and their titles... however I'd like to get a brief description of them as well. I've tried parsing the pages for their meta-descriptions, but most of them do not provide this info.
Could anyone point me in the right direction as to how to get a description of a URL, whether from Google, Yahoo, or from another source? I'd prefer to not have to scrape this information. Here's an example of the description I'm talking about: http://www.google.com/search?hl=en&q=http%3A%2F%2Fwww.techcrunch.com&btnG=Google+Search&aq=f&oq= [It shows the summary as: "Group-edited blog about technology start- ups, particularly the Web 2.0 sector."] How does google get this summary for websites that do not have a meta- description? Here's an example: http://www.periodicvideos.com/ There is no meta description, yet Google comes up with: "Short streaming videos about most every element on the periodic table." Thank everyone. I appreciate your input --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google AJAX APIs" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/Google-AJAX-Search-API?hl=en -~----------~----~----~----~------~----~------~--~---
