As detailed above, assuming that you need some pages present in your website and accessible, while in the same time keeping them out of reach of the search engine indexing process, the first step is disallowing the crawling of these pages in robots.txt. In this way, your pages will meet page removal criteria, and Googlebot will remove them from index when re-crawling.
In addition, it is also advisable to submit a removal request, as detailed below. Without a specific removal request, this automatic process will take time, usually 60 to 90 days; so to speed up removal, you need to submit a removal request to the Google webmaster tools. More details about page removal criteria on the “Remove URLs Tool <https://support.google.com/webmasters/answer/1663419?hl=en>” documentation page. In any case, once the removal request submitted, pages will stop being returned in search results quite a while prior to being finally removed from index. If you need extra fast removal from the GSS index, within 24 hours, you may remove URLs on-demand (based on your quota). To remove multiple URLs, you may submit the sitemap by adding the <expires> tag to the those specific URLs that you want removed from index. Removing outdated contents is covered in the “Remove outdated content <https://support.google.com/websearch/answer/6349986?hl=en>” documentation page. Independently of the above, in case you want to stop serving certain pages, and to additionally speed up the removal process, you can submit these URL patterns for registration with the GSS search engine by navigating to control panel->Setup->Basics->Advanced->Exclude sites section on the “Exclude sites <https://support.google.com/customsearch/answer/70323?hl=en>” documentation page. Registering the URLs will immediately stop serving the corresponding pages. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/36480b6f-4e32-4fe6-b0f4-50164ca479ce%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
