Saturday, July 21, 2012
Ask Google To Crawl And Index Pages Or Site. Yes, you can ask Google to crawl a site or page for later index it to the server. To do it, you can use a service from Google Webmaster Tools called "Fetch As Googlebot". Actually you don't even need to ask Google to crawl and index a page for it's a fully automated search engine that will crawl and index every reachable page on the web by default. But, the problem here is "When will Google crawl the page?". That's it. Nobody love waiting.

Fetch As Googlebot is particularly usefull if you have a page that's hard to be crawled, or you've just added a URL to your site, or if a page has significantly changed since the last time it was crawled. Just note that Google doesn't guarantee will index every url it crawls, but it's exactly something like trying to index.

Below is how to ask Google to crawl a page or site. Just note that to use Fetch as Google, you should have added and verified your site in Google Webmaster Tools.

1. Go to Webmaster Tools Home page.
2. Click the site you want.
3. On the left side menu click Health.
4. Click Fetch as Google.
5. In the text box, type the path to the page you want to check. For example: 2012/07/http-status-codes-list-and-explanation.html.
6. In the dropdown list, select Web.
7. Click Fetch and Google will fetch the URL you requested. It may take up to 10 or 15 minutes for Fetch status to be updated.
8. Once you see a Fetch status of "Successful", click Submit to Index, and then click one of the following:

*To submit the individual URL to Google's index, select URL and click Submit. You can submit up to 500 URLs a week this way.

*To submit the URL and all pages linked from it, click URL and all linked pages. You can submit up to 10 of these requests a month.

You can use this tool to fetch up to 500 URLs a week per Webmaster Tools account. If Googlebot can successfully fetch your page, you can submit that page to the Google index. Just click Submit to Google index. You can submit either the URL itself (limit of 500 URLs per week per Webmaster Tools account), or the URL and all pages linked from it (limit of 10 per week per Webmaster Tools account).

Additionally, you can also ask Google to crawl a url on a site that you don't own, try to visit:

That's all.


Post a Comment