Email: info@seogeneration.co.uk

Google Webmaster Tools adds new feature – Soft 404 Pages

New features rolled out by Google, both the soft 404’s and the new feature under News have raised a number of concerns.
Google announced they added “soft” or “crypto” 404s to their “crawl errors” report in Google Webmaster Tools.
Soft 404s or crypto 404s are page not found pages that return the server response code of 200. Technically, 404 pages should return a server status code 404, which means page not found. Sometimes webmasters make a mistake by creating custom not found pages but forget to return the server status code of 404, to help the search engines know that this page is a 404.
Google’s new report helps you locate these errors and shows that Google clearly understands that some webmasters set 404 pages as 200.

Google said, “Soft 404s can limit a site’s crawl coverage by search engines because these duplicate URLs may be crawled instead of pages with unique content.” Google added tips for 404 pages:

1. Check whether you have soft 404s listed in Webmaster Tools
2. For the soft 404s, determine whether the URL:
a. Contains the correct content and properly returns a 200 response (not actually a soft 404)
b. Should 301 redirect to a more accurate URL
c. Doesn’t exist and should return a 404 or 410 response
3. Confirm that you’ve configured the proper HTTP Response by using Fetch as Googlebot in Webmaster Tools
4. If you now return 404s, you may want to customize your 404 page to aid your users. Our custom 404 widget can help.

Another interesting feature under the Crawl errors section are the issues encountered when crawling Google News, this will only appear on your webmaster tool if you have your content included in Google news.
The errors observed by the crawlers are grouped into 2 main areas; In Sitemap and News-specific. I will be writing about this feature in detail in my next post.

  • I am getting a soft 404 error on google webmaster tool. But when I enter the same URL in fetch as googlebot, I am getting a 200 response. How do i resolve the soft 404 error.nn1

  • Hi Indy,
    Funny enough, getting a soft 404 doesn't necessarily mean your page is rendering a 404 page. I'm having a similar issue and I believe Google would be looking into this issue soon.

  • Conservatory Furniture

    Perfect, i agree that we must follow these guidelines as to protect our content from such vulnerabilities.

  • promotional merchandise

    If someone browses to a page that doesn't exist and you give them a custom error page with suggested links, a search function and an explanation that's pretty much as good as it gets. Granted some people just redirect to their homepage, this should certainly be discouraged.

  • promotional merchandise

    Thanks seroundtable for this! I'm still new to webmaster tools so any heads up are welcome…keep up the good work!

  • promotional product

    Many site owners want to be able to allow agencies/SEO's access to the data but emphatically DO NOT want them to be able to change any settings.

  • Conservatory Furniture

    Ability to restrict additional users access would be very useful, one for the feature request list please

  • Conservatory Furniture

    this is great news, can remove all those horrid verification pages clogging up my root folder.

  • It doesn’t work…on my site or yours. It works on the WP side but on the shop side….goes to blank screen.