{"id":5346,"date":"2014-05-22T15:39:09","date_gmt":"2014-05-22T12:39:09","guid":{"rendered":"http:\/\/cognitiveseo.com\/blog\/?p=5346"},"modified":"2014-05-22T15:39:09","modified_gmt":"2014-05-22T12:39:09","slug":"unnatural-links-penalty-404-the-bad-pages-and-recover","status":"publish","type":"post","link":"https:\/\/cognitiveseo.com\/blog\/5346\/unnatural-links-penalty-404-the-bad-pages-and-recover\/","title":{"rendered":"Unnatural Links Penalty? 404 The Bad Pages and Recover!"},"content":{"rendered":"<p style=\"text-align: justify;\">You may never know when you are going to stumble on an unnatural links penalty, whether it\u2019s algorithmic or manual. And you\u2019re going to have to deal with that problem one way or the other. When you\u2019re trying to get rid of those harmful backlink profiles, one solution that prevailed is to remove the page from your site to which the unnatural links were pointing. You\u2019re going to swiftly deal with the problem, but you\u2019re going to remain with a page that will give the 404 message.<\/p>\n<p style=\"text-align: center;\"><img decoding=\"async\" class=\" wp-image-5367 aligncenter\" title=\"Recover Your Sites Ranking by 404ing Your Bad Pages\" alt=\"Recover Your Sites Ranking by 404ing Your Bad Pages\" src=\"http:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/recover-yours-ites-ranking-404ing-your-bad-pages.jpg\" width=\"100%\" srcset=\"https:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/recover-yours-ites-ranking-404ing-your-bad-pages.jpg 1000w, https:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/recover-yours-ites-ranking-404ing-your-bad-pages-300x127.jpg 300w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/p>\n<p style=\"text-align: justify;\"><span style=\"line-height: 1.5em;\">Will this technique of removing a page that has toxic links pointing to it solve a problem that would otherwise lead to a penalty ? In a nutshell, if you\u2019re keen on getting rid of those unnatural links, you might as well remove the linked page. As a result, it will return a 404 HTTP response code.<\/span><\/p>\n<h3><strong>How to Spot the Pages With the Most Unnatural Links?<\/strong><\/h3>\n<p>When you run an <a title=\"The fastest &amp; most accurate Unnatural Link Detection + Case Study\" href=\"http:\/\/cognitiveseo.com\/blog\/3524\/the-fastest-most-accurate-unnatural-link-detection-case-study\/\">unnatural link detection report<\/a>, in cognitiveSEO, you have the very cool <a title=\"Visual Link Explorer \u2013 The Easiest &amp; Most Powerful way to Visualize Backlinks\" href=\"http:\/\/cognitiveseo.com\/blog\/2228\/visual-link-explorer-visualize-backlinks\/\">Visual Link Explorer<\/a> visualization that will plot all the detected unnatural links based on the pages of the site.<\/p>\n<p style=\"text-align: center;\"><a href=\"http:\/\/cognitiveseo.com\/blog\/3524\/the-fastest-most-accurate-unnatural-link-detection-case-study\/\"><img decoding=\"async\" class=\" wp-image-5477 aligncenter\" title=\"Visual Link Explorer Unnatural Links Distribution\" alt=\"Visual Link Explorer Unnatural Links Distribution\" src=\"http:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/visual-link-explorer-unnatural-links-distribution.jpg\" width=\"100%\" srcset=\"https:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/visual-link-explorer-unnatural-links-distribution.jpg 1654w, https:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/visual-link-explorer-unnatural-links-distribution-300x111.jpg 300w, https:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/visual-link-explorer-unnatural-links-distribution-1024x378.jpg 1024w\" sizes=\"(max-width: 1654px) 100vw, 1654px\" \/><\/a><\/p>\n<p>Each cluster represents a page on the site and the red and yellow dots represent the distribution of the unnatural and suspect links.<\/p>\n<p>So it is as simple as looking at the chart and spotting the pages that have the most unnatural links.<\/p>\n<h3><strong style=\"font-size: 1.17em; text-align: justify; line-height: 1.5em;\">When Should You Apply This Unnatural Link Removal Strategy?<\/strong><\/h3>\n<p style=\"text-align: justify;\">While this tactic can be used for any page on your website at any time, you won\u2019t be able to do so with the homepage. You need to take this fact into consideration. The pages from your site that have a great deal of toxic links can be removed and declared 404 in order to quickly recover from a Google penalty. You\u2019ll also have to think at all the natural links and at the content that you\u2019re going to get rid off. So you\u2019ll need to figure out if you want to keep the page and try to handpick and remove every unnatural link from the page or just solve the problem right from the start.<\/p>\n<p style=\"text-align: justify;\">You should also know, that in order for this strategy to work, you need to delete the page that has the toxic links and that might have triggered the Unnatural Links Penalty. You won\u2019t be able to dodge that bullet in any kind of way. The following will not solve your problem:<\/p>\n<ul style=\"text-align: justify;\">\n<li><span style=\"color: #333333;\">Generating a robots. txt file that blocks that page from being indexed. This method won\u2019t solve your problem as Google will simply not crawl the page but it will still be taken into consideration for your site.<\/span><\/li>\n<li>Using redirect to another page. You will still have those unnatural links pointing to your site.<\/li>\n<li>Using the same content on a newly created and canonicalized\u00a0page &#8211; After GoogleBot crawls your site it will find the duplicate content. The toxic links that were assigned to the deleted page will now be assigned to the canonicalized page.<\/li>\n<li>Tagging the page as nofollow or noindex. The same as the case with robots.txt. Rendering a page with nofollow won\u2019t make it\u2019s links obsolete.<\/li>\n<\/ul>\n<h3><strong>Does Google Recommend to 404 the Target Page in case of an Unnatural Links Penalty?<\/strong><\/h3>\n<p dir=\"ltr\" style=\"text-align: justify;\">This also hides another question that comes into mind \u201cDo 404 pages hurt my site\u2019s ranking ?\u201d. You shouldn\u2019t be scared if one day you stumble upon a couple of these errors reported in Webmaster Tools. Google is aware that the Internet is very volatile and changes happen on a daily basis. Everyone deals with broken pages that return 404 as a status code. It\u2019s also the decent way to deal with a page that was removed from the site. You should be aware that Google\u2019s crawlers can\u2019t see the updated 404 HTTP response code if you block it with robots.txt. But overall, the fact that you have a page that shows a 404 message doesn&#8217;t affect other pages from your site and their links.<\/p>\n<p dir=\"ltr\" style=\"text-align: justify;\">It\u2019s something that many people pondered upon and finally John Muller, Webmaster Trends Analyst at Google responded during a <a href=\"https:\/\/www.youtube.com\/watch?v=z6p7vO04Vsc&amp;t=33m17s\" target=\"_blank\" rel=\"nofollow\">Webmaster Central Hangout<\/a>. He was asked:<\/p>\n<blockquote>\n<p dir=\"ltr\" style=\"text-align: justify;\">\u201cDoes removing a page that has unnatural links pointing to it accomplish the same thing when it comes to removing a link when it comes to the Penguin algorithm? If a site has all of its links pointing to one page and removes the page is the issue solved?\u201d<\/p>\n<\/blockquote>\n<p dir=\"ltr\" style=\"text-align: justify;\">He \u00a0responded \u201cYes, essentially that\u2019s pretty much the same thing\u201d. All the links that are pointing to a 404 page are dropped because there\u2019s nothing to be linked anymore. But there might still be some differences between removing the links and removing the page that has those links. Some of them may be picked up faster by Google than the other, but he didn\u2019t mentioned something specific.<\/p>\n<p dir=\"ltr\" style=\"text-align: center;\"><img decoding=\"async\" class=\" wp-image-5368 aligncenter\" title=\"Error 404 James Bot cognitive SEO\" alt=\"Error 404 James Bot cognitive SEO\" src=\"http:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/error-404-james-bot-cognitive-seo.jpg\" width=\"100%\" srcset=\"https:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/error-404-james-bot-cognitive-seo.jpg 1000w, https:\/\/cognitiveseo.com\/blog\/wp-content\/uploads\/2014\/05\/error-404-james-bot-cognitive-seo-300x167.jpg 300w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/p>\n<h3><strong>How Should I do it?<\/strong><\/h3>\n<p>To make sure this strategy serves it\u2019s purpose you have to be careful on how you approach this. Only if you create the 404 page and then remove the page that has links pointing to it, you\u2019re going to make Google disregard those links from your profile. Google\u2019s John Muller also stated that you should make absolutely sure that accessing the URL should give you a 404 (Not Found) or a 410 ( Gone ) HTTP response code. Google reads into those messages and ignores the links.<\/p>\n<p>The main flaw of this strategy is that you can\u2019t use it when all those unnatural links are pointing to your homepage. You clearly can\u2019t delete this general page of your site. In this situation you\u2019re only option is to change the address of your site, but only if you\u2019re sure those unnatural links are causing your site to lose ranking. You also need to make sure you have an informative 404 page ready to replace the deleted one.<\/p>\n<h3><strong>Should I Disavow the Unnatural Links pointing to a 404 page?<\/strong><\/h3>\n<p>Taking in consideration every advantage and disadvantage of using both these methods of dissolving unnatural links, there are some similarities and differences worth taking into consideration They share the same fate as an ultimate resort and both are irreversible processes. And, last but not least, 404ing the page has the same results as using the disavow tool. But given all the drama and uncertainty that surrounds the disavow tool, removing the linked page and replacing it with one that offers a 404 HTTP code becomes a pretty viable option.<\/p>\n<h3><strong>What is the Difference Between HTTP Status Code 404 and 410?<\/strong><\/h3>\n<p dir=\"ltr\">Google reacts differently depending on the different response codes you assign to your pages. While there may be cut from the same fabric, Google\u2019s Matt Cutts decided to explain the difference between these two shades of \u201cpage not found\u201d.<\/p>\n<blockquote>\n<ul>\n<li>200 means everything went totally fine<\/li>\n<li>404 means page not found<\/li>\n<li>410 typically means gone, as in the page is not found and we do not expect it to come back<\/li>\n<\/ul>\n<\/blockquote>\n<p>He explained that 410 is basically more than a 404, it just means that the page is gone forever. He further says that you shouldn\u2019t worry for the most part &#8211; if a page is temporarily removed you should 404 it. If the page was deleted and there are no plans of getting it back, then you should serve a 410! Regardless of the 404 or 410 HTTP response code, GoogleBot will still come back and recrawl the site to see if those pages are really gone from your site. More details in the video below.<\/p>\n\n<h3><strong>Conclusion<\/strong><\/h3>\n<p>Most certainly, you can remove the unnatural links by removing the linked page from your site and then 404ing it. It\u2019s an approved method that works just as well as using the Disavow Tool. As a result, Google will proceed to de-index and remove those pages and disavow their links. But again, you need to remember one golden rule of applying this strategy &#8211; the page you want to 404 shouldn\u2019t be an important page from your website like the homepage. For those situations you need to do a Google Disavow.<\/p>\n<p>What are your thoughts on using a 404\/410 HTTP response code to remove pages that have lots of unnatural links ? Have you used this strategy or are you planning to use it in the future ?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>You may never know when you are going to stumble on an unnatural links penalty, whether it\u2019s algorithmic or manual. And you\u2019re going to have to deal with that problem one way or the other. When you\u2019re trying to get rid of those harmful backlink profiles, one solution that prevailed is to remove the page [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[81,103,74],"class_list":["post-5346","post","type-post","status-publish","format-standard","hentry","category-seo","tag-unnatural-links","tag-unnatural-links-detection","tag-unnatural-links-recovery"],"_links":{"self":[{"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/posts\/5346","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/comments?post=5346"}],"version-history":[{"count":0,"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/posts\/5346\/revisions"}],"wp:attachment":[{"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/media?parent=5346"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/categories?post=5346"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cognitiveseo.com\/blog\/wp-json\/wp\/v2\/tags?post=5346"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}