In the last months we have been working on an automatic unnatural links classification system. Before going into the details of this new tool, I would like to share with you the challenges that we had in implementing such a complex system. (if you are not interested in those just skip to the tool)
1. User Oriented Concept
The Unnatural Links subject generates a lot of confusion among website owners, webmasters and even SEO professionals. I can tell you that the unnatural link concept is a hard to grasp concept for the majority of the people. You can easily “feel” the confusion that most people have if you read the Google Product Forums, where a lot of people talk about their unnatural link warnings and Google Penguin penalties.
Some other techniques that classify links are based on a certain “toxicity” level or “potential” risk. We consider these techniques generate a poor user experience and are only adding complexity to an already complex formula.
The route we took is to simplify the unnatural link understanding and disavowing process.
We developed the system in such a way that it will split the links in
- Unnatural Links.
- Suspect Links.
- OK Links.
As simple as that!
2. False Positive Ratio
It is important to have a really low incorrect detection ratio. To put it simple you would not want a system that detects only 10% of your unnatural backlinks or misclassifies the good links as being unnatural.
This was hard to achieve. No automatic detection system provides 100% certainty (Google misclassifies site links also … it is all about the final False Positive ratio).
We took the performance up to 97% percent well-done classifications and a false positive ratio of only 3% on our testing dataset.
3. Incorrect Metrics
An important factor for a well-done classification, are the metrics that are used in order to draw any valid conclusion out of it.
For example using external metrics such as the Google PR or the indexation status of a link in Google are flowed ways of identifying an unnatural link. That is because you simply are able to identify this link only after Google has potentially marked it as unnatural and are looking at Google as the major sign of an unnatural link. This means that using such metrics in an automatic system makes the system rely on things that have been already flagged. These might only work for sites that have already been penalized.
We do not use any external metrics in our algorithm in order to detect unnatural backlinks. This made the development process harder but in the end more accurate and trustworthy.
4. Detection Algorithm
I am not going to share the algorithm that is used in order to classify links as natural or unnatural but I can tell you that this algorithm does not use external metrics and it relies on AI, in-depth content and link profile analysis in order to segment the so called “toxic” links from the natural ones. The rule set we use is based on the official Google Quality Guidelines.
Let me give you a quick example considering a web-directory link. In the context of a natural looking link profile that web-directory link will not be flagged as unnatural as it simply is not. The same link put in a unnatural link profile will be looked from a different POV and will be flagged as unnatural due to the high amount of unnatural link patterns found in the suspect link profile; patterns that falls into the black hat SEO category.
And the new tool is called:
Unnatural Link Detection
The tool that simplifies the “unnatural links” complexity!
Some of the most important features of the tool are:
- Automatic unnatural link classification.
- Transparency & detail on each classified link. (why it is unnatural)
- Google Disavow Export.
- Fast Double-Check using the Link Snapshots.
- Flag & Tag Links. (bulk actions available also)
- Advanced Link profile segmentation using unnatural filters.
- Can be used both on your site and the competitors.
- Ignore Links that are already disavowed, or unimportant to the analysis.
The Unnatural Links Detection widget is found in the inBound Link Analysis module, on any campaign that you run in cognitiveSEO.
Mixed with the Visual Link Explorer, this new set of data points will instantly give you the unnatural link profile of a site.
Who should use this new tool?
Everyone really, and here is why.
1. Penalized Sites Owners
This is the ideal tool if you’ve received an unnatural link warning or have been penalized by the “Google Penguin Updates”/ received a manual penalty.
The tool helps you find every link to your website and then analyse the potential risk they carry. Even if you have a lots of links, you can easily check the inbound links to disavow or remove is a breeze now with. You can easily check the links using the already generated screenshots . If we were wrong on the classification you can easily re-classify the link.
After you manually checked the entire list of links and disavow links just hit the Google Disavow Export and you have the file ready for the Google Import. If you see a link that uses links schemes you have the posibility to remove the link or apply other manual actions.
For the links you want to manually remove just create To-dos that you will later review.
Links that pass the unnatural test are marked as OK because those are natural links. Keep those links and use them as an example of high quality backlinks.
2. Non-Penalized Sites Owners
For sites that haven’t been penalized by any unnatural link warning or update, the tool helps to manage the link risk by monitoring your site and competitors on a weekly basis.
You will stay ahead of the game by being able to:
- Make informed Link Building Decisions.
- Know your risk to be penalized and monitor it weekly.
- Monitor your competitors’ link toxicity and risk.
- Monitor your site for Negative-SEO campaigns.
Link Risk and toxic links or harmful links, as concepts, are only useful if you know your bad links before Google takes any action against your site. If you know it before they do, you are able to manage it.
Matt Cutt has recommends using the Disavow tool even if your site wasn’t penalized:
If you are at all worried about someone trying to do negative SEO or it looks like there’s some weird bot that’s building up a bunch of links to your site and you have no idea where it came from, that’s the perfect time to use disavow as well. I wouldn’t worry about going ahead and disavowing links even if you don’t have a message in your webmaster console |
|
Matt Cutts | |
Former head of the web spam team at Google |
Recover Your Site Now!
To be able to test the system we give free 14 day trials, so you might want to take advantage of that first and see if the tool is up to your expectations. You will also get the full functionality of the tool, including full backlink analysis, daily rank tracking, social visibility and a plethora of cool & useful stuff.
Congrats to you and all the CognitiveSEO team Razvan !
This is a great new tool that will help a lot.
tks Guillaume. stay tuned for more 😉
Well done guys! This is going to be an amazing time saver. Keep up the developments.
we are even improving the time saver 😉
tks for the appreciation Adam.
Wow
My personal wishes to the entire team of Cognitiveseo. Hope you all will be blessed with more skills for all of your upcoming tools.
happy to see Visualize Backlinks tool.
Brahmadas
tks for the appreactions Brahmads and enjoy using the tool for a faster recovery or for best link management 😉
Looks like a great tool! Trying to find out whats natural and unnatural can be annoying and frustrating at times, especially when Google docks you for it.
This is incredible. It’s the first time I see a tool that can make a graphical representation of that type. Congratulations!
Hi,
Cool software and very time saving to identify unnatural links which will help seo expert to ease their job.
Great job keep it up.
Are all directory links unnatural. In the reason list, i found “web directory link” tagged as unnatural links. Please elaborate!
No they are not. It is probably because it is a web directory that is of low quality and has dubious links on it.
There are also OK directories. obviously it depends how the link looks on those directories. Even if they are ok the link can be unnatural.
as we are trying to rank better in search engine, and specially in Google, the most important thing is to classify what google see as unnatural linksans not to provides 100% certainty, so if “Google misclassifies links also” that what your tools should do also.. at least, that what I think… all in all, thank you for this useful tool and +1 for graphical representation
you get the option to reclassify any links that you may think are unnatural or ok in the eye of Google inside the platform. the tool provides guidance and the ability to do thinks way faster and better. 1 week vs 2 hours!
Razvan i am really a fan of CognitiveSEO it is awesome tool i have used ever but the charges are too much for beginner SEO professionals like me.
This is a great site to measure a website for actual link building or protect any site to prevent from unnatural link activities.
I want to test the linking activities with my site that how it is working for me ?
sure. just ran the site in cognitive and see what the system tells you 😉
interesting post Raz.
I’m new with this tool, just a simple question. Do links that my readers place on their twitter,pinterest page consider unnatural?
anything that is done in excess would be considered unnatural if it is done with the intent to alter the search engine rankings.
We need your assistance in SEO of our website Weblinkindia.net..We are a leading Web development company from India and have many sites developed for our clients across the globe.
send a mail on support at cognitiveseo [] com with more details.
Hi, today i used your tool, I want to get information about Unnatural Link. Please help me, how to generate this report. I don’t find any such option
Hi, After the campaign is run just claissify the anchor text as brand vs commercial and than run the unntural links. Here is a full tutorial on this http://support.cognitiveseo.com/knowledgebase/unnatural-link-detection-full-tutorial/
Awesome Sir,
I am new to this “Google Unnatural Links” so definitely I should go for your tool to understand it better and also make my site better by removing unnatural links.
you should check the risk of being penalized under the tool as it will indicate what potential risk you have regarding this and take action.
Wow, The Tool is Very Good to Find Unnatural Links.
Great tool, but where can I find it in my account? I see the ‘Unnatural Links Detection’ section, but can’t find the list of links which you point out with nr.7 in your first printscreen.
Can you please help?
Hi,
The interface was updated. That can be found in the Unnautral Link Navigator. more here https://cognitiveseo.com/blog/3524/the-fastest-most-accurate-unnatural-link-detection-case-study/
and here is the full documentation for the tool http://support.cognitiveseo.com/knowledgebase/unnatural-link-detection-tool-usage-guide/
Great tool will give a try
Great tool!
excellent tool, but how we can improve our link building strategy for detecting quality links?
The tool allows you to improve your link building strategy?
thanks
glad you like it. Sure it does. If you can see what works for your nice you could use that intelligence in order to apply similar tactics to your own site.
Also you can easily spot High Oprtunity Links and Lost Links ( links that became broken and ask them back eventually).
There are a lot of creative methods to do that.
This tool is so perfekt and easy to use for not profs.
Great Tool excellent result..
“Automatic Unnatural Link Detection”: what is the price, just for this function?
the software is only sold per month for with all the functionalities. you can find all the prices listed here http://cognitiveseo.com/pricing.php
I was losing my site rank from couple of days. I search for the answer to get my site rank back i found you and your articles really help me to get my website back to position.
Thanks for your great articles.
Does your tool also consider content relevancy when analyzing if a link is natural?
Yes, it does, along with other 50 rules 😉
Nice post thanks for sharing, i have a question how to remove suspicious links from website at a time?
Hi, Deepak!
You should try the tool for 14 days; it has a special section dedicated to automatic link identification and removal. 😉
https://cognitiveseo.com/googlepenguin/#trial
Best of luck with everything!