Comments on: Critical Mistakes in Your Robots.txt Will Break Your Rankings and You Won’t Even Know It https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/ SEO Blog | cognitiveSEO Blog on SEO Tactics & Strategies Sun, 15 Mar 2020 08:05:08 +0200 hourly 1 https://wordpress.org/?v=5.3 By: wismatata eltra jaya https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-276794 Sun, 15 Mar 2020 08:05:08 +0000 http://cognitiveseo.com/blog/?p=7052#comment-276794 thx .. nice article

]]> By: Carol Jones https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-220539 Mon, 07 Oct 2019 08:20:44 +0000 http://cognitiveseo.com/blog/?p=7052#comment-220539 I am facing few errors in robots and finding the root cause then I came over this article and it helps me. Thanx for sharing this.

]]> By: Santri Drajat https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-146323 Tue, 06 Nov 2018 14:40:52 +0000 http://cognitiveseo.com/blog/?p=7052#comment-146323 Why “The robots.txt content does not comply with the format rules.”

]]> By: Cornelia Cozmiuc https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-138741 Mon, 15 Oct 2018 08:44:22 +0000 http://cognitiveseo.com/blog/?p=7052#comment-138741 Hi, Lina!

Not sure what you refer to; yet robots.txt do act as a tour guide for crawlers and bots.

]]> By: Lina https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-138620 Sun, 14 Oct 2018 23:54:24 +0000 http://cognitiveseo.com/blog/?p=7052#comment-138620 Why do you say that robots.txt doesn’t serve as a law for crawlers to if the first thing a crawler do when visiting a website is read it (and then follow it)?

]]> By: Joseba https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-102594 Tue, 12 Jun 2018 16:22:41 +0000 http://cognitiveseo.com/blog/?p=7052#comment-102594 Sure!
By the way, thank you both for contributing with this issue.
I love how you explain these complicated (at least for me) matters, Razvan.
I am adquiring knowledge thanks to you.
Thank you again 😉

]]> By: Abhishek Jain https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-97496 Tue, 29 May 2018 09:45:55 +0000 http://cognitiveseo.com/blog/?p=7052#comment-97496 Hi, I am getting some errors in search console, I hope the errors are rectified after reading your post.

]]> By: Mac https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-92211 Thu, 17 May 2018 07:23:48 +0000 http://cognitiveseo.com/blog/?p=7052#comment-92211 Nice post.
You can also improve your search engine indexing by robots.txt.

]]> By: kalviseithi https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-73385 Wed, 07 Mar 2018 08:32:51 +0000 http://cognitiveseo.com/blog/?p=7052#comment-73385 HI, this is Kalviseithi. my site had been blocked by robots.txt in the previous month. and my site was gone down.

blocked by robots.txt as,

1. using labels

2. and others.

please give a correct solution about my site.
thanks,
kalviseithi

]]> By: Cornelia Cozmiuc https://cognitiveseo.com/blog/7052/critical-mistakes-in-your-robots-txt-will-break-your-rankings-and-you-wont-even-know-it/#comment-67476 Thu, 18 Jan 2018 09:43:02 +0000 http://cognitiveseo.com/blog/?p=7052#comment-67476 The screenshot is now updated 😉 thanks!

]]>