How to check robots.txt on site?
- Thread starter Marc0
- Start date
Top Niche Websites
Member
- Joined
- Jul 11, 2013
- Messages
- 27
- Points
- 0
Just type this into your browser and see if you get a result
http://domain/robots.txt
just change domain to whatever site you are checking
Michael
http://domain/robots.txt
just change domain to whatever site you are checking
Michael
psavsnacks
New member
- Joined
- Mar 11, 2014
- Messages
- 4
- Points
- 0
simple way to check robots.txt file....
type home page website url/robots.txt
type home page website url/robots.txt
TejasWebHosting
Member
- Joined
- Nov 9, 2014
- Messages
- 15
- Points
- 0
It is important to remember that just because you can browse the site, doesn't always mean everything is okay....
I would recommend using either Bing or Google's Webmaster Tools service to check it. They have a tool that allows you to confirm if it is visible or not with the click of a button.
I would recommend using either Bing or Google's Webmaster Tools service to check it. They have a tool that allows you to confirm if it is visible or not with the click of a button.
Older Threads
Newer Threads
Latest Threads
Recommended Threads
Similar Threads
Latest Hosting OffersNew Reviews
-
Latest hosting offers
-
Hostaddon VPS/VDS | EU/US/ASIA | 25/10/2/1 Gbps | SSD NVMe | Upto 50% Off | Storage | DMCA IgnoreUnmetered 1, 10, 25 Gbps Unmetered VPS Hosting- HostAddon
- Updated:
-
Hostaddon - EU/US/ASIA | 1Gbit/10Gbit Unmetered Servers | Start @$14.99 | Additional 10% OffPremium Hardware @ Affordable prices- HostAddon
- Updated:
-
Hostaddon - 10Gbit Unmetered Dedicated Servers | Start @$199.99 | Additional 10% Off10 Gbps Guaranteed Port Speed- HostAddon
- Updated:
-
