How to check robots.txt on site?
- Thread starter Marc0
- Start date
Top Niche Websites
Member
- Joined
- Jul 11, 2013
- Messages
- 27
- Points
- 0
Just type this into your browser and see if you get a result
http://domain/robots.txt
just change domain to whatever site you are checking
Michael
http://domain/robots.txt
just change domain to whatever site you are checking
Michael
psavsnacks
New member
- Joined
- Mar 11, 2014
- Messages
- 4
- Points
- 0
simple way to check robots.txt file....
type home page website url/robots.txt
type home page website url/robots.txt
TejasWebHosting
Member
- Joined
- Nov 9, 2014
- Messages
- 15
- Points
- 0
It is important to remember that just because you can browse the site, doesn't always mean everything is okay....
I would recommend using either Bing or Google's Webmaster Tools service to check it. They have a tool that allows you to confirm if it is visible or not with the click of a button.
I would recommend using either Bing or Google's Webmaster Tools service to check it. They have a tool that allows you to confirm if it is visible or not with the click of a button.
Older Threads
Newer Threads
Latest Threads
Recommended Threads
Similar Threads
Latest Hosting OffersNew Reviews
-
Latest hosting offers
-
Anonymous & Offshore VPS HostingBulletproof, Anonymous & Offshore VPS Hosting Provider- darkvpspro
- Updated:
-
Hostaddon VPS/VDS | EU/US/ASIA | 25/10/2/1 Gbps | SSD NVMe | Upto 50% Off | Storage | DMCA IgnoreUnmetered 1, 10, 25 Gbps Unmetered VPS Hosting- HostAddon
- Updated:
-
30 Days Free VPS Windows or Linux with Monthly Contract backed by NVMe SSD SANVPS customisble resources- trulycloud
- Updated:
-
