How to check robots.txt on site?

Marc0

Marc0

Well-known member
Registered
Joined
Jun 6, 2012
Messages
890
Points
28
Hi Friends..


If I would like to check whether a website has robots.txt, how would I check it?
 
psavsnacks

psavsnacks

New member
Joined
Mar 11, 2014
Messages
4
Points
0
simple way to check robots.txt file....

type home page website url/robots.txt
 
TejasWebHosting

TejasWebHosting

Member
Registered
Joined
Nov 9, 2014
Messages
15
Points
0
It is important to remember that just because you can browse the site, doesn't always mean everything is okay....

I would recommend using either Bing or Google's Webmaster Tools service to check it. They have a tool that allows you to confirm if it is visible or not with the click of a button.
 
You must log in or register to reply here.
Older Threads
Marc0
What is email marketing? What are the types of email marketing?
Replies
4
Views
3,506
tayloralina
Marc0
what is best tool create a logo
Replies
12
Views
5,760
Knightmedia
Marc0
How we create a div in middile of any screen ?
Replies
0
Views
2,158
Marc0
Marc0
how to create paging on php
Replies
1
Views
2,778
Holly Nicole
Marc0
Can I Use htaaccess file in window server?
Replies
2
Views
3,775
mikho
Newer Threads
Marc0
I use this as my robots.txt file. is it right?
Replies
2
Views
3,391
WHUK
Maxwell
Facebook Advertisement?
Replies
6
Views
4,052
Rufus Conn
Dmoz
What is 500 Internal Server Error ?
Replies
8
Views
5,863
24x7CSM
Maxwell
Difference in Static and Dynamic?
Replies
16
Views
6,434
ChristopherBGregory
Marc0
M-commerce Successful in India?
Replies
0
Views
2,441
Marc0
Latest Threads
K
Hello everyone
Replies
3
Views
151
Dr. McKay
K
Where can I buy reliable web hosting at the best price?
Replies
5
Views
178
Dr. McKay
JustHosting
40% OFF VPS in locations San Jose, Singapore, Dallas, Chicago and Dublin – Ends July 10!
Replies
0
Views
349
JustHosting
Rameshsharama
What Defines Good Web Design in 2025?
Replies
2
Views
796
Harry P
Rameshsharama
Exploring the Range of Digital Services We Work With
Replies
1
Views
613
BlueLeaf
Recommended Threads
Holly Nicole
Why you need a dedicated shared host
Replies
4
Views
3,905
view
Dr. McKay
Online.net promo code?
Replies
8
Views
5,377
AlbaHost
Paul Wellner Bou
Do I need to have 2 IP addresses to create DNS?
Replies
4
Views
2,930
VirtuBox
RobinYork
WTB Fiverr - Online Marketing Gigs
Replies
6
Views
5,239
Archana
Marc0
Do you think Facebook will kill the forums?
2 3
Replies
41
Views
16,685
djsmiley2k
Similar Threads
J
Jtti How do I check if DNF5 is working properly?
Replies
5
Views
2,902
DediRock
Cheerag Nundlall
Checking Memcached Usage on WordPress Site?
Replies
12
Views
5,201
Mjlivera
Chris Worner
Monthly maintenance checklist for WHM/cPanel: What should I be checking and updating?
Replies
8
Views
4,196
Harry P
Kaz Wolfe
How to check the speed of your VPS server
Replies
0
Views
3,964
Kaz Wolfe
HostSailor
How to check DDoS attack?
Replies
3
Views
1,900
quadcloud

Latest postsNew threads

Latest Hosting OffersNew Reviews

Popular Contributors - Past 30 Days

Sponsors

Tag Cloud

You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.
  • cpanel
  • dedicated
  • free
  • hello
  • hosting
  • hosting services
  • marketing
  • offers
  • seo
  • server
  • services
  • vps
  • web
  • web hosting
  • website
  • wordpress
    • Top