I use this as my robots.txt file. is it right?

Thread starter Marc0
Start date Mar 7, 2013

Marc0

Well-known member

Registered

#1

I use this for my robot.txt
example:

User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://www.domain.com/sitemap.xml.gz

as my wordpress site's robots.txt.

is it ok?

D

Deepak Kaushik

New member

#2

Yes, This is correct. Just a little bit you have to change in this coding in XML site URL remove ".gz" which is in last of the link.

W

WHUK

Member

Registered

#3

Nope, including the sitemap with .gz extension is correct. It's basically a compression used by the servers which is understandable by Google too. So shouldn't matter even if you remove it.

You must log in or register to reply here.

Share:

Facebook Twitter Reddit Pinterest Tumblr WhatsApp Email Link

Older Threads

How to check robots.txt on site?

Replies: 3

Views: 4,560

Dec 7, 2014

TejasWebHosting

What is email marketing? What are the types of email marketing?

Replies: 4

Views: 3,916

Apr 2, 2013

tayloralina

what is best tool create a logo

Marc0
Mar 7, 2013
Graphic Design

Replies: 12

Views: 6,070

Feb 23, 2014

Knightmedia

How we create a div in middile of any screen ?

Marc0
Mar 7, 2013
Website Design

Replies: 0

Views: 2,372

Mar 7, 2013

Marc0

how to create paging on php

Marc0
Mar 7, 2013
Web Programming

Replies: 1

Views: 3,034

Mar 7, 2013

Holly Nicole

Newer Threads

Facebook Advertisement?

Maxwell
Mar 7, 2013
Social Media

Replies: 6

Views: 4,396

Aug 16, 2013

Rufus Conn

What is 500 Internal Server Error ?

Replies: 8

Views: 6,445

Nov 11, 2016

24x7CSM

Difference in Static and Dynamic?

Maxwell
Mar 7, 2013
Website Design

Replies: 16

Views: 7,071

Oct 15, 2013

ChristopherBGregory

M-commerce Successful in India?

Marc0
Mar 7, 2013
Mobile Marketing

Replies: 0

Views: 2,669

Mar 7, 2013

Marc0

What type of website layout do you like?

Replies: 12

Views: 7,492

Oct 15, 2013

ChristopherBGregory

Latest Threads

J

WHMCS WhatsApp Notification module

jwn
Yesterday at 7:21 PM
Web Hosting

Replies: 1

Views: 61

Today at 5:29 AM

ITivan80

Hello

Ravel
Thursday at 7:14 AM
New Member Introductions

Replies: 1

Views: 76

Today at 5:25 AM

ITivan80

Buy your Mobile Proxy 4G/5G for Spain, USA, Colombia, Chile

Proxysolid
Nov 26, 2025
Services

Replies: 0

Views: 121

Nov 26, 2025

Proxysolid

How to read Exim mail logs on the server?

LitaR
Nov 20, 2025
Web Hosting

Replies: 2

Views: 729

Nov 27, 2025

ITivan80

hi, hope to connect with everyone here!

Replies: 4

Views: 571

Dec 2, 2025

apexgasgen

Recommended Threads

Can WHM/cpanel share on multi servers?

Replies: 4

Views: 4,064

Jun 13, 2022

Harry P

Hello to All

Replies: 6

Views: 2,675

Nov 29, 2017

HostOX

KVM vs Xen PV

m19
Jul 16, 2017
VPS Hosting

Replies: 8

Views: 7,127

Jul 21, 2017

m19

Hide entry-title on home page

Replies: 0

Views: 2,574

Mar 22, 2013

jdunhin

Hello from TLC Hosting

Replies: 8

Views: 4,201

Jun 13, 2017

robert4u

Similar Threads

Crawl delay in robots.txt?

Replies: 5

Views: 4,371

Nov 13, 2018

royceD

The difference between Robots.txt and Robot Meta Tag

Replies: 1

Views: 2,235

Mar 19, 2015

elcidofaguy

How to set up a robots.txt to control Google spider crawl my site?

Replies: 2

Views: 2,836

Jan 27, 2015

Hassan

How to check robots.txt on site?

Replies: 3

Views: 4,560

Dec 7, 2014

TejasWebHosting

M

How to edit Robots.txt in blogger?

Replies: 2

Views: 3,394

Mar 29, 2013

zebrathemes

Popular Contributors - Past 30 Days

P
23
F
15
13
12
R
12
S
12
11
H
9
8
A
7
D
5
B
4
4
4
J
4

Sponsors

Tag Cloud

Top