I use this as my robots.txt file. is it right?

Thread starter Marc0
Start date Mar 7, 2013

Marc0

Well-known member

Registered

#1

I use this for my robot.txt
example:

User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://www.domain.com/sitemap.xml.gz

as my wordpress site's robots.txt.

is it ok?

D

Deepak Kaushik

New member

#2

Yes, This is correct. Just a little bit you have to change in this coding in XML site URL remove ".gz" which is in last of the link.

W

WHUK

Member

Registered

#3

Nope, including the sitemap with .gz extension is correct. It's basically a compression used by the servers which is understandable by Google too. So shouldn't matter even if you remove it.

You must log in or register to reply here.

Share:

Facebook Twitter Reddit Pinterest Tumblr WhatsApp Email Link

Older Threads

How to check robots.txt on site?

Replies: 3

Views: 4,640

Dec 7, 2014

TejasWebHosting

What is email marketing? What are the types of email marketing?

Replies: 4

Views: 4,015

Apr 2, 2013

tayloralina

what is best tool create a logo

Marc0
Mar 7, 2013
Graphic Design

Replies: 12

Views: 6,111

Feb 23, 2014

Knightmedia

How we create a div in middile of any screen ?

Marc0
Mar 7, 2013
Website Design

Replies: 0

Views: 2,440

Mar 7, 2013

Marc0

how to create paging on php

Marc0
Mar 7, 2013
Web Programming

Replies: 1

Views: 3,075

Mar 7, 2013

Holly Nicole

Newer Threads

Facebook Advertisement?

Maxwell
Mar 7, 2013
Social Media

Replies: 6

Views: 4,467

Aug 16, 2013

Rufus Conn

What is 500 Internal Server Error ?

Replies: 8

Views: 6,558

Nov 11, 2016

24x7CSM

Difference in Static and Dynamic?

Maxwell
Mar 7, 2013
Website Design

Replies: 16

Views: 7,182

Oct 15, 2013

ChristopherBGregory

M-commerce Successful in India?

Marc0
Mar 7, 2013
Mobile Marketing

Replies: 0

Views: 2,721

Mar 7, 2013

Marc0

What type of website layout do you like?

Replies: 12

Views: 7,596

Oct 15, 2013

ChristopherBGregory

Latest Threads

✨ Welcome to 2026 with ForumWEB!

Replies: 1

Views: 595

Jan 3, 2026

Dr. McKay

D

Anonymous & Offshore VPS Hosting [Paid]

Replies: 1

Views: 410

Dec 18, 2025

ITivan80

J

WHMCS WhatsApp Notification module

jwn
Dec 12, 2025
Web Hosting

Replies: 1

Views: 561

Dec 13, 2025

ITivan80

Looking for AI models traffic

GNOM
Dec 12, 2025
Web Hosting Requests

Replies: 0

Views: 239

Dec 12, 2025

GNOM

Hi everyone!

Replies: 0

Views: 250

Dec 11, 2025

mobihub

Recommended Threads

Building backlinks to your blogs?

Replies: 4

Views: 5,116

Jul 9, 2015

kian.j

What to do if your hosting is becoming bad?

OnaDavney
Oct 30, 2020
Web Hosting

Replies: 10

Views: 4,309

Jan 8, 2021

WerdPressEh

Earn through Facebook?

Marc0
Oct 20, 2014
Make Money Online

Replies: 1

Views: 3,279

Oct 20, 2014

ericplotz1

Hi out there.

Replies: 9

Views: 4,380

Feb 16, 2020

Require

Should I buy a premium domain name?

Gmeister4
May 21, 2017
Domain Names

Replies: 6

Views: 4,794

May 22, 2017

Matt Eberlie

Similar Threads

Crawl delay in robots.txt?

Replies: 5

Views: 4,628

Nov 13, 2018

royceD

The difference between Robots.txt and Robot Meta Tag

Replies: 1

Views: 2,278

Mar 19, 2015

elcidofaguy

How to set up a robots.txt to control Google spider crawl my site?

Replies: 2

Views: 2,873

Jan 27, 2015

Hassan

How to check robots.txt on site?

Replies: 3

Views: 4,640

Dec 7, 2014

TejasWebHosting

M

How to edit Robots.txt in blogger?

Replies: 2

Views: 3,500

Mar 29, 2013

zebrathemes

Latest hosting offers
- Anonymous & Offshore VPS Hosting
  Bulletproof, Anonymous & Offshore VPS Hosting Provider
  
  darkvpspro
  
  Updated: Dec 16, 2025
- Hostaddon VPS/VDS | EU/US/ASIA | 25/10/2/1 Gbps | SSD NVMe | Upto 50% Off | Storage | DMCA Ignore
  Unmetered 1, 10, 25 Gbps Unmetered VPS Hosting
  
  HostAddon
  
  Updated: Oct 1, 2025
- 30 Days Free VPS Windows or Linux with Monthly Contract backed by NVMe SSD SAN
  VPS customisble resources
  
  trulycloud
  
  Updated: Sep 29, 2025

Popular Contributors - Past 30 Days

B
14
F
11
L
10
8
6
5
5
U
5
G
4
P
4
S
4
R
3
C
2
2
2

Sponsors

Tag Cloud

Top