I use this as my robots.txt file. is it right?

Thread starter Marc0
Start date Mar 7, 2013

Marc0

Well-known member

Registered

#1

I use this for my robot.txt
example:

User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://www.domain.com/sitemap.xml.gz

as my wordpress site's robots.txt.

is it ok?

D

Deepak Kaushik

New member

#2

Yes, This is correct. Just a little bit you have to change in this coding in XML site URL remove ".gz" which is in last of the link.

W

WHUK

Member

Registered

#3

Nope, including the sitemap with .gz extension is correct. It's basically a compression used by the servers which is understandable by Google too. So shouldn't matter even if you remove it.

You must log in or register to reply here.

Share:

Facebook Twitter Reddit Pinterest Tumblr WhatsApp Email Link

Older Threads

How to check robots.txt on site?

Replies: 3

Views: 4,051

Dec 7, 2014

TejasWebHosting

What is email marketing? What are the types of email marketing?

Replies: 4

Views: 3,428

Apr 2, 2013

tayloralina

what is best tool create a logo

Marc0
Mar 7, 2013
Graphic Design

Replies: 12

Views: 5,718

Feb 23, 2014

Knightmedia

How we create a div in middile of any screen ?

Marc0
Mar 7, 2013
Website Design

Replies: 0

Views: 2,125

Mar 7, 2013

Marc0

how to create paging on php

Marc0
Mar 7, 2013
Web Programming

Replies: 1

Views: 2,737

Mar 7, 2013

Holly Nicole

Newer Threads

Facebook Advertisement?

Maxwell
Mar 7, 2013
Social Media

Replies: 6

Views: 3,944

Aug 16, 2013

Rufus Conn

What is 500 Internal Server Error ?

Replies: 8

Views: 5,714

Nov 11, 2016

24x7CSM

Difference in Static and Dynamic?

Maxwell
Mar 7, 2013
Website Design

Replies: 16

Views: 6,231

Oct 15, 2013

ChristopherBGregory

M-commerce Successful in India?

Marc0
Mar 7, 2013
Mobile Marketing

Replies: 0

Views: 2,398

Mar 7, 2013

Marc0

What type of website layout do you like?

Replies: 12

Views: 6,405

Oct 15, 2013

ChristopherBGregory

Latest Threads

G

Hi guys! I am new here

Replies: 1

Views: 132

Monday at 10:51 AM

AlbaHost

What’s Your #1 Strategy for Sustaining and Growing a Hosting Business?

Replies: 0

Views: 223

May 29, 2025

Maxoq

PHP 8.x vs PHP 7.x for WordPress: Worth the Upgrade?

Replies: 2

Views: 198

Monday at 11:15 AM

DariaVPS

How do You Ensure Peak Performance on a Dedicated Server without Overspending?

Maxoq
May 29, 2025
Dedicated Server

Replies: 1

Views: 371

Tuesday at 4:04 AM

ITivan80

How Do You Squeeze the Best Performance Out of a Shared Hosting Plan?

Maxoq
May 29, 2025
Web Hosting

Replies: 0

Views: 105

May 29, 2025

Maxoq

Recommended Threads

24 HR Orders on your website

Replies: 6

Views: 5,376

Jan 12, 2018

NineWeb

Getting the right web host for your business site

DDSvpsHost
Dec 8, 2015
Web Hosting

Replies: 14

Views: 7,703

Jan 18, 2016

sclaeys

WordPress Admin Panel Loads very Slowly

vishwa
Jan 23, 2016
Website Design

Replies: 9

Views: 4,844

Jan 24, 2016

Developer

Difference between Software Raid and Hardware Raid?

Replies: 9

Views: 4,956

Jun 26, 2018

Daniel204

Company name suggestion !

Replies: 11

Views: 7,270

Jul 1, 2014

hipcat

Similar Threads

Crawl delay in robots.txt?

Replies: 5

Views: 3,381

Nov 13, 2018

royceD

The difference between Robots.txt and Robot Meta Tag

Replies: 1

Views: 1,995

Mar 19, 2015

elcidofaguy

How to set up a robots.txt to control Google spider crawl my site?

Replies: 2

Views: 2,511

Jan 27, 2015

Hassan

How to check robots.txt on site?

Replies: 3

Views: 4,051

Dec 7, 2014

TejasWebHosting

M

How to edit Robots.txt in blogger?

Replies: 2

Views: 3,006

Mar 29, 2013

zebrathemes

Latest hosting offers
- DARKVPS - Cheap Bare Metal RDP - 4vCPU-128vCPU - Anti Suspend - Renewable - Start $48
  We offer physical servers set up exclusively for you – one server per user, no sharing!
  
  darkvps
  
  Updated: May 28, 2025
- Hostaddon - EU/US/ASIA | 1Gbit/10Gbit Unmetered Servers | Start @$14.99 | Additional 10% Off
  Premium Hardware @ Affordable prices
  
  HostAddon
  
  Updated: May 7, 2025
- Hostaddon.com | 50% Off | Unlimited Disk + Traffic | Litespeed, SSD | From $1.99 | US, UK, AU, BG
  Unlimited Premium Shared Litespeed Hosting
  
  HostAddon
  
  Updated: May 6, 2025

Popular Contributors - Past 30 Days

6
6
6
6
6
H
5
5
4
3
2
B
2
2
H
2
L
2
2

Sponsors

Tag Cloud

Top