# Website Sitemap


Sitemap: https://www.shayabycaratlane.com/sitemap.xml 

Ensure these sitemaps are also declared in Google Search Console (Sitemaps tab) -  not just here.


User-agent: SemrushBot
Disallow: /
(Semrush’s correct bot name is SemrushBot)


# Directories
User-agent: *


Disallow: /cgi-bin/


# Clean Silver URLS
Disallow: /silver-/?
Disallow: /silver/?*


Disallow: */collections/*filter*&*filter*
Disallow: */product/*-??*-??*.html

# Cart Checkout Pages
Disallow: /cart
Disallow: /orders
Disallow: /checkouts/
Disallow: /checkout
Disallow: /carts
Disallow: /search


User-agent: *
Disallow: /*?sort=
This rule blocks all URLs that contain the ?sort= parameter for example:
https://www.caratlane.com/silver/?sort=latest


# Purity Pages - Adwords agent
User-Agent: AdsBot-Google
Disallow: /*by-purity*
Disallow: /*by-purity&_escaped_fragment_*


Disallow: /*.php$


Disallow: /*?p=*&


Disallow: /*?SID=


#Disallow: /*?


# Crawlers Setup


User-agent: AhrefsBot
Disallow: /


User-agent: Yandex
Disallow: /


User-agent: moget
Disallow: /


User-agent: ichiro
Disallow: /


User-agent: NaverBot
Disallow: /


User-agent: Yeti
Disallow: /


User-agent: Baiduspider
Disallow: /


User-agent: Baiduspider-video
Disallow: /


User-agent: Baiduspider-image
Disallow: /


User-agent: YoudaoBot
Disallow: /


#########################