# robots.txt indexing file

User-agent: *
Disallow: /redirect/
Disallow: /domains/checkup/*
Disallow: /domains/whois/*
Disallow: /domains/dnslookup/*
Disallow: /domains/punycode/*
Disallow: /ua/domains/checkup/*
Disallow: /ua/domains/whois/*
Disallow: /ua/domains/dnslookup/*
Disallow: /ua/domains/punycode/*
Disallow: /wiki/login
Disallow: /wiki?locale=ua
Disallow: /wiki?locale=en
Disallow: /wiki?locale=ru
Disallow: /tutorial

Sitemap: https://thehost.ua/sitemap.xml
Host: https://thehost.ua