# Allow all URLs (see http://www.robotstxt.org/robotstxt.html) User-agent: * Crawl-delay: 20 Allow: / Disallow: /cgi-bin/ Disallow: /loginwa Disallow: /loginph Sitemap: https://www.yellowpages.ae/sitemap.xml