User-Agent: * Allow: / Disallow: /catalogsearch/ajax/ Disallow: /js/ # Deny The Following Spiders User-agent: Soso Disallow: / User-agent: Yandex Disallow: / User-agent: Baidu Disallow: /