# If the Joomla site is installed within a folder such as at # e.g. www.example.com/joomla/ the robots.txt file MUST be # moved to the site root at e.g. www.example.com/robots.txt # AND the joomla folder name MUST be prefixed to the disallowed # path, e.g. the Disallow rule for the /administrator/ folder # MUST be changed to read Disallow: /joomla/administrator/ # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://tool.motoricerca.info/robots-checker.phtml User-agent: * Allow: /components/com_jshopping/files/importexport/imaudexportyml/ Allow: /components/com_jshopping/files/img_products/ Disallow: /administrator/ Disallow: /bin/ Disallow: /cache/ Disallow: /cli/ Disallow: /components/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /layouts/ Disallow: /libraries/ Disallow: /logs/ Disallow: /modules/ Disallow: /plugins/ Disallow: /tmp/ Disallow: /*id Disallow: /*admin Disallow: /*cart Disallow: /bin/ Disallow: /cache/ Disallow: /component/ Disallow: /includes/ Disallow: /css/ Disallow: /log/ Disallow: /media/ Disallow: /js/ Disallow: /templates/ Disallow: /jssort/ Disallow: /*mailto* Disallow: /*start* Disallow: /*print* Disallow: /*feed* Disallow: /*search* Disallow: /*users* Disallow: /*.pdf Disallow: /*? Disallow: /*?* Disallow: /output/ Disallow: /*search Disallow: /registr.html Disallow: /politika-konfidentsialnosti.html Disallow: /*% Disallow: /index.php Disallow: /*user/ Disallow: /404 Clean-param: searchword / Crawl-delay: 5 Host: www.mobicomshop.ru