# This robots.txt file requests that search engines and other # automated web-agents don't try to index the files in this # directory (/). This file is required in the event that you # use OpenX without virtual domains (i.e. you use a single URL # to run both the admin interface and the delivery engine), # and have the web root set to this directory. User-agent: * Disallow: /adserver/ Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content Disallow: /tag Disallow: /author Disallow: /paper-links.php User-agent: Mediapartners-Google Allow: / User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Mobile Allow: /