user-agent: * Crawl-Delay: 10 disallow: /admin/ disallow: /auth/ disallow: /add/ disallow: /edit/ disallow: /comments/ disallow: /email/ disallow: /random/ disallow: /text/ disallow: /latest/ disallow: /cgi-bin/ Disallow: /forjesus-d5/ Disallow: /forjesus-d6/ disallow: /forjesus/admin Disallow: /forjesus/ImageMagick Disallow: /forjesus/acidfree_tmp Disallow: /forjesus/files Disallow: /forjesus/includes Disallow: /forjesus/misc Disallow: /forjesus/node/ Disallow: /forjesus/comment/reply Disallow: /forjesus/aggregator Disallow: /forjesus/tracker Disallow: /forjesus/node/add Disallow: /forjesus/search Disallow: /forjesus/book/print Disallow: /forjesus/user-list Disallow: /forjesus-d5/ Disallow: /forjesus-d6/ Disallow: /forjesus/database/ Disallow: /forjesus/includes/ Disallow: /forjesus/misc/ Disallow: /forjesus/modules/ Disallow: /forjesus/sites/ Disallow: /forjesus/themes/ Disallow: /forjesus/scripts/ Disallow: /forjesus/updates/ Disallow: /forjesus/profiles/ # Files Disallow: /xmlrpc.php Disallow: /cron.php Disallow: /update.php Disallow: /install.php Disallow: /INSTALL.txt Disallow: /INSTALL.mysql.txt Disallow: /INSTALL.pgsql.txt Disallow: /CHANGELOG.txt Disallow: /MAINTAINERS.txt Disallow: /LICENSE.txt Disallow: /UPGRADE.txt # Paths (no clean URLs) User-agent: * Crawl-Delay: 10 Disallow: /?q=aggregator Disallow: /?q=tracker Disallow: /?q=comment/reply Disallow: /?q=node/add Disallow: /?q=user Disallow: /?q=files Disallow: /?q=search Disallow: /?q=book/print