# All robots will spider the domain -- Disallow directories... User-agent: * Disallow: /cgi-bin/