# /robots.txt file to disallow all spidering of this site. User-agent: * Disallow: /