# robots file to prevent web crawlers User-agent: * Disallow: /