User-Agent: *# Disallow all crawlers access to certain pages. Disallow: /eskisite Disallow: /Scripts Disallow: /js Allow: /