# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * # Disallow: /public/search.html? Disallow: /public/search Disallow: /public/advanced Disallow: /public/videos.html