# Sat, 11 Mar 2006 10:24:45 -0500 # Exclude Files From All Robots: User-agent: * Disallow: /offers/ Disallow: /cheap-holidays/connect/ Disallow: /bfs/offers/ Disallow: /flights/offers/ Disallow: /flights/thompsonfly/thomholidaysearch.html Disallow: /flights/thompsonfly/thomsearch.html Disallow: /flights/thompsonfly/TV.html # End robots.txt file