User-agent: * # this directs to all spiders who access this file Disallow: /announcements/ Disallow: /images/ Disallow: /admin/ Disallow: /calendars/ Disallow: /events/ Disallow: /features/