User-agent: * Disallow: /web/_archived Disallow: /web/CGI-BIN/ Disallow: /web/css/ Disallow: /web/db/ Disallow: /web/ftp_fldes/ Disallow: /web/includes/ Disallow: /web/links/ Disallow: /web/members_only/ Disallow: /web/scripts/