User-agent: * Disallow: /cgi-bin/ Disallow: /webalizer/ Disallow: /frequent-flyer-credit-card-application.php