User-agent: * Disallow: 404.php Disallow: /downloads/ Disallow: /id/*/thankyou.php Disallow: /webinars/