User-agent: * Disallow: /visit.php Disallow: /go/* Disallow: /not-found/ Disallow: /terms/ Disallow: /privacy-policy/