# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 User-agent: * Disallow: /login* Disallow: /register* Disallow: /viewarticle/s/* Disallow: /s/* User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: PerplexityBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: Arquivo-web-crawler Disallow: / Sitemap: https://www.univadis.it/sitemap-index.xml