# www.robotstxt.org/ # XML sitemap Sitemap: https://www.twint.ch/sitemap_index.xml # Allow crawling of all content User-agent: * Disallow: # WordPress specific rules Disallow: /content/languages/ Disallow: /content/cache/ Disallow: /content/w3tc-config/ Disallow: /content/upgrade/ Disallow: /wp-system # Disallow annoying bots User-agent: Linguee bot Disallow:/