# matthew.KERWIN.net.au # robots.txt file for matthew.kerwin.net.au User-agent: * Sitemap: https://matthew.kerwin.net.au/sitemap.xml.php Sitemap: https://www.kerwin.net.au/sitemapindex.xml # Directories: #Disallow: /log-in/ # Files: Disallow: /400.shtml Disallow: /401.shtml Disallow: /403.shtml Disallow: /404.shtml Disallow: /406.shtml Disallow: /410.shtml Disallow: /500.shtml User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: /