Sitemap: https://www.clinicsource.com/sitemap_index.xml # this custom robots.txt file has been created for this domain and uploaded to root of server to overwrite WP Engine's default robots.txt file in order to remove the Disallow: /wp-admin/ This was done for SEO reasons per Rich Owings suggestion. User-agent: * Allow: /wp-admin/admin-ajax.php Disallow: */xmlrpc.php # removed since was causing resources to be blocked according to GSC. Disallow: */wp-*.php Disallow: */trackback/ Disallow: *?wptheme= Disallow: *?comments= Disallow: *?replytocom Disallow: */comment-page- Disallow: *?s=