Standard robots.txt file for WordPress Websites
Below is the standard robots.txt file for most of the WordPress website. You can change it as per your requirements😊
# The code starts hereUser-agent: *Disallow: /cgi-bin/Disallow: /wp-admin/Disallow: /search?q=*Disallow: /readme.htmlDisallow: /wp-includes/Disallow: /wp-content/Allow: /wp-admin/admin-ajax.phpAllow: /wp-includes/*.jsAllow: /wp-includes/*.cssAllow: /wp-content/cache/*.jsAllow: /wp-content/cache/*.cssAllow: /wp-content/cache/*.gzipAllow: /wp-content/themes/*.jsAllow: /wp-content/themes/*.cssAllow: /wp-content/themes/*.ttfAllow: /wp-content/themes/*.woffAllow: /wp-content/themes/*.svgAllow: /wp-content/plugins/*.jsAllow: /wp-content/plugins/*.cssAllow: /wp-content/plugins/*.ttfAllow: /wp-content/plugins/*.woffAllow: /wp-content/plugins/*.svgAllow: /wp-content/uploads/*.jpgAllow: /wp-content/uploads/*.pngAllow: /wp-content/uploads/*.gifAllow: /wp-content/uploads/*.mp3Allow: /wp-content/uploads/*.mp4Allow: /wp-content/uploads/*.ogg# The code ends here
Thanks
Comments
Post a Comment