Standard robots.txt file for WordPress Websites

 Below is the standard robots.txt file for most of the WordPress website.  You can change it as per your requirements😊


# The code starts here
User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /search?q=*
Disallow: /readme.html
Disallow: /wp-includes/
Disallow: /wp-content/
Allow: /wp-admin/admin-ajax.php
Allow: /wp-includes/*.js
Allow: /wp-includes/*.css
Allow: /wp-content/cache/*.js
Allow: /wp-content/cache/*.css
Allow: /wp-content/cache/*.gzip
Allow: /wp-content/themes/*.js
Allow: /wp-content/themes/*.css
Allow: /wp-content/themes/*.ttf
Allow: /wp-content/themes/*.woff
Allow: /wp-content/themes/*.svg
Allow: /wp-content/plugins/*.js
Allow: /wp-content/plugins/*.css
Allow: /wp-content/plugins/*.ttf
Allow: /wp-content/plugins/*.woff
Allow: /wp-content/plugins/*.svg
Allow: /wp-content/uploads/*.jpg
Allow: /wp-content/uploads/*.png
Allow: /wp-content/uploads/*.gif
Allow: /wp-content/uploads/*.mp3
Allow: /wp-content/uploads/*.mp4
Allow: /wp-content/uploads/*.ogg
# The code ends here


Thanks

Comments

Popular posts from this blog

AVT Khyber TV Live Streaming

HTTP Live Streaming(HLS) With VAST by Using Fluid Player

WordPress Security(Part 07) by Sajid Javed