GetDevDone Blog

Insights into the world of technologies and business for IT professionals and agency owners.

Robots.txt (2 Articles)

Markup, Web Development
December 2nd, 2021
9 min

Robots.txt: What, When, and Why

Do you know that preventing search engines from accessing and indexing some pages on your site can can be beneficial both for your SEO and your privacy? Read this post and you will learn how to achieve this by changing the contents of a small but extremely important file - robots.txt.

Web Development
November 24th, 2021
12 min

Learn How to Noindex a Page Wisely

This post is your ultimate guide to noindexing web pages. You will learn why you need to noindex a page, what nonindexing methods you can apply, and other essentials.