---
title: "Please describe robots.txt, do-follow and no-follow?"  
description: "Please describe robots.txt, do-follow and no-follow?"  
author: "Anonymous User"  
published: 2020-12-11  
updated: 2020-12-11  
canonical: https://www.mindstick.com/forum/156333/please-describe-robots-txt-do-follow-and-no-follow  
category: "digital marketing"  
tags: ["seo", "digital marketing", "search engine optimization"]  
reading_time: 1 minute  

---

# Please describe robots.txt, do-follow and no-follow?

1. [robots.txt](https://www.mindstick.com/articles/337838/why-is-robots-txt-important-for-seo-tutorial-for-beginners)
2. do-follow
3. no-follow

## Replies

### Reply by Anshu Dwivedi

**Robot.txt** is a file tells search engine crawlers which pages or file the crawler can or can't request from your site. This file is used to avoid overloading your site with requests.

## Why Robot.txt Is Use

robot.txt is used basically used to manage crawler traffic to your site and usually to keep the site and usually to keep a page off google depending on the file type.

If you want to block your page from search results you can try another method such as password protection or non-index directive.

**Do-Follow Link**: When we give do follow to any link means we are giving a signal to google crawler to pass the authority. If you have given do follow to any popular and prestigious site then it gives a correct signal to google about your site.

**No, Follow**: When you give no follow to any link it means you don't want to pass authority to that site.


---

Original Source: https://www.mindstick.com/forum/156333/please-describe-robots-txt-do-follow-and-no-follow

Copyright © MindStick Software Pvt. Ltd. This Markdown version is provided for developers, AI systems, and offline reading.