---
title: "What is robots.txt?"  
description: "What is robots.txt?"  
author: "Anonymous User"  
published: 2020-11-26  
updated: 2020-11-26  
canonical: https://www.mindstick.com/forum/156097/what-is-robots-txt  
category: "negative seo"  
tags: ["seo"]  
reading_time: 1 minute  

---

# What is robots.txt?

What is [robots.txt](https://www.mindstick.com/articles/337838/why-is-robots-txt-important-for-seo-tutorial-for-beginners)?

## Replies

### Reply by Anshu Dwivedi

A robot .txt file tells search engine crawlers which pages or file the crawler can,t request from your site. This is used mainly to avoid overloading your site with the request, it is not a mechanism for keeping a web page out of google.


---

Original Source: https://www.mindstick.com/forum/156097/what-is-robots-txt

Copyright © MindStick Software Pvt. Ltd. This Markdown version is provided for developers, AI systems, and offline reading.