Welcome
to our free code generators:
Check out
the different code generators below which are all free
to use. We hope that is helps make your job easier, or
enhances your site in some way. We offer a number of
other free services that you can use at your leisure,
including, FREE Site Submit, FREE SE Ranker. We hope
that you come back often to use all of our free
services. We will be adding more free services as we
either acquire, or develop them.
Robots.txt Generator
INSTRUCTIONS (please read carefully):
1. Select a user agent (robot) in the left column. The default is "ALL User Agents", then click on the "ADD USER AGENT" button. 2. Type in directories and/or web pages that you do not want indexed, then click on the "ADD" button. Make sure there is a forward "slash" in-between directories and pages, and at the end of directories (indicated in red below). Repeat this
step until you have added all of the files you want under the "User Agent". If you don't want a user agent to index ANY of your site, LEAVE THE TEXTFIELD BLANK and click on the "ADD" button. A "/" will appear after "Disallow:" in the code below. 3. Once step 2 is complete, you may repeat steps 1 & 2 again until you have added all of the "User Agents" you want, and files under each that you want to "Disallow". 4. When complete, click on "COPY CODE" to save the robots.txt code.
Robots.txt Generator
Select a User Agent
Add directories/files you DO NOT want indexed
Directory/Page.html >
Three Examples: 1:
folderName/myPage.html
2:
folderName/
3:
myPage.html
Copy and paste the code into a text file and name it "robots.txt", then upload it into your root directory where your "index" page is.
For example: http://www.MySite.com/robots.txt
