Loading...
No monthly payments or hidden costs.
Websites from R1 650 ex vat
Hosting and e-mails for a year.
Websites with Hosting
from R2 460 ex vat
Online store. Platform allows unlimited products.
E-commerce website
from R13 500 ex vat
Directories, property websites and more...
Custom and advance websites
from R25 000 ex vat
By the only website design company first on google in SA.
Website Marketing
from R815 ex vat
Local and International solutions.
Hosting, E-mails and Domains
from R62.50 p/m ex vat

Robots.txt

Robots.txt is a text file on your website that instructs a robot what to index and how to crawl through your website. Often there are pages on a website that the company does not want displayed in search results, and a robots.txt file can help prevent that. These text files can also save on bandwidth by excluding photos, videos and JavaScript.

It is not obligatory to include a robot.txt file on your website but it is incredibly beneficial to an SEO campaign as it helps search engine robots to index the correct pages of a website. It does not prevent a robot from crawling your webpage, however it does instruct them on how to do so correctly. By doing so your search engine result ranking can be improved tremendously. Correct indexing is one of the key factors of a successful SEO campaign.

A robot.txt file will always be located in the main directory of your website in order to help the search engine robots to find it. This is because these robots are not specifically looking for these files, but will obey them when they come across them in the main directory. In your robot.txt file you can specify exactly which pages to disregard and this means that the search engine robot will focus solely on those files that have not been excluded.


Contact Form

Please complete the reCAPTCHA to help us reduce spam and to complete the form sending process. If you struggle to complete this form please email sales@websitedesign.co.za with your enquiry.

Contact Us

Sales
Development
086 111 5596 pm@websitedesign.co.za
Hosting