Add URL to search-engines
Do not use this feature at the early stage of site development.
Alta-Vista Search and their spider Scooter
Sending our URL to Scooter the Alta-Vista spy, will make Scooter watching our
content of the site (including all links to other documents) in regular time intervals.
So you just have to send the URL of our Homepage
http://tek.flynet.de/index.htm
Feel free to modify the robots.txt file.If you want to
hide any information on our site, please modify the /tek/robots.txt file.
This file will be readed by spiders like Scooter.
Please add directories which you don't want bots to look in.
(e.g. Administrator stuff, Beta-pages etc.)
User-agent: *
Disallow: /ADMIN
Add your directory to that file.
Syntax:
Disallow: Directory
Note: This administrator action shouldn't be captured in the history file.
Add/Remove URL to AltaVista/Scooter
|
updated on
administrator
|
21-Aug-1997
plex
|
|
