How to enable robots.txt publicly

Hello everyone,

I try to use a custom robots.txt file on RT apache instance but it seems
this file is not publicly accessible online so web robots can’t read the
file.

Can someone explain how to make this file public and makes this works ?

Thanks.

I try to use a custom robots.txt file on RT apache instance but it seems this file is not publicly accessible online so web robots can’t read the file.
Can someone explain how to make this file public and makes this works ?

Thanks.

Sébastien,

The robots.txt file needs to be in the root directory of the server. If you’re using something like ipplan.domain.tld then drop the robots.txt file into the same directory where the server grabs the default page from.

If you’re using your.domain.tld/ipplan then you must do the above.

The College of New Caledonia
Visit us at http://www.cnc.bc.ca
Virus scanning is done on all incoming and outgoing email.
Anti-spam information for CNC can be found at http://gateway.cnc.bc.ca