|Administrator Help - RC v3.3|
Chapter - 8.1 Content exclusion list
robots.txt is a text file which may be placed at the root of your web site. This file contains a set of instructions for SE robots to ignore specified pages and folders. The file must be properly formatted for robot to understand it and must be located at the root of your website.
RC comes with a preset robots.txt file. The vast majority of classified board pages, scripts, and folders do not require indexing. If you place RC into some folder off the root, then you need to move robots.txt to the site root and in addition modify path to RC pages and folders in robots.txt file (path to folders must start with "/"). For more information regarding robots.txt file syntax, navigate to: http://www.robotstxt.org/orig.html
|©2003-2010 Rapid Classified v3.3 GA Soft|