Robot policy is used to tell web crawlers and other tools what to exclude.
Configuration settings
- $wgDefaultRobotPolicy - Default robot exclusion policy for the wiki.
- $wgArticleRobotPolicies - Allow customization of robot policies on a per-article basis.
- $wgExemptFromUserRobotsControl - An array of namespace keys in which the __INDEX__/__NOINDEX__ magic words will not function.
- $wgNamespaceRobotPolicies - Allow customization of robot policies on a per-namespace basis.
Robot policy | ||
|---|---|---|
| Files | robots.txt |  |
| Attributes |
| |
| Configuration settings |
| |
This article is issued from Mediawiki. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.