Tools

Block web bots from indexing KB content

Author: Edward Hardin Reference Number: AA-00404 Views: 9063 Last Updated: 12/06/2010 11:04 AM

0 Rating/ Voters

As for blocking web bots from indexation of your knowledge base, you should just add one line to the 'head' section of each layout in Manage Templates module:

Go to the "Customization" > "Manage Templates".
If you're using customized front-end theme, chose it from the themes list and go to the step 4.
If you're using standart theme (Theme1 or Theme2, for example), you need to create your own theme (it is simple, just follow this Front-end customization and styling tutorial).
Expand the layouts tree.
Add following code to the <head></head> section of each layout and click "Apply" to apply changes.
<meta name="robots" content="noindex" />
You'll get something like this for each layout code:
Article layout fragment
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<link rel="icon" href="%%base_href%%favicon.ico" type="image/x-icon" />
<title>%%var.PageTitle%%</title>
<meta name="keywords" content="%%var.MetaKeyWords%%" />
<meta name="Description" content="%%var.MetaDescription%%" />
<meta name="robots" content="noindex" />

<link rel="stylesheet" type="text/css" href="%%base_href%%css" />

<script type="text/javascript">
            emptyImageUrl = '%%base_url%%js/js-local/build/images/s.gif';
                        base_href = '%%base_href%%';
                        i18n = %%i18n%%;
                        system = %%system%%;
useVoitingCom = %%sistem.useVoitingCom%%;
                        email ='%%system.useremail%%';
                       name='%%system.username%%';
</script>
<script type="text/javascript" src="%%base_url%%js/js-local/build/lite-build.js"></script>
<script type="text/javascript" src="%%base_url%%js/local/article_tools.js"></script>
<script type="text/javascript" src="%%base_url%%js/local/gateway_ask_question.js"></script>
</head>

Alternative

There is an alternative way of blocking search bots from crawling your knowledge base. You can require login to access the knowledge base. In this case only people who have a username and password would be able to access your knowledge base.

To enable this:

Go to Customization > Styling and Front-end Settings > Access.
Set Access Mode option to "Authorization Required".