There is an alternative way of blocking search bots from crawling your knowledge base. You can require login to access the knowledge base. In this case only people who have a username and password would be able to access your knowledge base.
To enable this:
- Go to Customization > Styling and Front-end Settings > Access.
- Set Access Mode option to "Authorization Required".