Moved here by moderator
This is not of support nature so I moved it where It seemed to fit in best.
To control the Bots you need to add a /robots.txt file at the root of the homepage. Not all Bots care about your wishes though. Here is an example from the Trisquel homepage: http://trisquel.info/robots.txt
As you can see not even the distro that his coding grace, Richard Stallman, recommends are prohibiting Google Bot. It just asks the bots to leave some parts of the forum alone and to read the pages at a slower rate to limit the impact on the servers, that's all.
In our case I don't think Linuxmint would last long without Google and other bots, so it's not an option here. I do understand why many get upset about them big companies though...