Here is search logs of 650,000 AOL users. It's very interesting to view search history of particular person and analyze his personality. Let's do it together! Read more about AOL search database scandal or view research papers on web searching.
SELFHTML: Diverse technische Erg\303\244nzungen / robots.txt - Robots kontrollieren
Anleitung von SelfHtml zur Zugriffskontrolle für Suchmaschinen mit der robots.txt-Datei.