Here is search logs of 650,000 AOL users. It's very interesting to view search history of particular person and analyze his personality. Let's do it together! Read more about AOL search database scandal or view research papers on web searching.
New Robots.txt Syntax Checker: a validator for robots.txt files
Analyzes a robots.txt file searching for syntax and "logical" errors, and shows a summary of what effect it will have.