Using Titles and Category Names from Editor-driven Taxonomies for Automatic Evaluation
By Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury and David Grossman. Illinois Institute of Technology, USA. In: Proceedings of the twelfth international conference on Information and knowledge management, 2003. Evaluation of IR systems has always been difficult because of the need for manually assessed relevance judgments: large editor-driven taxonomies on the web make a new evaluation approach possible. ODP´s taxonomy is used to compare and contrast two methodologies.