TY - JOUR AB - Purpose– The purpose of this article is to look into relevance ranking and its importance in trying to bring some order to the deluge of results in response to a query.Design/methodology/approach– A large‐scale analysis of detailed web logs of various search engines was performed. Sample tests were made on five to eight versions of MEDLINE, ERIC, and PsycINFO on hosts which have comparable versions of the databases and offer relevance ranking.Findings– It was found that, for fairness, it must be ensured that the implementations are identical, they have the same retrospective coverage, the same MEDLINE/PubMed subsets, and (quasi) identical update.Research limitations/implications– The tests were made early September 2005. As databases are updated at different times, perfect synchronicity is not easy to achieve. When new records are added to the database, they may change the ranking of the test result set. Similarly, a small change in the fine‐tuning of the algorithm may yield different rank order positions of the same record the next time.Originality/value– Brings together important research findings and suggests a topic for the next column. VL - 29 IS - 6 SN - 1468-4527 DO - 10.1108/14684520510638106 UR - https://doi.org/10.1108/14684520510638106 AU - Jacsó Péter PY - 2005 Y1 - 2005/01/01 TI - Relevance in the eye of the search software T2 - Online Information Review PB - Emerald Group Publishing Limited SP - 676 EP - 682 Y2 - 2024/03/29 ER -