This paper proposes the evaluation methods for measuring retrieval effectiveness of Web search engine systems, attempting to make them suitable for real Web environment. With this objective, we constructed 100-gigabyte and 10-gigabyte document sets that were mainly gathered from the '.jp' domain, and conducted an evaluation workshop at the third NTCIR Workshop from 2001 to 2002, where we assessed the retrieval effectiveness of a certain number of Web search engine systems using the common data set. Conventional evaluation workshops assessed the relevance of the retrieved documents, which were submitted by the workshop participants, by considering the contents of individual pages. On the other hand, we assessed the relevance of the retrieved pages by considering the relationship between the pages referenced by hyperlinks.
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Copy
Koji EGUCHI, Keizo OYAMA, Emi ISHIDA, Noriko KANDO, Kazuko KURIYAMA, "Evaluation Methods for Web Retrieval Tasks Considering Hyperlink Structure" in IEICE TRANSACTIONS on Information,
vol. E86-D, no. 9, pp. 1804-1813, September 2003, doi: .
Abstract: This paper proposes the evaluation methods for measuring retrieval effectiveness of Web search engine systems, attempting to make them suitable for real Web environment. With this objective, we constructed 100-gigabyte and 10-gigabyte document sets that were mainly gathered from the '.jp' domain, and conducted an evaluation workshop at the third NTCIR Workshop from 2001 to 2002, where we assessed the retrieval effectiveness of a certain number of Web search engine systems using the common data set. Conventional evaluation workshops assessed the relevance of the retrieved documents, which were submitted by the workshop participants, by considering the contents of individual pages. On the other hand, we assessed the relevance of the retrieved pages by considering the relationship between the pages referenced by hyperlinks.
URL: https://global.ieice.org/en_transactions/information/10.1587/e86-d_9_1804/_p
Copy
@ARTICLE{e86-d_9_1804,
author={Koji EGUCHI, Keizo OYAMA, Emi ISHIDA, Noriko KANDO, Kazuko KURIYAMA, },
journal={IEICE TRANSACTIONS on Information},
title={Evaluation Methods for Web Retrieval Tasks Considering Hyperlink Structure},
year={2003},
volume={E86-D},
number={9},
pages={1804-1813},
abstract={This paper proposes the evaluation methods for measuring retrieval effectiveness of Web search engine systems, attempting to make them suitable for real Web environment. With this objective, we constructed 100-gigabyte and 10-gigabyte document sets that were mainly gathered from the '.jp' domain, and conducted an evaluation workshop at the third NTCIR Workshop from 2001 to 2002, where we assessed the retrieval effectiveness of a certain number of Web search engine systems using the common data set. Conventional evaluation workshops assessed the relevance of the retrieved documents, which were submitted by the workshop participants, by considering the contents of individual pages. On the other hand, we assessed the relevance of the retrieved pages by considering the relationship between the pages referenced by hyperlinks.},
keywords={},
doi={},
ISSN={},
month={September},}
Copy
TY - JOUR
TI - Evaluation Methods for Web Retrieval Tasks Considering Hyperlink Structure
T2 - IEICE TRANSACTIONS on Information
SP - 1804
EP - 1813
AU - Koji EGUCHI
AU - Keizo OYAMA
AU - Emi ISHIDA
AU - Noriko KANDO
AU - Kazuko KURIYAMA
PY - 2003
DO -
JO - IEICE TRANSACTIONS on Information
SN -
VL - E86-D
IS - 9
JA - IEICE TRANSACTIONS on Information
Y1 - September 2003
AB - This paper proposes the evaluation methods for measuring retrieval effectiveness of Web search engine systems, attempting to make them suitable for real Web environment. With this objective, we constructed 100-gigabyte and 10-gigabyte document sets that were mainly gathered from the '.jp' domain, and conducted an evaluation workshop at the third NTCIR Workshop from 2001 to 2002, where we assessed the retrieval effectiveness of a certain number of Web search engine systems using the common data set. Conventional evaluation workshops assessed the relevance of the retrieved documents, which were submitted by the workshop participants, by considering the contents of individual pages. On the other hand, we assessed the relevance of the retrieved pages by considering the relationship between the pages referenced by hyperlinks.
ER -