Web查询日志研究综述

doi:10.3969/j.issn.0372-2112.2013.09.021

摘要/Abstract

摘要： 本文对查询日志在相关领域内的研究现状与进展进行了总结.首先介绍了web查询日志的常用信息和公开的数据集;进而阐述了查询日志在web搜索、信息抽取等方面的相关研究,并对它们进行了细致的介绍和分析;最后指出基于查询日志研究所面临的问题和挑战.重在对基于查询日志研究的主流方法和前沿进展进行概括、比较和分析,以期对后续研究有所助益.

关键词: 查询日志分析, 查询日志挖掘, web搜索, 信息抽取

Abstract: This paper surveys the state-of-the-art research on query logs analysis.First,the existing corpus of query logs and the information embedded in are summarized and analyzed.Then,important tasks benefiting from query logs are introduced,including web search,information extraction,as well as some closely related topics.Finally,the problems and challenges of current researches are discussed.This paper aims to make a summary,comparison and analysis of the mainstream methods and the latest progress,expecting to be helpful to the future research.

Key words: analysis on query logs, mining on query logs, web search, information extraction

中图分类号:

TP391.2

付博, 赵世奇, 刘挺. Web查询日志研究综述[J]. 电子学报, 2013, 41(9): 1800-1808.

FU Bo, ZHAO Shi-qi, LIU Ting. Research on Analysis and Mining of Web Query Logs[J]. Acta Electronica Sinica, 2013, 41(9): 1800-1808.

参考文献

[1] Cui H,Wen JR,Nie JY,Ma WY.Query expansion by mining user logs[J].IEEE Transaction on Knowledge and Data Engineering,2003,15(4):829-839.
[2] Fonseca BM.Concept-based interactive query expansion [A].Proceeding of the CIKM [C].New York:ACM Press,2005.696-703.
[3] 崔航,文继荣,李敏强.基于用户日志的查询扩展统计模型[J].软件学报,2003,14(9):1593-1599. Cui Hang,Wen Ji-rong,Li Min-qiang.A statistical query expansion model based on query logs[J].Journal of Software,2003,14(9):1593-1599.(in Chinese).
[4] Baeza-Yates,Hurtado C,Mendoza M.Query recommendation using query logs in search engines [A].Proceeding of the EDBT Workshop [C].Berlin,Heidelberg:Springer-Verlag,2004.588-596.
[5] Cao HH,Jiang DX,Pei J,He Q,Liao Z,Chen EH,Li H.Context-aware query suggestion by mining click-through and session data [A].Proceeding of the KDD [C].New York:ACM Press,2008.875-883.
[6] Huang C,et al.Relevant term suggestion in interactive web search based on contextual information in query session logs[J].Journal of the American Society for Information Science and Technology,2003.54(7):638-649.
[7] Zhao SQ,Wang HF,Liu T.Paraphrasing with search engine query logs [A].Proceeding of the COLING [C].Morristown:ACL,2010.1317-1325.
[8] Pasca M.Weakly-supervised discovery of named entities using web search queries [A].Proceeding of the CIKM [C].New York:ACM Press,2007.683-690.
[9] Guo JF,Xu G,Cheng XQ,Li H.2009.Named entity recognition in query [A].Proceeding of the SIGIR [C].New York:ACM Press,2009.267-274.
[10] Du J,Zhang ZM,Yan J,Cui Y,Cheng Z.Using search session context for named entity recognition in query [A].Proceeding of the SIGIR [C].New York:ACM Press,2010.765-766.
[11] Jansen BJ,Spink A.How are we searching the World Wide Web? A comparison of nine search engine transaction logs[J].Information Processing and Management,2006,42(1):248-263.
[12] Jansen BJ,Spink A,Saracevic T.Real life,real users,and real needs:a study and analysis of user queries on the web[J].Information Processing and Management,2000,36(2):207-227.
[13] Wu DY,Zhang Y,Liu T.Analysis of named entity queries in web search logs[J].Journal of Computational Information Systems,2011,7(16):5837-5844.
[14] Broder A.A taxonomy of web search[J].SIGIR Forum,2002,36(2):3-10.
[15] Rose DE,Levinson D.Understanding user goals in Web search [A].Proceeding of the WWW [C].New York:ACM Press,2004.13-19.
[16] Baeza-Yates R,Calderron-Benavides L,Gonzalez-Caro C.The intention behind web queries[J].Lecture Notes in Computer Science 4209,2006.98-109.
[17] Jansen BJ,Booth DL,Spink A.Determining the user intent of web search engine queries [A].Proceeding of the WWW [C].New York:ACM Press,2007.1149-1150.
[18] Lee U,Liu Z,Cho J.Automatic identification of user goals in web search [A].Proceeding of the WWW [C].Japan:ACM Press,2005.391-400.
[19] Liu YQ,Zhang M,Ru LY,Ma SP.Automatic query type identification based on click through information [A].Proceeding of the AIRS [C].Berlin,Heidelberg:Springer-Verlag,2006.593-600.
[20] Li X,Wang YY,Acero A.Learning query intent from regularized click graphs [A].Proceeding of the SIGIR [C].New York:ACM Press,2008.339-346.
[21] 张森,王斌.Web检索查询意图分类技术综述[J].中文信息学报,2008,22(4):75-82. Zhang Sen,Wang Bin.A survey of web search query intention classification[J].Journal of Chinese Information Processing,2008,22(4):75-82(in Chinese).
[22] Brenes DJ,Gayo-Avello D,Perez-Gonzalez K.Survey and evaluation of query intent detection methods [A].Proceedings of the 2009 Workshop on Web Search Click Data [C].New York:ACM Press,2009.1-7.
[23] Beitzel SM,et al.Hourly analysis of a very large topically categorized web query log [A].Proceeding of the SIGIR [C].New York:ACM Press,2004.321-328.
[24] Li Y,Zheng ZJ,Dai HH.KDD CUP-2005 report:Facing a great challenge[J].SIGKDD Explorations Newsletter,2005,7(2):91-99.
[25] Hu J,Wang G,Lochovsky F,Sun JT,Chen Z.Understanding user’s query intent with Wikipedia [A].Proceeding of the WWW [C].New York:ACM Press,2009.471-480.
[26] Beitzel SM,et al.Automatic classification of web queries using very large unlabeled query log[J].ACM Transactions on Information Systems,2007,25(2):1-29.
[27] Cao HH.Context-aware query classification [A].Proceeding of the SIGIR [C].New York:ACM Press,2009.3-10.
[28] Carpineto C,Romano G.A survey of automatic query expansion in information retrieval[J].ACM Computing Surveys (CSUR),2012,44(1):1-56.
[29] Beeferman D,Berger A.Agglomerative clustering of a search engine query log [A].Proceeding of the KDD [C].New York:ACM Press,2000.407-416.
[30] Chan WS,Leung WT,Lee DL.Clustering search engine query log containing noisy clickthroughs [A].Proceeding of SAINT [C].Tokyo:IEEE Computer Press,2004.305-308.
[31] Wen JR,Nie JY,Zhang HJ.Clustering user queries of a search engine [A].Proceeding of the WWW [C].New York:ACM Press,2001.162-168.
[32] Shen X,Tan B,Zhai CX.Context-sensitive information retrieval using implicit feedback [A].Proceeding of the SIGIR [C].New York:ACM Press,2005.43-50.
[33] Cui H,Wen JR,Nie JY,Ma WY.Probabilistic query expansion using query logs [A].Proceeding of the WWW [C].New York:ACM Press,2002.325-332.
[34] Fonseca BM,Golgher PB,Moura ES,Ziviani N.Using association rules to discover search engines related queries [A].Proceeding of the LAWEB [C].Santiago:Citeseer,2003.66-71.
[35] Jones RR,et al.Generating query substitutions [A].Proceeding of the WWW [C].New York:ACM Press,2006.387-396.
[36] 李亚楠,王斌,李锦涛.搜索引擎查询推荐技术综述[J].中文信息学报,2010,24(6):75-84. Li Ya-nan,Wang Bin,Li Jin-tao.A survey of query in search engine[J].Journal of Chinese Information Processing,2010,24(6):75-84(in Chinese).
[37] Antonellis I,Molina HG,Chang CC.Simrank++:query rewriting through link analysis of the click graph [A].Proceeding of the VLDB [C].Auckland,New Zealand,2008.408-421.
[38] Craswell N,Szummer M.Random walks on the click graph [A].Proceeding of the SIGIR [C].New York:ACM Press,2007.239-246.
[39] Boldi P,Bonchi F,Castillo C,Donato D,Vigna S.Query suggestions using query-flow graphs [A].Proceeding of the WSCD Workshop [C].New York:ACM Press,2009.56-63.
[40] Bordino I,Castillo C,Donato D,Gionis A.Query similarity by projecting the query-flow graph [A].Proceeding of the SIGIR [C].New York:ACM Press,2011.
[41] Banko M,Cafarella M,Soderland S.Open information extraction from the web [J].Communications of the ACM,2008,51(12):68-74.
[42] Nadeau D,Sekine S.A survey of named entity recognition and classification[J].Linguisticae Investigationes,2007,30(1):3-26.
[43] 蔡怡峰,彭鑫,钱乐秋.面向语义构件检索的交互式查询方案生成[J].电子学报,2008,36(8):1631-1636. Cai Yi-feng,Peng Xin,Qian Le-qiu.An Interactive query generation method for semantics-based component retrieval[J].Acta Electronica Sinica,2008,36(8):1631-1636(in Chinese).
[44] 乔亚男,齐勇.查询语义图辅助的信息检索性能预测模型[J].电子学报,2011,39(A03):158-162. Qiao Ya-nan,Qi Yong.Predicting query performance using smantic chart[J].Acta Electronica Sinica,2011,39(A03):158-162 (in Chinese).
[45] Li X.Understanding the semantic structure of noun phrase queries [A].Proceeding of the ACL [C].Morristown:Association for Computational Linguistics,2010.1337-1345.
[46] Meij E,Bron M,Hollink L,Huurnink B,Rijke M.Learning semantic query suggestions [A].Proceeding of the ISWC [C].New York:Springer-Verlag,2009.424-440.
[47] Sekinei S,Suzuki H.Acquiring ontological knowledge from query logs [A].Proceeding of the WWW [C].New York:ACM Press,2007.1223-1224.
[48] Pasca M.Weakly-supervised acquisition of open-domain classes and class attributes from web documents and query logs [A].Proceeding of the ACL [C].Morristown:Association for Computational Linguistics,2008.19-27.
[49] Weding S,Madani O.A large-scale analysis of query logs for assessing personalization opportunities [A].Proceeding of the KDD [C].New York:ACM Press,2006.742-747.
[50] 韩立新,陈贵海,谢立.一种面向Internet的个性化信息检索系统模型[J].电子学报,2002,30(2):240-244. Han Li-xin,Chen Gui-hai,Xie L.A model of personalized information retrieval systems for internet applications[J].Acta Electronica Sinica,2002,30(2):240-244(in Chinese).
[51] Liu F,Yu C,Meng W.Personalized web search for improving retrieval effectiveness[J].IEEE Transactions on Knowledge and Data Engineering,2004,16(1):28-40.
[52] 曾春,刑春晓,周立柱.个性服务技术综述[J].软件学报,2002,13(10):1952-1961. Zeng Chun,Xing Xiao-chun,Zhou Li-zhu.Survey of personalization technology[J].Journal of Software,2002,13(10):1952-1961.(in Chinese)
[53] 谢海涛,孟祥武.适应用户需求进化的个性化信息服务模型[J].电子学报,2011,39(3):643-648. Xie Hai-tao,Meng Xiang-wu.A personalized information service model adapting to user requirement evolution[J].Acta Electronica Sinica,2011,39(3):643-648(in Chinese).
[54] Weerkamp W,Berendsen R,Kovachev B,Meij E,Balog K,Rijke M.People searching for people:Analysis of a people search engine log [A].Proceeding of the SIGIR [C].New York:ACM Press,2011.45-54.
[55] Feild HA,Allan J,Glatt J.CrowdLogging:Distributed,private,and anonymous search logging [A].Proceeding of the SIGIR [C].New York:ACM Press,2011.375-384.
[56] Ashkan A,Clarke C.Term-based commercial intent analysis [A].Proceeding of the SIGIR [C].New York:ACM Press,2009.800-801.
[57] Dai HH,Zhao LZ,Nie ZQ,Wen JR,Wang L,Li Y.Detecting online commercial intention [A].Proceeding of the WWW [C].New York:ACM Press,2006.829-837.
[58] Singh G,Parikh N,Sundaresn N.User behavior in zero-recall ecommerce queries [A].Proceeding of the SIGIR [C].New York:ACM Press,2011.75-84.
[59] Zhang W,Yan J,Yan SC,Liu N,Chen Z.Temporal query substitution for ad search [A].Proceeding of the SIGIR [C].New York:ACM Press,2009.798-799.
[60] Cartright MA,White RW,Horvitz E.Intentions and attention in exploratory health search [A].Proceeding of the SIGIR [C].New York:ACM Press,2011.65-74.
[61] Brilliant L.Detecting influenza epidemics using search engine query data[J].Nature.2009,457(7232):1-5.
[62] Zhang Y,Sun M,Zhang Y.Chinese new word detection from query logs [A].Proceeding of the ADMA [C].Berlin,Heidelberg:Springer-Verlag,2010.233-243.
[63] Zhao QK,Liu TY,Bhowmick SS,Ma WY.Event detection from evolution of click-through data [A].Proceeding of the KDD [C].New York:ACM Press,2006.484-493.