贺国秀,张晓娟.查询意图自动分类的方法改进探讨[J].数字图书馆论坛,2018,(1):53~60 |
查询意图自动分类的方法改进探讨 |
Discussion on the Improvement of Methods for Automatic Classification of Query Intent |
|
DOI: |
中文关键词: GBDT;机器学习;查询日志;查询意图;自然语言处理 |
英文关键词: GBDT;Machine Learning;Query Log;Query Intent;Nature Language Processing |
基金项目:本研究得到国家社会科学基金青年项目"融合用户个性化与实时性意图的查询推荐模型研究"(编号:15CTQ019)资助. |
|
摘要点击次数: 2269 |
全文下载次数: 1940 |
中文摘要: |
本文在降低数据标注成本的基础上,提高查询意图自动分类的准确率.首先,将ODP主题类目体系映射到Rose等意图类目体系,利用启发式和匹配的方法形成标注规则,对查询日志数据进行自动标注;其次,在提取查询的统计特征、用户行为特征和基于自然语言处理的语义特征基础上,提取查询的句法依赖关系作为分类特征;最后,使用集成学习模型GBDT作为分类器,对查询意图进行分类研究.实验表明,本文提出的标注规则可以获得大量被标注的训练数据集,新增的句法依赖关系特征可以提高查询意图的分类效果,GBDT作为集成学习模型相比线性分类模型可以明显提高查询意图分类的准确率. |
英文摘要: |
On the basis of reducing the cost of data marked, the research is to improve the accuracy of query intent automatic classification. Firstly, the ODP subject category system is mapped to Rose's intent class system, the heuristic and matching methods are used to form the annotation rules, and the query log data is automatical y marked;Then, based on statistical characteristics of the extracted query, the characteristics of user's behavior and natural language such as word segmentation and part of speech, the syntactic dependency of the query is extracted as the classification feature;Final y, the integrated learning model GBDT is used as a classifier to classify the query intent. The experimental results show that the proposed rules can be used to obtain a large number of trained training data sets. The new syntactic and relational feature can improve the classification result of query intent. GBDT can improve the accuracy rate of query intent classification as an integrated learning model compared with linear classification model. |
查看全文
查看/发表评论 下载PDF阅读器 |
关闭 |
|
|
|