| SHAO Qing(邵 清),DU Yiwei.[J].高技术通讯(英文),2025,31(3):309~320 |
|
| A multi-modal hierarchical approach for Chinese spelling correction using multi-head attention and residual connections |
| |
| DOI：10. 3772 / j. issn. 1006-6748. 2025. 03. 011 |
| 中文关键词: |
| 英文关键词: Chinese spelling correction, multiple-headed attention, multi-modal fusion, residual connection, pinyin encoder |
| 基金项目: |
| Author Name | Affiliation | | SHAO Qing(邵 清) | (School of Optoelectronic Information and Intelligent Engineering, University of Shanghai for Science and Technology,Shanghai 200093, P. R. China) | | DU Yiwei | |
|
| Hits: 18 |
| Download times: 21 |
| 中文摘要: |
| |
| 英文摘要: |
| The primary objective of Chinese spelling correction (CSC) is to detect and correct erroneous characters in Chinese text, which can result from various factors, such as inaccuracies in pinyin representation, character resemblance, and semantic discrepancies. However, existing methods often struggle to fully address these types of errors, impacting the overall correction accuracy. This paper introduces a multi-modal feature encoder designed to efficiently extract features from three distinct modalities: pinyin, semantics, and character morphology. Unlike previous methods that rely on direct fusion or fixed-weight summation to integrate multi-modal information, our approach employs a multi-head attention mechanism to focuse more on relevant modal information while disregarding less pertinent data. To prevent issues such as gradient explosion or vanishing, the model incorporates a residual connection of the original text vector for fine-tuning. This approach ensures robust model performance by maintaining essential linguistic details throughout the correction process. Experimental evaluations on the SIGHAN benchmark dataset demonstrate that the proposed model outperforms baseline approaches across various metrics and datasets, confirming its effectiveness and feasibility. |
|
View Full Text
View/Add Comment Download reader |
| Close |
|
|
|
