Effective Medical Visual Question Answering Using Dynamic Prompting and Decoding Knowledge Editing

DOI码：

10.1007/s41019-025-00291-0

所属单位：

School of Informatics, Xiamen University,

发表刊物：

Data Science and Engineering

刊物所在地：

China

关键字：

"Medical visual question answering";"Pre-training";"Prompt tuning"; "Knowledge editing"

摘要：

This paper addresses the issue of time-consuming manual prompt design and the limitations of current knowledge editing methods, which fail to utilize new knowledge fully. It integrates knowledge during the pre-training and answer prediction stages. Additionally, it proposes a medical visual question-and-answer model called DPDE, which is based on dynamic prompts and decoded knowledge editing. This model innovatively applies dynamic prompts to the field of medical visual question answering. It proposes a new paradigm for decoding knowledge editing, which enhances the language model’s knowledge editing capabilities in the decoding stage. In order to verify the effectiveness of the DPDE model, we conducted multiple sets of experiments to explore the model performance on three data sets. Experiments have proven that the dynamic prompt module and decoding knowledge editing module used in this model can effectively improve the performance of medical visual question-answering tasks.

第一作者：

ZhiJie Zhou

通讯作者：

XiaoLi Wang

合写作者：

YeFan Huang,Xiaojie Hong

论文类型：

Original Research

学科门类：

医疗人工智能 / 计算机科学 / 多模态 / 视觉语言模型

一级学科：

信息与计算科学 / 计算机科学 / 人工智能类

文献类型：

Journal Article

是否译文：

否

发表时间：

2025-06-24