LLM 기반 TOPIK 문항 생성 모델의 개발 및 타당도 검증
Development of an LLM-based TOPIK Item Generation Model and Its Validity Verification
  • 김현영
  • 한승훈
  • 박주현
Citations

WEB OF SCIENCE

0
Citations

SCOPUS

0

초록

The Hallyu (Korean Wave) content industry has become a core axis of the global cultural market, spurring increased interest in Hangeul and the Test of Proficiency in Korean (TOPIK). However, following the 2020 Korean Standard Education Curriculum, the supply of official and private practice items remains limited, hindering the ability to secure sufficient mock exam materials. To solve this, this study successfully developed an automatic item generation (AIG) model and system that adheres to specialized TOPIK standards, including item-specific learning objectives. The system's performance was rigorously verified through evaluations conducted by Korean education experts, confirming the alignment of generated items with their respective learning objectives. Critically, the model addresses grammatical and sentence structure errors resulting from the data sparsity of Hangeul in commercially available foreign LLMs. By automating the creation of all item components (passages, options, commentary, and attractive distractors) and ensuring they meet TOPIK's inherent level-specific objectives, the AIG system significantly enhances the overall quality and completeness of mock exams.

키워드

TOPIK(Test of Proficiency in Korean)Large Language ModelAutomatic Item GenerationValidity/Quality VerificationAgentic RAG
제목
LLM 기반 TOPIK 문항 생성 모델의 개발 및 타당도 검증
제목 (타언어)
Development of an LLM-based TOPIK Item Generation Model and Its Validity Verification
저자
김현영한승훈박주현
DOI
10.9717/kmms.2026.29.3.581
발행일
2026-03
유형
Y
저널명
멀티미디어학회논문지
29
3
페이지
581 ~ 592