ScholarWorks@숙명여자대학교

초록

In this paper, we proposes a CODA service application equipped with a sign language translation function based on generative AI. The application is characterized by its sign language translation technology and a user interface (UI) that minimizes text. The sign language translation technology consists of the Image2Pose, Pose2Gloss, Gloss2Text, and Image Generation modules. The Image2Pose module analyzes input sign language videos and converts them into images. The Pose2Gloss module translates the meaning of Gloss based on continuous Pose key points. The Gloss2Text module converts Gloss into text, while the Image Generation module converts text into images. The application undergoes field testing with actual CODA users and is refined based on their feedback. Additionally, the need for additional sign language features is identified, and these are implemented using Contrastive Learning. The proposed application is expected to contribute not only to smooth communication within CODA families but also to the advancement of sign language translation technology.

키워드