Hello, I'm Inyup Lee

Hi everyone, I am a PhD student in Visual Media Lab at KAIST.
I am interested in multimodal 2D/3D facial animation generation and editing.

CV Scholar Github

Publications

AnyTalk: Zero-Shot Speech-Driven 3D Facial Animation

AnyTalk: Zero-Shot Speech-Driven 3D Facial Animation

Kwan Yun * , Serin Yoon * , Sunjin Jung , Jung Eun Yoo , Inyup Lee , Junyong Noh (*equal contribution)
IEEE TVCG 2026

Project Page
FaceDirector: Iterative Editing of Speech-driven Facial Animation with Natural Language

FaceDirector: Iterative Editing of Speech-driven Facial Animation with Natural Language

Inyup Lee , Sunjin Jung , Sihun Cha , Junyong Noh
Under review

Mesh-Agnostic Audio-Driven 3D Facial Animation Generation

Mesh-Agnostic Audio-Driven 3D Facial Animation Generation

Kwanggyoon Seo * , Sihun Cha * , Hyeonho Na , Inyup Lee , Junyong Noh (*equal contribution)
KCGS 2025 / Best Paper Award

Project Page
Deep-Learning-Based Facial Retargeting Using Local Patches

Deep-Learning-Based Facial Retargeting Using Local Patches

Yeonsoo Choi * , Inyup Lee * , Sihun Cha , Seonghyeon Kim , Sunjin Jung , Junyong Noh (*equal contribution)
Computer Graphics Forum (CGF) 2024 / EuroGraphics 2025

Project Page arXiv Code

Project

NC AI Project

NC AI Project

as a Researcher
Oct. 2025 ~ Ongoing

Generating industry-standard 52 facial blendshape targets, given any 3D character head.

IITP Starlab

IITP Starlab

as a Researcher
May. 2024 ~ Ongoing

Generating hyper-realistic to extremely-stylized face avatar with varied speech speed and context-based emotional expression.

Nermarble 3D Facial Animation Project

Nermarble 3D Facial Animation Project

as a Software Developer / Researcher
Mar. 2023 ~ Dec. 2023

Conduct research on facial animation retargeting method to transfer motion of human facial performance video to 3D stylized character.