Changyeon Kim

changyeon.kim [AT] kaist.ac.kr

changyeon.jpg

Hello. I am a PhD student at KAIST, advised by Jinwoo Shin and Kimin Lee, and a visiting PhD student at UT Austin advised by Yuke Zhu. I also worked closely with Honglak Lee at UMich and Joseph J. Lim at KAIST.

My research focuses on training artificial robotic agents to align with human intentions. To this end, my research recently focused on reinforcement learning (RL) applicable to large-scale, pre-trained robotic foundation models for training human-aligned behaviors on new tasks through online experiences. Additionally, to accurately convey human intents, I focused on developing reward learning algorithms that generate appropriate reward signals based on real human preferences or foundational vision-language models, effectively incorporating extensive human knowledge.

Prior to my graduate studies, I was a machine learning engineer at Recommendation Team of Kakao. Before that, I completed my BS in Computer Science at KAIST.


News

May 12, 2025 B-MoCA is accepted to CoLLAs 2025 :smile:.
Jan 23, 2025 REDS is accepted to ICLR2025 :smile:.
Sep 22, 2023 ARP has been accepted to NeurIPS 2023. See you in New Orleans :us:!
Jun 19, 2023 I will attend ICML 2023 in person for presenting workshop paper (ARP). Feel free to contact to meet or chat in Hawaii, USA :us:.
Jan 21, 2023 Preference Transformer is accepted to ICLR2023 :smile:. Hope to see you in Kigali, Rwanda :rwanda:!

Publications

  1. CoLLAs
    B-MoCA: Benchmarking Mobile Device Control Agents across Diverse Configurations
    Juyong Lee, Taywon Min, Minyong An, Dongyoon Hahm, Haeone Lee,  Changyeon Kim, and Kimin Lee
    In Conference on Lifelong Learning Agents (CoLLAs), 2025
    Previously accepted to ICLR 2024 Workshop on Generative Models for Decision Making as a **spotlight presentation**
    arXiv Code Website
  2. ICLR
    Subtask-Aware Visual Reward Learning from Segmented Demonstrations
    Changyeon Kim, Minho Heo, Doohyun Lee, Jinwoo Shin, Honglak Lee, Joseph J. Lim^, and Kimin Lee^
    In International Conference on Learning Representations (ICLR), 2025
    (^: equal advising)
    arXiv PDF Code Website
  3. NeurIPS
    Guide Your Agent with Adaptive Multimodal Rewards
    Changyeon Kim, Younggyo Seo, Hao Liu, Lisa Lee, Jinwoo Shin, Honglak Lee, and Kimin Lee
    In Conference on Neural Information Processing Systems (NeurIPS), 2023
    Previously accepted to ICML 2023 Workshop on New Frontiers in Learning, Control, and Dynamical Systems
    Finalist of Qualcomm Innovation Fellowship 2024 Korea
    arXiv PDF Code Website
  4. ICLR
    Preference Transformer: Modeling Human Preferences using Transformers for RL
    Changyeon Kim*, Jongjin Park*, Jinwoo Shin, Honglak Lee, Pieter Abbeel, and Kimin Lee
    In International Conference on Learning Representations (ICLR), 2023
    (*: equal contribution)
    arXiv PDF Code Website
  5. NeurIPSW
    Dynamics-Augmented Decision Transformer for Offline Dynamics Generalization
    Changyeon Kim*, Junsu Kim*, Younggyo Seo, Kimin Lee, Honglak Lee, and Jinwoo Shin
    In Conference on Neural Information Processing Systems (NeurIPS) Workshop on Offline Reinforcement Learning, 2022
    (*: equal contribution)
    PDF

Work Experience


Recommendation Team, Kakao
Machine Learning Engineer (Dec 2020 ~ Feb 2022)

Data Science Group, Institute of Basic Science
Resarch Intern advised by Prof. Meeyoung Cha (Jul 2019 - Nov 2020)


Honors and Awards

Notable Reviewer,  International Conference on Learning Representations (ICLR), 2025
Finalist,  Qualcomm Innovation Fellowship 2024 Korea
Travel Award ($2,000),  Conference on Neural Information Processing Systems (NeurIPS), 2023
Recipient ($3,000),  KAIST-Google Partnership Program, 2023
Recipient ($2,000),  Google East Asia Student Travel Grant, 2023
Travel Award ($1,000),  International Conference on Learning Representations (ICLR), 2023
Dean's List,  KAIST Department of Engineering, 2019
Recipient ($5,000),  Line Scholarship, 2019
Recipient,  National Science and Engineering Scholarship, Korea Ministry of Science and ICT, 2017 - 2019
Recipient ($3,000),  Kwanjeong Scholarship, 2017


Invited Talks

Guide Your Agent with Adaptive Multimodal Rewards
LG AI Research (New Orleans, LA, USA)


Academic Services

Conference Reviewer:  ICLR (2025), ICML (2024, 2025), NeurIPS (2024, 2025)
Workshop Reviewer:  Frontiers4LCD@ICML'23