Seungho Baek

Seungho Baek

I'm a Ph.D. student at Sungkyunkwan University (SKKU), advised by Prof. Yusung Kim. I'm interested in developing reinforcement learning (rl) algorithms for long-horizon and sparse-reward tasks, and applying them to real-world robotic control. The question that drives me these days is: how can we effectively combine foundation models with rl? More specifically, my goal is to design off-policy q-learning methods that improve the long-horizon reasoning abilities of vision-language-action (vla) models.

My research interests include the following challenges:

  • Discovering skills for generalization
  • Learning robustly from suboptimal datasets
  • Combining foundation models with off-policy rl
  • Solving long-horizon tasks with sparse rewards

Research Keywords: Offline RL · Off-to-Online RL · Unsupervised RL · Goal-Conditioned RL · Hierarchical RL

News


Aug. 2025   Paper accepted at CIKM '25
Jul. 2025   ICML '25 @ Vancouver, Canada
Jun. 2025   GAS released on arXiv
May. 2025   Paper accepted at ICML '25
Aug. 2024   Paper accepted at JCMC '24
Nov. 2022   Paper accepted at KIPS '22

Publications


Learning Generalizable Skill Policy with Data-Efficient Unsupervised RL

Jongchan Park, Seungjun Oh, Seungho Baek, Yusung Kim

Preprint, 2026    Paper

Temporal Distance-Aware Subgoal Generation for Offline Hierarchical Reinforcement Learning

Taegeon Park, Seungho Baek, Jongchan Park, Seungjun Oh, Yusung Kim

Conference on Information and Knowledge Management (CIKM), 2025    Paper  Code

Graph-Assisted Stitching for Offline Hierarchical Reinforcement Learning

Seungho Baek, Taegeon Park, Jongchan Park, Seungjun Oh, Yusung Kim

International Conference on Machine Learning (ICML), 2025    Paper  Code  Project page  Talk (10 min)

Prediction of Intraoperative Hypotension Using Deep Learning Models Based on Non-Invasive Monitoring Devices

Heejoon Jeong, Donghee Kim, Dong Won Kim, Seungho Baek, Hyung-Chul Lee, Yusung Kim, Hyun Joo Ahn

Journal of Clinical Monitoring and Computing (JCMC), 2024  Paper Code

Intelligent CCTV for Port Safety

Seungho Baek, Yeongil Ji, Hansaem Choi

Korea Information Processing Society (KIPS), 2022  Paper Code

Education


Sungkyunkwan University

2026.03.02 – Present

  • Degree: Ph.D.
  • Major: Artificial Intelligence
  • Advisor: Prof. Yusung Kim

Sungkyunkwan University

2023.08.28 – 2026.02.25

  • Degree: M.S.
  • Major: Software Engineering
  • GPA/Scale: 4.2/4.5
  • Advisor: Prof. Yusung Kim

Hyupsung University

2017.03.02 – 2023.02.17

  • Degree: B.S.
  • Major: Software Engineering
  • GPA/Scale: 4.0/4.5
  • Advisor: Prof. Hyeseung Park

Teaching


Introduction to Data Analysis and AI

2026.03.02 – Present

  • Audience: Undergraduate Students at Sungkyunkwan University

Introduction to Data Analysis

2023.09.02 – 2025.12.23

  • Audience: Undergraduate Students at Sungkyunkwan University

Introduction to Reinforcement Learning

2024.03.04 – 2025.06.28

  • Audience: Undergraduate Students at Sungkyunkwan University

AI Leadership Program for Manufacturing

2024.11.01 – 2024.11.14

  • Attendees: LG Electronics Employees

National Defense AI Education Program

2024.10.15 – 2024.10.16

  • Attendees: South Korean Military Personnel

Internships


Sungkyun AI Research Institute

2023.04.01 – 2026.02.28

  • Data Collection
  • Data Preprocessing
  • Exploratory Data Analysis
  • AI Model Development

Consquare

2022.07.04 – 2022.09.04

  • Exploratory Data Analysis
  • AI Model Development

SuperBin

2021.07.05 – 2021.10.27

  • Data Collection
  • Data Preprocessing

Certificates


Engineer Big Data Analysis

2022

  • Issued by: Ministry of Science and ICT, Republic of Korea

Profile


Date of Birth: 1998.11.09

Military Service Status: Fulfilled

Languages: Korean (Native) / English

Residence: Anyang-si, Gyeonggi-do, Republic of Korea