Seungho Baek

Seungho Baek

I'm an M.S. student at Sungkyunkwan University (SKKU), advised by Prof. Yusung Kim. My research primarily focuses on Reinforcement Learning (RL), specifically within two main areas: offline RL and hierarchical RL. Initially, my research was centered on enhancing the agent’s long-horizon reasoning and stitching ability by formulating subgoal selection as a graph search problem rather than learning explicit high-level policy. I've also contributed by developing a framework that leverages temporal distance representations to improve offline hierarchical RL, particularly in settings with sparse rewards and suboptimal data. Recently, I’ve expanded into online RL, investigating how to enable efficient policy learning using a small amount of expert data combined with dense rewards shaped by a temporal distance representation.

Ultimately, my goal is to address the following key challenges in offline RL:

  • Solving long-horizon tasks with sparse rewards
  • Learning robustly from suboptimal datasets
  • Transferring knowledge across diverse trajectories
  • Discovering skills for generalization

Research Keywords: Offline RL · Unsupervised RL · Goal-Conditioned RL · Hierarchical RL

News


Jul. 2025   ICML '25 @ Vancouver, Canada
Jun. 2025    GAS released on arXiv
May. 2025   Paper accepted at ICML '25
Aug. 2024   Paper accepted at JCMC '24
Aug. 2023   Started M.S. at Sungkyunkwan University

Publications


Temporal Distance-Aware Subgoal Generation for Offline Hierarchical Reinforcement Learning

Taegeon Park, Seungho Baek, Jongchan Park, Seungjun Oh, Yusung Kim

Preprint

Graph-Assisted Stitching for Offline Hierarchical Reinforcement Learning

Seungho Baek, Taegeon Park, Jongchan Park, Seungjun Oh, Yusung Kim

International Conference on Machine Learning (ICML), 2025    Paper Code Project Page

Prediction of Intraoperative Hypotension Using Deep Learning Models Based on Non-Invasive Monitoring Devices

Heejoon Jeong, Donghee Kim, Dong Won Kim, Seungho Baek, Hyung-Chul Lee, Yusung Kim, Hyun Joo Ahn

Journal of Clinical Monitoring and Computing (JCMC), 2024  Paper Code

Intelligent CCTV for Port Safety

Seungho Baek, Yeongil Ji, Hansaem Choi

Korea Information Processing Society (KIPS), 2022  Paper Code

Education


Sungkyunkwan University

2023.08.28 – Present

  • Degree: M.S.
  • Major: Software Engineering
  • GPA/Scale: 4.2/4.5
  • Advisor: Prof. Yusung Kim

Hyupsung University

2017.03.02 – 2023.02.17

  • Degree: B.S.
  • Major: Software Engineering
  • GPA/Scale: 4.0/4.5
  • Advisor: Prof. Hyeseung Park

Teaching


AI Leadership Program for Manufacturing

2024.11.01 – 2024.11.14

  • Attendees: LG Electronics Employees

National Defense AI Education Program

2024.10.15 – 2024.10.16

  • Attendees: South Korean Military Personnel

Introduction to Reinforcement Learning

2024.03.04 – Present

  • Audience: Undergraduate Students at Sungkyunkwan University

Introduction to Data Analysis

2023.09.02 – Present

  • Audience: Undergraduate Students at Sungkyunkwan University

Internships


Sungkyun AI Research Institute

2023.04.01 – 2023.08.27

  • Data Collection
  • Data Preprocessing
  • Exploratory Data Analysis
  • AI Model Development

Consquare

2022.07.04 – 2022.09.04

  • Exploratory Data Analysis
  • AI Model Development

SuperBin

2021.07.05 – 2021.10.27

  • Data Collection
  • Data Preprocessing

Certificates


Engineer Big Data Analysis

2022

  • Issued by: Ministry of Science and ICT, Republic of Korea

Profile


Date of Birth: 1998.11.09

Military Service Status: Fulfilled

Languages: Korean (Native) / English

Residence: Anyang-si, Gyeonggi-do, Republic of Korea