Specification-Guided Reinforcement Learning

Speaker:
Organiser:
Shibashis Guha
Date:
Friday, 18 Jul 2025, 11:00 to 12:00
Venue:
A-201 (STCS Seminar Room)
Category:
Abstract
Reinforcement Learning (RL) is being touted to revolutionize the way we design systems. However, a key challenge to reaching that holy grail comes from the lack of guarantees that the synthesized systems offer. Logic and formal reasoning can address some of these issues ... or can they? In this talk, I will cover recent progress in using logical specifications in RL and discuss the challenges it faces moving forward.
 
Short Bio:
Suguman Bansal is a is an assistant professor in the School of Computer Science at Georgia Institute of Technology. Her research interests lie at the intersection of Artificial Intelligence and Programming Languages. Specifically, she works on developing tools and techniques to improve the quality of automated verification and synthesis of computational systems. Her recent work concerns providing formal guarantees about learning-enabled systems with a focus on Reinforcement Learning.
She received her Ph.D. (2020) and M.S. (2016) in Computer Science from Rice University, and B.S. (with Honors) degree (2014) in Mathematics and Computer Science from Chennai Mathematical Institute. She is the recipient of the Amazon Research Award 2024, ATVA Best Paper Award 2023, MIT EECS Rising Stars 2021 and 2018, Future Faculty Fellowship 2019, Andrew Ladd Fellowship 2016, and a Gold Medal at the ACM Student Research Competition at POPL 2016.