- Seminar Calendar
- Seminar Archive
- 2024-2025 Semester 1
- 2023-2024 Semester 2
- 2023-2024 Semester 1
- 2022-2023 Semester 2
- 2022-2023 Semester 1
- 2021-2022 Semester 2
- 2021-2022 Semester 1
- 2020-2021 Semester 2
- 2020-2021 Semester 1
- 2019-2020 Semester 2
- 2019-2020 Semester 1
- 2018-2019 Semester 2
- 2018-2019 Semester 1
- 2017-2018 Semester 2
- 2017-2018 Semester 1
- 2016-2017 Semester 2
- 2016-2017 Semester 1
- 2015-2016 Semester 1
- 2015-2016 Semester 2
- 2014-2015 Semester 2
- 2014-2015 Semester 1
- 2013-2014 Semester 2
- 2013-2014 Semester 1
- 2012-2013 Semester 2
- 2012-2013 Semester 1
- 2011-2012 Semester 2
- 2011-2012 Semester 1
- 2010-2011 Semester 2
- 2010-2011 Semester 1
- 2009-2010 Semester 2
- 2009-2010 Semester 1
- 2008-2009 Semester 2
- 2008-2009 Semester 1
- 2007-2008 Semester 2
- 2007-2008 Semester 1
- 2006-2007 Semester 2
- 2006-2007 Semester 1
- 2005-2006 Semester 2
- 2005-2006 Semester 1
- Contact
- Site Map
Towards Provable Unaligned Multimodal Learning: A Model Identification Perspective
----------------------------------------------------------------------------------------------------
Department of Systems Engineering and Engineering Management
The Chinese University of Hong Kong
----------------------------------------------------------------------------------------------------
Date: Tuesday, June 4, 4:30 pm – 5:30 pm
Venue: ERB 513, The Chinese University of Hong Kong
Title: Towards Provable Unaligned Multimodal Learning: A Model Identification Perspective
Speaker: Prof Xiao Fu, Oregon State University
Abstract:
2023 was “the year of AI”, highlighted by the release of numerous AI models with remarkable capabilities. Multimodal learning is at the forefront of AI advancements, with state-of-the-art models like GPT-4 and Gemini emphasizing multimodal functionalities as their defining features. Despite its importance, many aspects of multimodal learning, and AI developments in general, still lack a concrete and comprehensive understanding---which is essential for building resilient and trustworthy systems. Our research focuses on the understanding of AI/ML systems to drive theory-backed advancements. From this perspective, this presentation revisits a core component of multimodal learning—Unsupervised Domain Translation (UDT). Many UDT systems, such as CycleGAN, use Distribution Matching (DM) modules, which often fail in content-aligned translations due to measure-preserving automorphism (MPA). Existing remedies fall short of guaranteed performance. In my talk, I will introduce a model identification perspective for UDT, overcoming the MPA issues and ensuring identifiability of the desired translation functions. This is the first proven identification result in UDT under CycleGAN’s settings, to our knowledge. We have also broadened these concepts, providing solutions for various translation challenges, enabling provable content-style disentanglement, and offering more versatile cross-domain data generation. These advancements promise significant theoretically supported enhancements for UDT applications, particularly in data-limited fields such as medicine and biology.
Biography:
Xiao Fu has been with the School of Electrical Engineering and Computer Science, Oregon State University since 2017, where he is currently an Associate Professor. He received the Ph.D. degree in Electronic Engineering from The Chinese University of Hong Kong, in 2014. He was a Postdoctoral Associate with the Department of Electrical and Computer Engineering, University of Minnesota - Twin Cities, from 2014 to 2017. His research interests include the broad area of machine learning and signal processing, especially theory and algorithms. Dr. Fu received the Best Student Paper Award at ICASSP 2014, the 2022 IEEE Signal Processing Society (SPS) Best Paper Award, and the 2022 IEEE SPS Donald G. Fink Overview Paper Award. He also received the Outstanding Postdoctoral Scholar Award at University of Minnesota in 2016, the Engelbrecht Early Career Faculty Award from the College of Engineering at Oregon State University in 2023, and the National Science Foundation (NSF) CAREER Award in 2022. Since 2023, he has been the Chair of the IEEE SPS Oregon Chapter. He is currently an Associate Editor of IEEE Transactions on Signal Processing. He was a tutorial speaker at ICASSP 2017 and SIAM Conference on Linear Algebra 2021.
Everyone is welcome to attend the talk!
SEEM-5202 Website: http://seminar.se.cuhk.edu.hk
Email: seem5202@se.cuhk.edu.hk
Date:
Tuesday, June 4, 2024 - 16:30