KCIS Invited Talk by Dr. Karthi Desingh
on
Robust and Generalized Perception Towards Mainstreaming Domestic Robots
-
Dr. Karthik's long-term goal is to build general-purpose robots that can care for and assist the aging and disabled population by autonomously performing various real-world tasks. To robustly execute various tasks, a general-purpose robot should be capable of seamlessly perceiving and manipulating a wide variety of objects in our environment. To achieve a given task, a robot should continually perceive the state of its environment, reason with the task at hand, plan and execute appropriate actions. In this pipeline, perception is largely unsolved and one of the more challenging problems. Common indoor environments typically pose two main problems: 1) inherent occlusions leading to unreliable observations of objects, and 2) presence and involvement of a wide range of objects with varying physical and visual attributes (i.e., rigid, articulated, deformable, granular, transparent, etc.). Thus, we need algorithms that can accommodate perceptual uncertainty in the state estimation and generalize to a wide range of objects.In his research, he developed 1) probabilistic inference methods to estimate the world-state with the notion of uncertainty and 2) data-driven methods to learn object representations that can generalize the state estimation to a wide range of objects. This talk will highlight some of his research efforts in these two research thrusts. In the first part of the talk, he will describe an efficient belief propagation algorithm - Pull Message Passing for Nonparametric Belief Propagation (PMPNBP) - for estimating the state of articulated objects using a factored approach. In the second part of the talk, he will describe the recent work - Spatial Object-centric Representation Network (SORNet) - for learning object-centric representation grounded for sequential manipulation tasks. He will also discuss the open research problems on both these thrusts towards realizing general-purpose domestic robots.Venue: KRB AuditoriumDate and Time: 5 August, Friday, 4:00pm,
Page last updated on August, 2022