Biography
Hi! I am Karmesh, a PhD student at Georgia Tech, advised by Prof. Dhruv Batra and Prof. Zsolt Kira.
During my PhD I am interested in creating better pretraining strategies for Embodied AI agents. Previously, I was an AI Resident at FAIR, working with the Habitat and Cortex team under the supervision of Dr. Oleksandr Maksymets and Prof. Batra. Before that, I worked as a Senior Robotics Engineer at ISEE, an autonomous vehicles startup working on automating yard trucks. I completed my Masters in Robotics Systems Development (MRSD) at the CMU Robotics Institute in 2020.
Download my resumé.
- Embodied AI
- Robot Learning
- Reinforcement Learning
Ph.D. in Computer Science, 2026
Georgia Institute of Technology
Masters in Robotic Systems Development, 2020
Carnegie Mellon University
B.Tech in Mechanical Engineering, 2017
Indian Institute of Technology, Guwahati
Experience
- Developed deployment pipelines for web agents to operate on real websites while effectively avoiding bot detection.
- Created data filtering pipeline and trained VLM-based agents for web navigation tasks.
- Worked on self-supervised pretraining techniques for learning useful representations for embodied agents.
- Released the HM3D-Semantics dataset and the Open-Vocabulary Mobile Manipulation benchmark based of Habitat Simulator.
- Organised multiple challenges on Embodied Navigation and Rearrangement in CVPR and NeurIPS.
- Explored deep uncertainty estimation techniques for predicting the closed loop tracking performance of an autonomous vehicle controller. Estimated the collision probability of the AV with respect to obstacles in an occupancy grid.
- Improved the trajectory optimization planner and robustified its collision checking. This led to an increased confidence in its performance and resulted in its deployment on the AV.
- Developed the speed planning module for safely achieving three-fold increase in the operating speed of the AV.
- Built toolboxes to automate the system identification and calibration procedure of Isee’s vehicles.
- Researched and implemented various vehicle and tire models for control application in AVs.
