Jamal Ansary

I am an AI Researcher at Volkswagen Group of America, Innovation and Engineering Center California (IECC), where I work on multimodal agents and vision-language-action models for automotive systems.

Email  /  Google Scholar  /  LinkedIn  /  GitHub

profile photo
Research

My research interests lie at the intersection of multimodal foundation models and autonomous agents. I am interested in improving how agents perceive, reason, plan, and interact with complex environments through fine-tuning, distillation, reinforcement learning, post-training, and evaluation. I am particularly interested in grounding and decision making in both digital and physical domains, including computer-use agents, digital assistants, robotics, and autonomous vehicles.

Publications
CASE 2026 paper A Multi-Agent Framework for Robotic HMI Testing Using Multimodal Large Language Models
Jamal Ansary, et al.
IEEE International Conference on Automation Science and Engineering (CASE), 2026

Multi-agent framework for robotic HMI testing using multimodal large language models.

HAB paper Harnessing Vision-Language Models for Improved Detection and Analysis of Harmful Algal Blooms (HAB)
Jamal Ansary, et al.
ACS ES&T Water, 2025

Vision-language models for improved detection and analysis of harmful algal blooms.

COVID-19 paper Machine-Learning Approaches in COVID-19 Survival Analysis and Discharge-Time Likelihood Prediction Using Clinical Data
Mohammadreza Nemati, Jamal Ansary
Patterns: Cell Press, 2020

Using machine learning techniques to estimate survival rate of COVID-19 patients.

Sol-gel paper Sol-gel Process Applications: A Mini-review
Amir Dehghanghadikolaei, Jamal Ansary, Reza Ghoreishi
Proceedings of the Nature Research Society, 2019

Review of sol-gel process applications.

USV paper Swarms of Aquatic Unmanned Surface Vehicles (USV), a Review From Simulation to Field Implementation
Jamal Ansary, Jacob O’Donnell, Nashiyat Fyza, Brian Trease
ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2020

Swarm robotics is a field of multi-robotics in which robot behavior is inspired by nature.

Notes

Short research notes on multimodal agents, grounding, reasoning, planning, and autonomous systems.

Grounding Is a Reasoning Problem Grounding Is a Reasoning Problem
Research Note • Coming soon: This article will be updated

Grounding is often treated as finding the right button or object. But in real interfaces, the target may not even be visible yet. To open Settings while inside Navigation, an agent must reason about context, go Home, find the Settings app, and only then act. This note argues that grounding is not just localization, it is reasoning over intent, state, semantics, and action.

Media Coverage
Volkswagen Group Research & Development How Volkswagen is Accelerating Innovation in Vehicle Development
Volkswagen Group Research & Development, 2026

What started as a side project evolved into GHOST, Volkswagen's AI-powered platform for automated infotainment testing. As the original proposer and technical lead, I led the development of multimodal agents that autonomously interact with Android automotive systems. The project was highlighted by Volkswagen Group Research & Development as an example of how AI is transforming vehicle development.

WTOL News Machine Learning for COVID-19 Outcome Prediction
WTOL News, 2020

What started as a side project during the COVID-19 lockdown evolved into a machine learning study on patient survival analysis and discharge-time prediction. The work was later featured by WTOL News and demonstrated the potential of data-driven methods for clinical outcome prediction.