|
Research
My research interests lie at the intersection of multimodal foundation models and autonomous agents.
I am interested in improving how agents perceive, reason, plan, and interact with complex environments
through fine-tuning, distillation, reinforcement learning, post-training, and evaluation. I am particularly
interested in grounding and decision making in both digital and physical domains, including computer-use
agents, digital assistants, robotics, and autonomous vehicles.
|
|
A Multi-Agent Framework for Robotic HMI Testing Using Multimodal Large Language Models
Jamal Ansary, et al.
IEEE International Conference on Automation Science and Engineering (CASE), 2026
Multi-agent framework for robotic HMI testing using multimodal large language models.
|
|
Harnessing Vision-Language Models for Improved Detection and Analysis of Harmful Algal Blooms (HAB)
Jamal Ansary, et al.
ACS ES&T Water, 2025
Vision-language models for improved detection and analysis of harmful algal blooms.
|
|
Machine-Learning Approaches in COVID-19 Survival Analysis and Discharge-Time Likelihood Prediction Using Clinical Data
Mohammadreza Nemati, Jamal Ansary
Patterns: Cell Press, 2020
Using machine learning techniques to estimate survival rate of COVID-19 patients.
|
|
Sol-gel Process Applications: A Mini-review
Amir Dehghanghadikolaei, Jamal Ansary, Reza Ghoreishi
Proceedings of the Nature Research Society, 2019
Review of sol-gel process applications.
|
|
Swarms of Aquatic Unmanned Surface Vehicles (USV), a Review From Simulation to Field Implementation
Jamal Ansary, Jacob O’Donnell, Nashiyat Fyza, Brian Trease
ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2020
Swarm robotics is a field of multi-robotics in which robot behavior is inspired by nature.
|
|
Notes
Short research notes on multimodal agents, grounding, reasoning, planning,
and autonomous systems.
|
|
Grounding Is a Reasoning Problem
Research Note • Coming soon: This article will be updated
Grounding is often treated as finding the right button or object. But in
real interfaces, the target may not even be visible yet. To open Settings
while inside Navigation, an agent must reason about context, go Home,
find the Settings app, and only then act. This note argues that grounding
is not just localization, it is reasoning over intent, state, semantics,
and action.
|
|
How Volkswagen is Accelerating Innovation in Vehicle Development
Volkswagen Group Research & Development, 2026
What started as a side project evolved into GHOST, Volkswagen's AI-powered platform
for automated infotainment testing. As the original proposer and technical lead, I led the development
of multimodal agents that autonomously interact with Android automotive systems. The project was
highlighted by Volkswagen Group Research & Development as an example of how AI is transforming
vehicle development.
|
|
Machine Learning for COVID-19 Outcome Prediction
WTOL News, 2020
What started as a side project during the COVID-19 lockdown evolved into a machine learning study on patient survival analysis and discharge-time prediction. The work was later featured by WTOL News and demonstrated the potential of data-driven methods for clinical outcome prediction.
|
|