Abbaas Alif Mohamed Nishar · Applied Scientist at Capital One

I build conversational AI and study where it goes wrong.

I fine-tune models for multi-turn conversations, build evaluation tools that explain why assistants fail, and develop tools to deploy GPU-backed models. My research covers video-language evaluation, neural decoding, and event cameras. I hold a Ph.D. in Computer Science from Georgia State University.

Work & research experience

Capital One

Applied Scientist

Jun 2025–Present

I work across the lifecycle of conversational AI: training models to route requests, evaluating what happens after routing, and building tools to operate models in production.

Multi-turn intent classification
I fine-tune language models to route requests that depend on earlier turns. Retrieval narrows the candidate intents, and constrained decoding limits predictions to those candidates. I evaluate failures on ambiguous requests, missing context, and overlapping labels.
Conversation evaluation & failure analysis
I built review tools that group recurring failures and separate a routing mistake from a task that remained unfinished even though the request was understood. That gives reviewers evidence for what to fix next.
Model deployment & operations
I built tools to deploy and monitor GPU-backed language models and route proposed operational changes for human approval.
Jul 2023–Jun 2025
Revelio Communications

Founding Engineer

Built the screen-to-camera pipeline for embedding data in video and recovering it on a smartphone. Worked across adaptive encoding and the two-stage neural decoder, including cases where the screen and camera were not synchronized.

See the screen-to-camera project
Aug 2021–Jun 2025
Georgia State University

Graduate Research Assistant

Built and evaluated optical communication and sensing prototypes with event cameras. Developed a non-line-of-sight receiver using asynchronous pixel events and investigated how reflective surfaces and modulation affect signal recovery.

Read the event-camera paper
May–Aug 2022
American Family Insurance

Data Science Intern

Developed image segmentation for home-inspection imagery and automated multi-GPU training.

Aug 2020–Aug 2021
Tata Consultancy Services

DevOps Engineer

Built retail forecasting dashboards and Jenkins CI/CD pipelines.

Dec 2019–Jun 2020
Tata Consultancy Services

Research Intern

Prototyped AR/VR and computer vision applications for clothing-pattern detection and text-to-avatar interfaces.

Industry work

When the assistant understands but doesn’t help

I work on two parts of a conversation: recognizing what someone wants and checking whether the response helped them do it. I built evaluation tools that let reviewers distinguish a misunderstood request from an incomplete answer. That distinction points to two different fixes: change how the request is interpreted, or change what happens next.

Fictional example · Library assistant

Reader: “Can I renew my book?”

Assistant: “To renew a book, go to your account.”

Request understood
Yes
Renewal confirmed
No

The reply gives instructions; it does not establish that the book was renewed.

Video understanding

REVEAL: Did the model watch the video?

What happens when a familiar action plays backward? In REVEAL, my co-authors and I tested whether video-language models followed the action on screen or described what they expected to happen. Some models described the forward action even when the clip was reversed.

Published scope: Five controlled tests across 12 video-language models, covering failures such as weak cross-frame integration and reliance on language cues.

A ball falls toward the floor in three forward frames and appears to rise in the reversed sequence.
Illustration of the test
Read the REVEAL paper

Computer vision

Revelio: Sending data from a screen to a phone

My co-authors and I built a way to embed information in video without adding a visible code to the picture. A standard smartphone camera captures the screen, and a neural decoder recovers the message even when the screen and camera are not synchronized.

Published result: Zero decoding errors across four videos at distances up to 2 m in direct-view tests.

Video to screen to phone camera to decoded message.
Screen-to-camera pipeline
Read the Revelio paper

Other work

  • Model deployment

    I built tools for deploying and monitoring GPU-backed language models, with human review before operational changes.

  • Neuromorphic-camera optical communication

    An event-camera receiver for optical communication without direct line of sight.

    Read the neuromorphic camera paper
Show all projectsShow fewer projects
  • Self-adapting language models

    Research on how language models can adapt selectively as tasks and feedback change.

  • GFlowNet red-teaming

    Research exploring diverse language-model failure modes for safety evaluation.

  • Text2Net

    A tool for turning plain-text network descriptions into interactive simulations.

  • OpenRadon

    A soil-radon sensing and mapping testbed.

    View radon data-processing scripts

Publications

Google Scholar
Show all publications and patentsShow fewer publications and patents
  • Text2Net: Transforming Plain-text to a Dynamic Interactive Network Simulation Environment

    IEEE SoutheastCon 2025

    Read paper
  • Non Line-of-Sight Optical Wireless Communication Using Neuromorphic Cameras

    EWSN 2025

    Read paper
  • Towards Modeling Underground Soil Radon Gas Emanation

    IEEE SoutheastCon 2024 · pp. 1157–1166

    Read paper
  • A Framework for Classifying Applications from Raw Network Traffic Traces

    IEEE SoutheastCon 2024 · Best Student Paper Award

  • Joint Optical Wireless Communication and Sensing Using Neuromorphic Cameras

    ACM/IEEE IPSN 2024 · Third Place Best Poster

Patent

  • Machine learning based system and method for controlling residual artifacts in media contents to optimize user experience in real-time screen-to-camera communication environment

    U.S. Patent 12,676,939 · 2026 (application US20250030811A1)

    Read patent record

Recognition & service

AWARDS

Best Student Paper
IEEE SoutheastCon 2024

Also Third Place Best Poster at ACM/IEEE IPSN 2024 and Third Place Oral Presentation at the GSU Graduate Research Conference.

LEADERSHIP

President
IEEE at GSU

Led the student chapter from June 2024 through 2025 and organized IdEEEathon 2024 with IEEE Atlanta and Young Professionals.

TEACHING + SERVICE

Guest lecturer
and mentor

Guest lectures in Advanced Computer Vision and Introduction to Robotics, plus a Girls Who Code Raspberry Pi workshop.

Choose a résumé

abbaasalif6998@gmail.com