Computer vision and AI researcher focused on detection, tracking, and applied ML.

Research Assistant

Office of Strategic Initiatives, University at Albany - Albany, NY - Aug 2024 to Present

• Led development of a full-stack LLM-powered assistant for retrieval, Q&A, and knowledge-based automation.
• Built RAG pipelines with hybrid retrieval, metadata indexing, and cross-encoder reranking.
• Developed agentic reasoning systems with task decomposition, memory modules, and workflow orchestration.
• Created automated LLM evaluation systems including hallucination detection, relevance scoring, and safety checks.

Adjunct Lecturer

Dean's Office, Rockefeller College - Albany, NY - May 2024 to Jul 2024

• Taught labs for Introduction to Computer Science; evaluated projects and exams.
• Mentored students individually and in groups on coursework and technical challenges.

Teaching Assistant

University at Albany, SUNY - Albany, NY - Aug 2022 to May 2024

• Supported courses including Data Mining, Machine Learning, AI, Computer Vision, Networks, OS, DBMS, and Intro CS.
• Delivered lectures, guided labs, and managed assessments.

Research Intern (Computer Vision & Deep Learning)

Siemens Healthineers - Princeton, NJ - May 2022 to Aug 2022

• Performed object detection and tracking with high accuracy for a product-specific environment.
• Set up the initial product pipeline and framework.
• Analyzed legacy datasets to generate quantitative insights and applied data processing for new algorithm compatibility.

Research Intern (Computer Vision & ML)

Siemens Healthineers - Princeton, NJ (Virtual) - May 2021 to Aug 2021

• Delivered object detection and tracking for product-specific environments.
• Set up pipelines and analyzed legacy datasets for quantitative insights.
• Processed historical data for compatibility with new algorithms.

Research Assistant

The Research Foundation of SUNY - Albany, NY - Jan 2020 to May 2021

• Performed object detection and tracking for product-specific environments.
• Contributed to pipeline and framework setup for computer vision analytics.

Sr. Research Project Assistant (Full-time)

The Research Foundation of SUNY - Albany, NY - Jul 2019 to Dec 2019

• Developed rail yard management and crossing protection systems using CV analytics, detection, tracking, and re-identification.
• Managed edge deployments with NVIDIA AGX Xavier and multi-camera inputs.
• Processed and analyzed datasets to improve product-relevant models.

Seizure Detection in Animals

AMC, GE HealthCare, UAlbany - Mar 2023 to Present

Detection and prediction of seizure and animal states during induced and natural conditions using pose estimation and behavior analysis.

DARPA Semantic Forensics (SemaFor)

Kitware & UAlbany - Jan 2020 to Dec 2023

Detected falsified media/news using semantic forensics across object, scene text, and human pose signals.

Railcar Locomotive Yard Detection

GE Research & UAlbany - Jul 2019 to Dec 2021

Rail yard management system using CV analytics, object detection, tracking, and re-identification with edge plus control center architecture.

Rail Crossing Point Protection

GE Research & UAlbany - Jan 2020 to Jan 2021

Enhanced rail crossing safety using instance segmentation, multi-object tracking, and rule-based logic.

AI City Challenge

UAlbany - Jan 2021 to Aug 2021

Analyzed submissions for detection, tracking, re-identification, and road anomaly tasks.

UA-DETRAC Dataset v1.5

Research Foundation of SUNY - Jul 2019 to Dec 2019

Added vehicle colors and subclasses and verified ground truth for large-scale traffic analytics.

Conference papers / manuscripts

• A Computer Vision System for Visual Detection, Identification, and Tracking for Rail Transportation Management. Manuscript.
• Scene Text Manipulation Data Generation and Detection. Manuscript.

Peer-reviewed

• TextSleuth: A New Dataset and Baseline for Scene Text Manipulation Detection. MIPR, 2024.
• FlagDetSeg: Multi-Nation Flag Detection and Segmentation in the Wild. AVSS, 2021.
• A Video Analytic System for Rail Crossing Point Protection. AVSS, 2021.
• Railcar Detection, Identification and Tracking for Rail Yard Management. ICIP, 2020.

In preparation

• Automated Feature Extraction and Classification for Rodent Seizure Detection Using Computer Vision and Machine Learning. Ready to submit.
• Detecting Image Text Alteration Using Geometric Mapping, Texture and Font Inconsistency.
• Scene Text Language Detection and Classification.
• Multilingual Scene Text Detection and Recognition.

• Vehicle type and color detection (UA-DETRAC): YOLOv3 and KNN for 12 vehicle types and 9 colors with strong accuracy under varied conditions.
• Movie success prediction: Twitter and IMDb mining for box office accuracy near 80%.
• Stock price prediction: Intraday pipeline using pattern recognition, NLP, storyline analysis across tweets, news, and market data.
• Library Management System: Java app for institutional library workflows.

• Social Geo Tagging Web App: PHP app aggregating social data and mapping alumni connections.
• Online Yearbook: Full-stack web app for comments and social links.
• Smart Attendance System: IoT RFID and Arduino with Google Sheets API backend.
• Hand Gesture Control: MATLAB-based webcam gesture recognition for input control.

Membership

IEEE, ACM

Reviewer (selected)

ICIP (2020-2024), ICME, MICCAI, AVSS, AICity, IMPROVE, Signal Processing: Image Communication, TVCJ, MDPI, TMM.

Professional training

• New York State Cyber Security Conference (2018)
• AWS Innovate: ML and AI Edition (2019)

Technical

Python, C, C++, Java, CUDA, MATLAB

PyTorch, TensorFlow, scikit-learn, matplotlib

Systems & tools

Linux, Linux-server, Windows, macOS, VirtualBox, VMWare, vSphere, Visual Studio

Edge: NVIDIA AGX Xavier, Nano, Raspberry Pi, Google Coral

Collaboration

Public speaking, teamwork, leadership, time management, communication, problem-solving

Infrastructure

Managed GPU and data servers (software, hardware, networks, security) for UAlbany CVML lab.

Administered lab GitLab, Nextcloud, and DE-TRAC servers.

Mentoring

Advised master's and high-school students on projects and research.

• Srujan Vepuri
• Ragini Rani
• Nidhi Vadnere
• Patrick Dai (UCLA)

Languages

English - Native/Bilingual

Hindi - Native/Bilingual

Others

Hobbies: Piano playing, photography, exploring new developments in technology.