Stroke-Level Connectivity Verification: Grounding Vision-Language Models Against Topology Hallucination in Diagram Understanding
Md Ashikur Rahman is a Lead AI Engineer at The KOW Company, leading 15+ engineers and researchers building production vision-language and LLM systems.
His AI work focuses on multimodal and vision-language AI, LLM safety, hallucination and reliability, video understanding, model fine-tuning, and AI interpretability, with recent research on prompt safety submitted to major AI, NLP, computer vision, and document analysis venues.
He builds reliable AI systems from research prototypes to fine-tuned models and production deployment for real-world enterprise use.
Recent Highlights
- Paper accepted at ICDAR 2026 on diagram understanding with LogicBench-1K.
- New manuscript submitted to a peer-reviewed venue; two prior manuscripts currently under review.
- The Fitting Room approaching public launch with 170+ global brands onboarded.
- CogniX R&D initiated for exploratory multi-reference image fusion and editing.
Education
B.Sc. in Computer Science & Engineering, American International University-Bangladesh (AIUB), 2011-2015. CGPA 3.87/4.00 (WES 3.94/4.00).
Publications
Selected Projects
- Initiated CogniX as an early-stage R&D effort to explore generalized multi-reference image fusion and prompt-guided image editing.
- Exploring architecture options for generating a coherent output image from a prompt and 1-3 reference images.
- Evaluating Qwen-Image-Edit-2509 and related multi-image conditioning approaches for tasks such as product visualization, garment replacement, scene composition, style transfer, and object-level image editing.
- Experimenting with LoRA/QLoRA fine-tuning strategies, 4-bit NF4 quantization, and PyTorch/Diffusers-based training workflows.
- Investigating dataset design for variable-length multi-reference inputs, semantic instructions, attribute-rich prompts, and preservation constraints.
- Testing ComfyUI-based inference workflows for multi-image upload, graph-based execution, VRAM control, and LoRA-enabled generation.
- Qwen-Image-Edit-2509
- Qwen2.5-VL
- MMDiT
- QLoRA
- LoRA
- NF4 Quantization
- PyTorch
- Diffusers
- ComfyUI
- Conceived the product idea and co-led the system design for a unified cross-brand virtual try-on platform.
- Designed the user workflow where shoppers can browse products from hundreds of brands, virtually try them on, and purchase from one place.
- Co-architected the platform architecture and technical pipeline, including a Dockerized FastAPI backend behind Nginx, SQL Server data layer, Google Cloud Storage for assets, Redis for caching, recommendation design, and 2D virtual try-on workflows.
- Fine-tuned CogniX, an internal Qwen-based LLM using LoRA, for garment understanding, catalog matching, product recommendation, and product-to-user try-on reasoning across diverse apparel categories.
- CogniX
- Qwen
- LoRA
- PyTorch
- FastAPI
- Redis
- Docker
- Nginx
- Google Cloud VM
- Google Cloud Storage
- SQL Server
- Leading development of an AI site-audit platform for a major US retail client, automating quality checks across product imagery, catalog data, and backend content health.
- Built image-audit workflows to detect inappropriate content, sheer-garment visibility, offensive tattoos, vulgar copy, crop inconsistencies, retouching defects, face-crop issues, and duplicate or near-duplicate images.
- Developed data-audit capabilities to validate product copy, color and style attribution, product-type metadata, image origination tags, and DAM/CMS integration requirements.
- Designed backend audit checks for inventory gaps, broken image and swatch links, alt-text quality, and pages requiring updates or removal.
- Computer Vision
- NLP
- PyTorch
- FastAPI
- Co-participated in the system design and architecture of Omnimage.ai, an AI platform for generating images and videos from text prompts and reference images.
- Helped design the technical pipeline for prompt-based generation, reference-image conditioning, image editing, video generation, background processing, asset handling, and downstream platform integration.
- Enabled users to select from multiple state-of-the-art generation models, including Gemini Nano Banana, Kimi Krea, and other image/video generation models.
- Built production APIs and backend workflows for generation requests, background processing, and delivery to downstream systems.
- Supported onboarding and usage across 200+ brands using the platform for creative and product-image workflows.
- LLaMA
- PyTorch
- FastAPI
- Built a 3D asset pipeline that converts 360° video, multi-view image sequences, and reference images into textured 3D assets.
- Implemented camera pose estimation, structure-from-motion, and multi-view geometry workflows for automated 3D reconstruction.
- Explored image-to-3D generation using sparse 3D latent representations, transformer-based generation, and multi-format decoding.
- Optimized reconstruction quality and processing efficiency to reduce manual 3D cleanup and editing effort.
- PyTorch
- Open3D
- COLMAP
- Docker
- CUDA
- Diffusers
- Transformers
- 3D Gaussian Splatting
- Mesh Processing
- GLB/OBJ
- Developed and optimized deep-learning models for salient object detection and image segmentation in automated background-removal workflows.
- Improved segmentation quality and processing speed over the previous production baseline, achieving a 17% accuracy gain and 30% faster processing.
- Optimized inference for large image inputs, processing 257 MB images in 2.27 seconds using U-Net/RSU-style architecture blocks and advanced pooling.
- Built the production segmentation pipeline for large-scale background-removal workloads, supporting 4.5M+ images processed globally across hundreds of customers worldwide.
- PyTorch
- TensorFlow
- U-Net variants
- FastAPI
- Redis
- Docker
- GCP
Production client: leading European luxury resale marketplace
- Helped optimize a .NET and SQL Server workflow platform for high-volume image-processing operations.
- Improved backend flows across FTP ingestion, order management, editor assignment, AI processing, QC validation, and automated delivery.
- Worked on job routing, batch processing, status tracking, and handoff automation to reduce manual work across the production pipeline.
- Supported integration of Omnimage.ai and Retouched.ai for AI-assisted background removal, image enhancement, and asset preparation.
- Helped the team support production throughput of about 17K images per day, with average batch turnaround of about 65 minutes.
- .NET
- SQL Server
- FTP
- Omnimage.ai
- Retouched.ai
- Built an audio intelligence workflow for customer-service QA using speech transcription and LLM-based phrase extraction.
- Deployed SeamlessM4T for audio-to-text transcription across customer-service conversations.
- Integrated Llama 2 to extract contextual key phrases from transcribed calls for QA review and downstream analysis.
- Built API workflows for transcription, phrase extraction, result validation, and integration with QA systems.
- Reduced manual review effort by automating transcription and key-phrase spotting across customer-service audio.
- SeamlessM4T
- Llama 2
- PyTorch
- FastAPI
Experience
Leadership & Management
- Lead 15+ engineers and researchers across enterprise delivery, applied research, and product development.
- Own execution across AI workstreams; improved delivery workflows and maintain 90-95% on-time delivery across concurrent projects.
- Review ML and software engineering work for correctness, scalability, reliability, and maintainability.
- Mentor junior ML engineers and researchers on research methods, model development, evaluation, and production standards.
Engineering Practices
- Lead system design reviews covering scalability, reliability, data flow, integration patterns, and trade-offs.
- Define engineering standards that improve code quality, maintainability, extensibility, and system scalability.
Research & Technical
- Lead research on AI hallucination, prompt safety, vision-language model reliability, and video understanding; prepare manuscripts for peer-reviewed venues including ICDAR 2026.
- Develop evaluation frameworks and experimental pipelines for hallucination, grounding, safety, and multimodal model evaluation.
- Build AI systems using vision-language models, LLM fine-tuning, 3D reconstruction, and pose estimation.
- Publish reproducible code, datasets, and models on GitHub and Hugging Face.
- Collaborate with East West University faculty on linear algebra and differential geometry for AI research.
- Improved object detection and segmentation accuracy by 20-35%; advanced production models later deployed through Retouched.ai.
- Led 6+ client ML engagements from business requirements to technical delivery; built A/B testing frameworks for model validation.
- Delivered customer segmentation and territory mapping models, contributing to measurable marketing strategy improvements.
- Built deep learning models for production object recognition, image segmentation, and background-removal workflows.
- Developed scalable preprocessing, training, and A/B testing workflows to move models from experimentation into production.
Enterprise Software Development
- Developed ERP modules in .NET across HR, inventory, procurement, audit, sales, and predictive analytics.
- Led end-to-end delivery of the supply chain module, including system architecture, domain modeling, business logic, and database integration.
- Automated the full supply chain workflow, reducing manual paperwork by 90%.
- Achieved 70-75% process automation across core ERP workflows and increased report visualization coverage by 45%.
- Designed a modular and scalable architecture that reduced new-feature development time by 30-40%.
- Implemented role-based access control, validation rules, reporting workflows, and approval flows across ERP modules.
Data Engineering & Performance Optimization
- Reduced report generation time from approximately 20 minutes to 40-54 seconds on a 4TB SQL Server ERP database through index restructuring, query optimization, and execution-plan analysis.
- Optimized complex SQL queries, stored procedures, joins, indexes, and reporting views for high-volume enterprise data.
- Built an offline-capable synchronization scheduler with a 99.9% success rate, including conflict detection, retry handling, and automated recovery with no data loss.
- Reduced overall database load by 35% through targeted caching, query-level optimization, and improved data access patterns.
- Developed and maintained production features for DevSkill.com using ASP.NET MVC.
- Built backend services, database integrations, and web interfaces for user-facing platform features.
- Applied SOLID principles, design patterns, and clean-code practices to improve maintainability and extensibility.
- Worked across application logic, UI updates, and relational database operations in a production web environment.
Technical Skills
- Core AI
- PyTorch · Vision-Language Models · Large Language Models · Computer Vision · Multimodal Learning · Video Understanding · LoRA / QLoRA Fine-tuning · AI Interpretability · 3D Reconstruction
- Generative AI & VLMs
- Qwen / Qwen-VL · Qwen-Image-Edit · LLaMA / Llama 2 · Diffusion Models · Diffusers · Image & Video Generation · Multi-Reference Image Conditioning · Prompt Safety · Hallucination Evaluation · Visual Grounding · ComfyUI
- Computer Vision & 3D
- Object Detection · Semantic / Instance Segmentation · Salient Object Detection · U-Net / RSU Architectures · Pose Estimation · Multi-View Geometry · Structure-from-Motion · 3D Gaussian Splatting · COLMAP · Open3D · Mesh Processing
- Audio, NLP & Evaluation
- Speech Transcription · SeamlessM4T · NLP · Contextual Key-Phrase Extraction · Fine-tuning Pipelines · NF4 Quantization · A/B Testing · Model Evaluation · Dataset Design · Weights & Biases
- Backend, MLOps & Cloud
- FastAPI · Docker · Nginx · Redis · CI/CD · Model Serving · Google Cloud Platform · Google Cloud Storage · TensorFlow
- Software & Data
- Python · C# / .NET · SQL Server · FTP
Honors and Awards
- Champion - BASIS National ICT Awards 2020, Retouched.ai
- Finalist - APICTA 2021, Asia Pacific ICT Alliance Awards
- Academic Excellence Award - Magna Cum Laude, AIUB, Top 3%
- Merit Scholarship and Tuition Fee Waiver - AIUB
Contact
Open to research collaboration, speaking invitations, and professional inquiries in vision-language AI, LLM systems, and applied machine learning.
- mdashikur.rafi@gmail.com
- Google Scholar
- Dhaka, Bangladesh