Stroke-Level Connectivity Verification: Grounding Vision-Language Models Against Topology Hallucination in Diagram Understanding
Md Ashikur Rahman is a Lead AI Engineer at The KOW Company, leading 15+ engineers and researchers building production multimodal AI, vision-language, and LLM systems.
His AI work focuses on multimodal and vision-language AI, generative image models, LLM safety, hallucination and reliability, video understanding, model fine-tuning, and AI interpretability, with recent research on prompt safety submitted to major AI, NLP, computer vision, and document analysis venues.
He builds reliable AI systems from research prototypes to fine-tuned models and production deployment for real-world enterprise use.
Recent Highlights
- Paper at ICDAR 2026 on diagram understanding with LogicBench-1K.
- New manuscript submitted to a peer-reviewed venue; two prior manuscripts currently under review.
- The Fitting Room approaching public launch with 170+ global brands onboarded.
- CogniX early-stage R&D underway for a proprietary multimodal image-generation and editing initiative.
Education
B.Sc. in Computer Science & Engineering, American International University-Bangladesh (AIUB), 2011-2015. CGPA 3.87/4.00 (WES 3.94/4.00).
Publications
Selected Projects
- Leading early-stage R&D for CogniX, a proprietary multimodal image-generation and editing initiative for product visualization workflows, aimed at reducing reliance on third-party model providers.
- Exploring multi-reference fusion and prompt-guided image editing for garment replacement, scene composition, product visualization, and style transfer using LoRA-based adaptation, quantized fine-tuning experiments, PyTorch/Diffusers, and ComfyUI workflows.
- Investigating dataset design for variable-length multi-reference inputs, semantic instructions, attribute-rich prompts, and preservation constraints.
- Qwen-Image-Edit
- Qwen2.5-VL
- MMDiT
- LoRA
- Quantized Fine-tuning
- PyTorch
- Diffusers
- ComfyUI
- Conceived and co-led a unified cross-brand virtual try-on platform across 170+ brands.
- Designed the user workflow where shoppers can browse products from hundreds of brands, virtually try them on, and purchase from one place.
- Architected Dockerized FastAPI/Nginx backend with SQL Server, Google Cloud Storage, Redis, recommendation workflows, and 2D try-on pipelines.
- PyTorch
- FastAPI
- Redis
- Docker
- Nginx
- Google Cloud VM
- Google Cloud Storage
- SQL Server
- Leading AI catalog-audit and image-QA platform for a major US retail client, automating image QA, catalog validation, metadata checks, and content-health monitoring across DAM/CMS workflows.
- Built image-audit workflows to detect inappropriate content, sheer-garment visibility, offensive tattoos, vulgar copy, crop inconsistencies, retouching defects, face-crop issues, and duplicate or near-duplicate images.
- Developed data-audit capabilities to validate product copy, color and style attribution, product-type metadata, image origination tags, and DAM/CMS integration requirements.
- Designed backend audit checks for inventory gaps, broken image and swatch links, alt-text quality, and pages requiring updates or removal.
- Computer Vision
- NLP
- PyTorch
- FastAPI
- Co-designed architecture and production APIs for prompt-based image and video generation with multi-model selection, reference-image conditioning, background processing, and Llama-based prompt classification, intent routing, and model-selection workflows; onboarded 200+ brands for creative and product-image workflows.
- Built production APIs and backend workflows for generation requests, background processing, and delivery to downstream systems.
- Enabled users to select from multiple state-of-the-art generation models for image and video creative workflows.
- Llama (Prompt Classification)
- PyTorch
- FastAPI
- Designed a multi-view 3D reconstruction pipeline for generating textured GLB/OBJ assets from 360° video and image sequences, combining COLMAP-based camera pose estimation and structure-from-motion, multi-view stereo reconstruction, Open3D mesh processing, and experimental NeRF/3D Gaussian Splatting refinement.
- Optimized reconstruction quality and processing efficiency to reduce manual 3D cleanup and editing effort.
- PyTorch
- Open3D
- COLMAP
- Docker
- CUDA
- Diffusers
- Transformers
- 3D Gaussian Splatting
- Mesh Processing
- GLB/OBJ
- Developed production salient-object segmentation for background removal; improved segmentation quality by 17% on internal benchmarks, reduced processing time by 30%, supported uploads up to 257 MB, and achieved 2.27s average processing time across standard production workloads.
- Scaled Retouched.ai to 4.5M+ images processed globally across hundreds of customers using PyTorch, U²-Net-inspired salient-object segmentation architecture, FastAPI, and GCP.
- PyTorch
- TensorFlow
- U²-Net-inspired Segmentation
- FastAPI
- Redis
- Docker
- GCP
Production client: leading European luxury resale marketplace
- Optimized .NET/SQL Server workflow for a leading European luxury resale marketplace; integrated Omnimage.ai and Retouched.ai across FTP ingestion, QC validation, and automated delivery; ~17K images/day, ~65-minute average batch turnaround.
- .NET
- SQL Server
- FTP
- Omnimage.ai
- Retouched.ai
- Built customer-service QA workflow with a SeamlessM4T-based speech transcription/translation pipeline and Llama 2-based contextual key-phrase extraction; automated transcription, validation, and review pipelines via FastAPI, reducing manual audio review effort.
- SeamlessM4T
- Llama 2
- PyTorch
- FastAPI
Experience
Leadership & Management
- Lead 15+ engineers and researchers across enterprise delivery, applied research, and product development.
- Maintain 90-95% on-time delivery across AI engineering projects.
- Review ML and software engineering work for correctness, scalability, reliability, and maintainability.
- Mentor junior ML engineers and researchers on research methods, model development, evaluation, and production standards.
Engineering Practices
- Lead system design reviews covering scalability, reliability, data flow, integration patterns, and trade-offs.
- Define engineering standards that improve code quality, maintainability, extensibility, and system scalability.
Research & Technical
- Build production vision-language and LLM systems across virtual try-on, image and video generation, 3D reconstruction, catalog audit and image-QA, and audio QA platforms.
- Lead applied research on AI hallucination, prompt safety, visual grounding, and video understanding; corresponding author on ICDAR 2026 paper.
- Develop production segmentation and image-processing systems, including Retouched.ai; publish reproducible code, datasets, and models on GitHub and Hugging Face.
- Develop evaluation frameworks and experimental pipelines for hallucination, grounding, safety, and multimodal model evaluation.
- Collaborate with East West University faculty on linear algebra and differential geometry for AI research.
- Improved object detection and segmentation performance by 20-35% across internal evaluation benchmarks; advanced production models later deployed through Retouched.ai.
- Led 6+ client ML engagements from business requirements to technical delivery; built offline evaluation pipelines and production A/B testing workflows to validate model quality, performance, and deployment impact.
- Delivered customer segmentation and territory mapping models, contributing to measurable marketing strategy improvements.
- Built deep learning models for production object recognition, image segmentation, and background-removal workflows.
- Developed scalable preprocessing, training, and A/B testing workflows to move models from experimentation into production.
Enterprise Software Development
- Developed ERP modules in .NET across HR, inventory, procurement, audit, sales, and predictive analytics.
- Led end-to-end delivery of the supply chain module, including system architecture, domain modeling, business logic, and database integration.
- Automated the full supply chain workflow, reducing manual paperwork by 90%.
- Achieved 70-75% process automation across core ERP workflows and increased report visualization coverage by 45%.
- Designed a modular and scalable architecture that reduced new-feature development time by 30-40%.
- Implemented role-based access control, validation rules, reporting workflows, and approval flows across ERP modules.
Data Engineering & Performance Optimization
- Reduced report generation time from approximately 20 minutes to 40-54 seconds on a 4TB SQL Server ERP database through index restructuring, query optimization, and execution-plan analysis.
- Optimized complex SQL queries, stored procedures, joins, indexes, and reporting views for high-volume enterprise data.
- Built an offline-capable synchronization scheduler with a 99.9% success rate, including conflict detection, retry handling, and automated recovery with no data loss.
- Reduced overall database load by 35% through targeted caching, query-level optimization, and improved data access patterns.
- Developed and maintained production features for DevSkill.com using ASP.NET MVC.
- Built backend services, database integrations, and web interfaces for user-facing platform features.
- Applied SOLID principles, design patterns, and clean-code practices to improve maintainability and extensibility.
- Worked across application logic, UI updates, and relational database operations in a production web environment.
Technical Skills
- Core AI
- Python · PyTorch · Vision-Language Models · Large Language Models · Computer Vision · Multimodal Learning
- LLMs
- Llama · Qwen · Prompt Safety · Hallucination Evaluation · Visual Grounding
- Generative AI
- Diffusion Models · LoRA/QLoRA Fine-tuning and Adaptation · Prompt-Guided Image Editing
- Computer Vision & 3D
- Object Detection · Segmentation · Pose Estimation · Multi-View Stereo · NeRF-style Reconstruction · 3D Gaussian Splatting · COLMAP · Open3D
- Research & Evaluation
- Offline Evaluation · Production A/B Testing · Model Evaluation · Dataset Design · Weights & Biases
- Audio & NLP
- SeamlessM4T-based Speech Transcription/Translation · Llama 2
- Backend & Cloud
- FastAPI · Docker · Nginx · Redis · CI/CD · Model Serving · Google Cloud Platform · Google Cloud Storage · Amazon S3 · DynamoDB · SQL Server
Honors and Awards
- Champion - BASIS National ICT Awards 2020, Retouched.ai
- Finalist - APICTA 2021, Asia Pacific ICT Alliance Awards
- Academic Excellence Award - Magna Cum Laude, AIUB, Top 3%
- Merit Scholarship and Tuition Fee Waiver - AIUB
Contact
Open to research collaboration, speaking invitations, and professional inquiries in vision-language AI, LLM systems, and applied machine learning.
- mdashikur.rafi@gmail.com
- Google Scholar
- Dhaka, Bangladesh