Md Basim Uddin Ahmed

Applied AI Researcher & Software Engineer

I combine three years of backend engineering with two years of research on LLM agents, software security, and automated testing.

About Me

Md Basim Uddin Ahmed

I'm a software engineer and MSc Computer Science graduate from York University. My work combines Java/Spring Boot backend development with research on LLM agents, software security, and automated testing.

At DSi and on an external assignment with Synopsys, I worked on examination-management systems, payment integrations, and CI/CD tooling. During a university research collaboration with Huawei Canada, I developed components for repository-wide test generation and agent tracing and evaluation. My research includes SecVulEval, which received the Best Dataset & Benchmark Paper award at AIware 2026, and StaAgent, accepted in ACM TOSEM.

When I'm not working, you can find me traveling🌴, playing instruments🎸, or experimenting with new technologies🧑‍💻.

Experience

💼Professional Experience

Research & Development Intern - University Collaboration

/icons/company/huawei.svg logoHuawei CanadaCanada (Remote)
Aug 2025 - Sep 2026

Developed Python components for a repository-wide agentic test generation framework that transforms software requirements and repository code into executable test scripts.

  • Built agent workflows with Claude Code, OpenAI SDK, and OpenSearch/RAG; evaluated code retrieval, code maps, and token use efficiency.
  • Built a forward-proxy framework to capture prompts, responses, tool calls, and session-linked agent traces.
  • Designed and implemented a rule-based and LLM-based trace evaluation framework using Langfuse traces.
  • Debugged, documented, and resolved failures in tool use, context awareness, instruction following, and output consistency.
  • Collaborated remotely and on site with Huawei's Beijing engineering and research team.
Python logoPythonClaude Code logoClaude CodeOpenAI SDK logoOpenAI SDKOpenSearch logoOpenSearchRAG logoRAGOpik logoOpikLangfuse logoLangfuseOpenTelemetry logoOpenTelemetry

Associate Software Engineer

Jul 2021 - Jul 2024

Developed backend services for HEMS, a nationwide examination-management platform.

  • Developed Java/Spring Boot REST APIs and PostgreSQL backend functionality for HEMS.
  • Translated client requirements into backend and database designs.
  • Built grading, result-processing, and reporting workflows for approximately 30,000 students annually.
  • Integrated two payment gateways handling approximately BDT 4 million in annual transactions.
  • Implemented mobile-client REST APIs with JWT authentication.
Java logoJavaSpring Boot logoSpring BootPostgreSQL logoPostgreSQLHibernate logoHibernateRedis logoRedisREST APIs logoREST APIsGit logoGitLinux logoLinux

Software Engineer (External)

Aug 2023 - Jul 2024

Worked remotely on an external assignment through DSi with Synopsys Inc., contributing to Black Duck Detect, a software composition analysis tool that identifies dependency-related component, security, and license risks.

  • Contributed Java, Groovy, and Gradle changes to Black Duck Detect.
  • Migrated the Detect project CI/CD pipeline from Jenkins to GitHub Actions.
  • Diagnosed and fixed two defects affecting scheduled jobs and artifact versioning.
  • Migrated analytics from Google Universal Analytics to GA4, restoring a broken reporting dashboard.
Java logoJavaGroovy logoGroovyGradle logoGradleJenkins logoJenkinsGitHub Actions logoGitHub ActionsGA4 logoGA4

💡Research Experience

SecVulEval - Context-Aware C/C++ Vulnerability Benchmark

York UniversityToronto, Canada
Dec 2024 - Aug 2025

Built a real-world C/C++ vulnerability benchmark with 25,440 functions covering 5,867 CVEs.

  • Curated paired vulnerable/fixed code with statement-level vulnerability labels and external program context.
  • Designed and implemented a multi-stage LLM-agent pipeline for context-aware vulnerability detection.
  • Evaluated five LLMs at function and statement levels, with ablations and failure analysis.
  • Received the Best Dataset & Benchmark Paper award at AIware 2026. 🏆
  • Made the dataset publicly available at Hugging Face - SecVulEval for community use.
Python logoPythonOpenAI SDK logoOpenAI SDKTransformers logoTransformersBenchmark construction logoBenchmark constructionLLM evaluation logoLLM evaluationContext-aware agents logoContext-aware agents

StaAgent - An Agentic Framework for Testing Static Analyzers

York UniversityToronto, Canada
Mar 2025 - Jul 2025

Developed an LLM-assisted, mutation-based metamorphic-testing framework for static-analysis rule implementations.

  • My highlighted work uncovered 42 faulty rule implementations across SpotBugs, Error Prone, and PMD.
  • Findings were reported to developers; some issues were already fixed. Status is available in the linked preprint.
  • Accepted as an article in ACM Transactions on Software Engineering and Methodology (TOSEM) 2026.
Python logoPythonJava logoJavaOpenAI SDK logoOpenAI SDKTransformers logoTransformersSpotBugs logoSpotBugsError Prone logoError PronePMD logoPMDMetamorphic testing logoMetamorphic testing

Skills & Technologies

Gen AI

Python iconPythonOpenAI SDK iconOpenAI SDKClaude Code iconClaude CodeAgent Skills iconAgent SkillsRAG iconRAGOpenSearch iconOpenSearchLangGraph iconLangGraph

Machine Learning

PyTorch iconPyTorchOpenCLIPTransformers iconTransformerstorchvision icontorchvisionNumPy iconNumPyPandas iconPandasOpenCV iconOpenCV

Backend

Java iconJavaPython iconPythonJavaScript iconJavaScriptSpring Boot iconSpring BootNode.js iconNode.js

Databases & ORMs

PostgreSQL iconPostgreSQLHibernate iconHibernateRedis iconRedisSQLAlchemy iconSQLAlchemy

DevOps

Docker iconDockerGitHub Actions iconGitHub ActionsJenkins iconJenkinsMaven iconMavenGradle iconGradleLinux iconLinuxBash iconBashGit iconGit

Frontend

JavaScript iconJavaScriptReact.js iconReact.jsJSX iconJSXTailwind CSS iconTailwind CSSHTML5 iconHTML5CSS3 iconCSS3

Observability & Evaluation

Opik iconOpikLangfuse iconLangfuseOpenTelemetry iconOpenTelemetryGoogle Analytics iconGoogle Analytics

Projects

PairCheck - Image-Text Mismatch Detection

Built a lightweight machine-learning pipeline to identify images paired with captions that misrepresent their content.

PythonPyTorchOpenCLIPCOCOSugarCrepeCodex

LLM Agent Trace Analyzer

Designed a trace-analysis workflow for an AI test-generation agent to uncover agent failures and enable root-cause analysis.

PythonLangfuseOpenTelemetryOpenAI SDKLLM-based evaluation

SaliencyMix Replication

Implemented core components of SaliencyMix, a saliency-based image-augmentation method, along with ResNet-18, ResNet-50, and ResNet-101 in PyTorch. Built saliency-map generation and image-region mixing for classification workflows.

PythonPyTorchtorchvisionNumPyOpenCV

DeObfus Email

Built a cross-browser extension that converts obfuscated email text into clean, copy-ready addresses. Implemented rule-based parsing for varied masking formats and handled Firefox/Chromium API and permission differences.

JavaScriptBrowser Extension APIsManifest V3

HF ML App Analysis

Collected and filtered applications built on top-downloaded Hugging Face text-classification and text-generation models. Extracted code-size metrics with Lizard and analyzed implementation-size and maintainability trends using Pandas, NumPy, and Matplotlib.

PythonLizardPandasNumPyMatplotlib

Education

York UniversityToronto, Canada

🎓Master of Science in Computer ScienceSep 2024 - Aug 2026
CGPA: 8.84/9.00 · Supervisor: Dr. Song Wang. Research focus: context-aware LLM agents, vulnerability detection, and empirical evaluation.

Shahjalal University of Science & TechnologySylhet, Bangladesh

🎓Bachelor of Science in Computer Science & EngineeringFeb 2017 - Jul 2021
CGPA: 3.73/4.00 · Research focus: Bengali topic modeling and news-trend analysis.

Publications & Recognition

SecVulEval: Context-Aware Benchmarking of LLMs for Vulnerability Detection

Md Basim Uddin Ahmed; Nima Shiri Harzevili; Jiho Shin; Hung Viet Pham; Song Wang

Proceedings of the 3rd ACM International Conference on AI-Powered Software (AIware '26) · Montreal, Canada, July 6-7, 2026 · 2026

🏆 Best Dataset & Benchmark Paper - AIware 2026

StaAgent: An Agentic Framework for Testing Static Analyzers

Elijah Nnorom*; Md Basim Uddin Ahmed*; Jiho Shin; Hung Viet Pham; Song Wang

ACM Transactions on Software Engineering and Methodology (TOSEM) · Accepted, 2026

*Equal Contribution

A Systematic Literature Review on English and Bangla Topic Modeling

Md. Basim Uddin Ahmed; Ananta Akash Podder; Mahruba Sharmin Chowdhury; Mohammad Abdullah Al Mumin

Journal of Computer Science · 17(1), 1-18 · 2021

Get In Touch

Have a project in mind or just want to connect? Feel free to reach out to me using the form or through any of the channels below.

Social

Location

Toronto, Canada

© 2026 Md Basim Uddin Ahmed. All rights reserved.