Onur Barut, PhD
Lead ML Engineer · Applied AI, GenAI & Search
I build LLM systems that run unattended at catalog scale and can prove their own quality — enrichment platforms, retrieval-plus-LLM classification, embedding pipelines, and the evaluation harnesses that gate every model change. Before that I was an AI Software Architect at Intel and a PhD researcher in deep learning for network security.
- PhD, UMass Lowell
- 8+ years in ML
- Catalog-scale GenAI · 100+ retailer feeds
- Adjunct faculty, Clark University (Fall 2025)
About
I build production AI systems that run unattended at scale and can prove their own quality. Today I am the Lead Machine Learning Engineer at Wizard Commerce, where I own the AI catalog-enrichment platform: the categories, typed attributes, summaries and embeddings behind a search index of tens of millions of listings assembled from 100+ retailer feeds. Most of my work sits where large language models meet retrieval and data quality — structured-output extraction, hybrid search, embedding pipelines, orchestration on Airflow and Cloud Run, and evaluation harnesses that decide which model actually ships. Before Wizard I was an AI Software Architect at Intel, working on multimodal RAG, VLM-generated synthetic data and hardware-aware inference optimization, and I earned my PhD in Computer Engineering at UMass Lowell for transformer-based network security models. I also developed a graduate generative AI course for Clark University. I am open to new opportunities — Staff or Lead roles in applied AI, GenAI, and search and recommendations.
Selected work
Platform, model and data-quality work behind a catalog search index of tens of millions of listings. Company-internal names, customers and systems are deliberately omitted.
-
AI catalog enrichment platform
51 registered job types
Owner and primary author of two successive generations of the service that turns raw retailer feeds into search-ready categories, typed attributes, summaries and embeddings. Took it from research-grade code with manual file handoffs to a job framework that runs whole-catalog campaigns unattended and is ingested continuously by the data platform.
-
Recategorization at catalog scale
34.0% → 44.9% on a 256-product audit set
Owned LLM product categorization into a ~6,100-leaf taxonomy across three engine generations, ending hallucinated category paths by generating strict Literal-typed response schemas over retrieved candidates. Replayed an operations error set into a repeatable evaluation loop: on a separate 138-product operations error set, exact-category fixes rose 20 → 39 and right-department fixes 33 → 78 with zero regressions. A controlled A/B on 1,199 random listings with retrieval held fixed lifted agreement with production labels 90.2% → 91.0% (19 wins, 9 losses).
-
Retailer feed mapping service
87–99% per-attribute accuracy (median ~93%), 11 garment-size attributes
Built and owned a Cloud Run service that onboards retailer feeds onto a ~6,750-category taxonomy and a ~1,450-attribute schema: hybrid Elasticsearch retrieval (BM25 + kNN + RRF) proposes candidates and an LLM selects under a dynamically generated Literal schema, so it cannot invent a label. Also cross-mapped a next-generation attribute schema onto the legacy repository, covering roughly 1,280 of ~1,450 attributes (about 88%).
-
Orchestration and release ownership
2× batches in flight (50 → 100)
Took over the enrichment DAG family in the data-engineering team's Airflow repository across roughly 100 pull requests: retailer and sample-size filters, and an idempotent Cloud Run operator that persists the operation name and re-attaches to an in-flight job on retry. Diagnosed that DAG limits and pools ignore deferred tasks — the limits looked correct but bounded nothing — and shipped per-backend pools.
-
Open-weight models, chosen on evidence
Self-hosted 35B edged GPT-4.1-nano, 0.714 vs 0.698
Led the move of catalog enrichment from per-token vendor APIs to self-hosted open-weight models (Qwen3 / 3.5 / VL, GPT-OSS, Gemma on vLLM behind a LiteLLM gateway), landing a 68-file, ~20.7k-line integration, keeping the vendor batch path as a pluggable fallback, and holding production up through a compute-capacity interruption by re-pointing a live job to an external GPU-cloud model on a two-line config change. Models were picked on benchmark evidence — a config-driven LLM-as-judge harness (severity rubrics, strict-JSON verdicts, coverage, agreement, defect-rate and cost metrics, text and vision judging) alongside reference-free heuristic rubrics, which showed an 8B open-weight model matching an 80B one on 754-variant name normalization and quantified an open-weight VLM hallucinating numeric specs ~3× more often (4.4% vs 1.4%).
-
Catalog data-quality program
Applied size coverage 11% → 79% on one feed cohort
Turned anecdotal quality complaints into measured programs: read-only Elasticsearch audits quantified ~4.7M documents that carried a valid size prefix but no size fields, and a normalized size attribute out of enum on ~31% of ~11.2M documents. The fix was deterministic rather than another LLM pass — a fill-only, evidence-ledgered, dry-run-by-default pipeline routed through the standard ingestion path. Separately built a conformance validator that checked 26 enrichment configs (25 per-vertical plus a fallback) against the schema and taxonomy and enumerated 1,044 conformance issues across eight classes — 365 of them low-severity name-similarity pairs — against staging snapshots, before any of them reached production.
-
Near-duplicate image detection
Rerank-latency benchmark
A research benchmark for near-duplicate listing detection in a recommendation rerank step under a hard latency budget: a classical hash / HSV / ORB + RANSAC cascade against triplet-loss fine-tuned CNN backbones and a multimodal embedding model with Matryoshka truncation, all through one harness that sweeps thresholds for precision/recall and measures warm and cold latency against explicit PASS/FAIL budgets.
-
Conversational shopping features
Catalog-grounded
Worked on the shopping assistant's prompt layer — soft-constraint entity extraction, brand and entity extraction merged into one async call, and hard-coded size lists replaced with values fetched from the catalog API — then an LLM-judged pipeline that decides which attributes a category genuinely requires, so the assistant asks only the clarifying questions that category actually needs. Later prototyped a retrieval-grounded, steerable shopping experience over a hybrid BM25 + kNN pipeline.
-
Multimodal RAG and video super-resolution
Open-sourced at Intel
As AI Software Architect at Intel: trained and open-sourced a multimodal visual RAG model on a LLaMA backbone, generated VLM-based synthetic data to fine-tune a smaller language model for document question answering, and open-sourced a video super-resolution model reported at +2% PSNR with reduced artifacts at minimal additional compute.
Experience
-
Wizard Commerce — Lead Machine Learning Engineer
AI shopping company. Owner of the AI catalog-enrichment platform: categories, typed attributes, summaries and embeddings for a search index of tens of millions of listings built from 100+ retailer feeds.
- Owned the AI catalog-enrichment platform across two service generations and three repositories, taking it from a research-grade service with manual file handoffs to a job framework of 51 registered jobs that runs whole-catalog campaigns unattended and is ingested continuously by the data platform.
- Led the migration of catalog enrichment from per-token vendor APIs to self-hosted open-weight models (Qwen3 / 3.5 / VL, GPT-OSS, Gemma on vLLM behind a LiteLLM gateway), selecting each model on benchmark evidence — a self-hosted 35B model edged GPT-4.1-nano on a 381-variant summary benchmark (0.714 vs 0.698) — keeping the vendor batch API as a pluggable fallback, and holding production up through a compute-capacity interruption by re-pointing a live job to an external GPU-cloud model on a two-line config change.
- Selected models per task with evaluation-first benchmarks: 754-variant name normalization (98.9% accuracy for the best vendor-API model, with an 8B open-weight model matching the 80B), 1,077-variant vision-language recategorization (92.8% full-path exact match for the leading vendor model; the open-weight 8B led subcategory accuracy), and a 381-variant summary benchmark.
- Owned LLM product categorization into a ~6,100-leaf taxonomy across three engine generations, eliminating hallucinated category paths by generating strict Literal-typed response schemas over retrieved candidates.
- Ran catalog-scale campaigns: ~1.7M listings in a taxonomy migration, a multi-million-listing recategorization campaign, 9M+ records lite-enriched, ~3.5M listings size-enriched across 100+ retailer feeds, and a ~275k-product brand pass across 100+ retailer feeds.
- Migrated catalog embeddings from a paid vendor API to a self-hosted fine-tuned Qwen3 model, backfilled 10 product categories, and fixed a silent data-loss bug so the full set of per-facet vectors reaches the search index.
- Took over the enrichment Airflow DAG family in the data-engineering team's repository (roughly 100 pull requests), diagnosing that DAG limits and pools ignore deferred tasks and shipping per-backend pools that doubled batches in flight (max active runs 50 → 100), plus an idempotent Cloud Run operator that re-attaches to an in-flight job on retry.
- Shipped a deterministic, LLM-free size and color fix pipeline — fill-only, evidence-ledgered, dry-run by default, routed through the standard ingestion path — that lifted applied size coverage 11% → 79% on one feed cohort — 100% LLM-judged accuracy on the variant-evidenced letter/numeric/waist tiers (313/313) and 98% on the text-derived default tier — validated on a staging cohort ahead of production rollout.
-
Clark University — Adjunct Faculty (part-time)
- Developed MSIT 3103: Generative AI Model Development, a graduate course on building with generative AI models, for Fall 2025.
- Published the course assignment notebooks as a public repository so students — and anyone else — can run the exercises: MSIT3103-GenAI-assignments.
-
Intel Corporation — AI Software Architect
- Generated synthetic data with a vision-language model to fine-tune a smaller language model for document question answering.
- Trained and open-sourced a multi-modal visual RAG model on a LLaMA backbone for retail security.
- Designed and open-sourced deep learning models for network-AI projects and optimized them for Intel hardware against customer compute budgets, reported at up to 50% higher throughput.
- Developed and open-sourced a video super-resolution model reported at +2% PSNR with reduced artifacts at minimal additional compute cost.
- Led research on network security and video quality enhancement, publishing and presenting more than five papers internally and externally.
-
University of Massachusetts Lowell — Research Assistant, ACANETS Lab
- Raised malicious traffic detection above 90% and improved model expansion capability with a transformer-based deep learning architecture.
- Co-organized the NetML 2020 network traffic analytics competition, and collected and open-sourced the HAR-UML20 human activity recognition dataset.
- Developed a multi-task LSTM model for activity classification and intensity estimation with over 95% accuracy.
-
Intel Corporation — Graduate Intern for Machine Learning
- Built end-to-end machine learning pipelines for network traffic analysis and improved throughput by 15% by optimizing the flow feature selection algorithm.
-
Aselsan — System Design Engineer
- Led the team responsible for flight-test data acquisition tasks and system integration tests.
- Increased flight-test data acquisition speed 5× by replacing the PCM interface with Ethernet.
- Contributed to Electronic Warfare Self-Protection (EWSP) integration projects with flight data acquisition.
Education
PhD, Computer Engineering — University of Massachusetts Lowell, 2022
Dissertation: Network Traffic Analysis and Malware Detection Using Deep Neural Networks
Dean's Gold Medal Award, 2022
MS, Electrical and Electronics Engineering — Middle East Technical University, 2018
Thesis: Geospatial object recognition using deep networks for satellite images
BS, Electrical and Electronics Engineering — Middle East Technical University, 2014
Minor Degree in Aerospace Engineering, Middle East Technical University, 2015
Skills
Ordered by depth — the first items in each group are where I have designed and owned production systems.
LLM & GenAI engineering
- Structured outputs & dynamic Pydantic/Literal schemas
- Candidate-constrained decoding
- Prompt & grounding design (few-shot, anti-pattern lists, strict JSON, enum grounding)
- OpenAI chat / Batch / realtime APIs
- Batch-vs-realtime cost routing
- Hallucination mitigation & numeric post-validation
- Open-weight LLM/VLM deployment (Qwen3 / 3.5 / VL 0.6B–80B, GPT-OSS, Gemma)
- vLLM, TEI, LiteLLM / OpenAI-compatible endpoints
- Multimodal & vision-language prompting
- Enrichment mode and arbitration design
- Agent prompt layers & agent-skill authoring
ML modeling & evaluation
- LLM-as-judge design (text and vision, severity rubrics, evidence parity)
- Multi-stage LLM pipeline architecture
- Per-task model selection by benchmark
- Data-quality auditing & root-cause analysis at catalog scale
- Reference-free generation metrics (faithfulness, hallucination, completeness, consistency)
- Benchmark & latency-harness design
- Deep learning research and training (transformers, multi-task LSTM, triplet-loss metric learning, PyTorch)
- Entity resolution with human-in-the-loop
- Rule-based extraction & normalization
- Majority-vote ensembling
- Classical CV (OpenCV ORB/RANSAC) and DBSCAN clustering
Search & retrieval
- Hybrid retrieval (BM25 + kNN + RRF) with LLM selection
- Text and multimodal embedding pipelines
- Fine-tuned vs base embedding A/B
- Matryoshka dimensions & per-attribute vectors
- Embedding backfills
- Elasticsearch dense_vector mappings
- Elasticsearch aggregations at 10M+ documents
- Taxonomy & attribute-schema modeling
- Retrieval evaluation (Precision@k, top-1 accuracy, consensus labelling)
Data engineering
- Parquet / PyArrow nested schemas & data contracts
- GCS (Hive partitioning, filter pushdown)
- PySpark / Spark SQL & medallion warehouse architecture
- Delta Lake
- MongoDB (job documents, atomic id allocation, Motor async)
- MySQL 8 (transactions, strict mode, utf8mb4)
- Redis
- Polars, pandas, DuckDB
- GraphQL client engineering (token refresh, pagination, bulk mutations)
- Bin-packing / hash partitioning for multi-million-row exports
MLOps, orchestration & serving
- Apache Airflow / Cloud Composer (TaskFlow, dynamic task mapping, TriggerDagRun fan-out, pools, deferrable and custom operators, Triggerer internals, XCom vs Variable semantics)
- GCP Cloud Run jobs (long-running operations, idempotent re-attach)
- Idempotency & retry safety (backoff with jitter, circuit breakers, async rate limiting, checkpoint/resume)
- Cost-aware reliability engineering
- Celery + Redis distributed tasks
- FastAPI services and Typer CLIs
- Release management (dev → staging → prod promotion chains)
- Dry-run / apply, evidence ledgers, canaries and quarantine-restore patterns
Cloud & infrastructure
- GCP Cloud Run & GCS
- Cloud Composer
- Secret Manager, Artifact Registry, IAM presigned URLs
- Vertex AI model-as-a-service
- Third-party GPU cloud workflows
- Docker
- uv / poetry, ruff, pre-commit
- kustomize + GitHub Actions multi-environment deploys
- AWS Bedrock (multimodal embeddings, boto3)
- Inference optimization on Intel hardware (ONNX, OpenVINO)
Languages & tooling
- Python 3.10–3.12 (asyncio, aiohttp, threading, typing, Pydantic, dataclasses, pandas, pyarrow, numpy)
- SQL (MySQL 8, Spark SQL)
- pytest (fixtures, parametrization, mocking, regression baselines, mutation testing)
- Bash / shell orchestration
- YAML config systems
- Git & large-scale branch integration
- Streamlit and internal-tool building
- Jinja2 / HTML / Chart.js / openpyxl reporting
- JavaScript (ES modules), HTML5 Canvas
- MATLAB, C/C++, PyTorch, TensorFlow
Leadership & practice
- End-to-end technical ownership across repositories and teams
- Cross-team contracts and stakeholder communication (data engineering, search, product, data operations, leadership)
- Evaluation-first model adoption
- Cost and capacity reasoning
- Incident ownership and root-cause analysis
- Code review and delegation
- Technical writing: runbooks, design and decision documents, architecture docs, handoff guides
- AI-assisted engineering (coding agents, custom agent skills, repo guidelines, LLMs as generators and judges)
- Teaching and mentoring
Publications
A star marks the three most-cited papers; citation counts shown only for those.
-
RET-Net: A CNN Framework for Real-Time Traffic Classification Using Key-Byte Mechanism
-
Malware Detection for Portable Executables Using a Multi-input Transformer-Based Approach
-
AWS Compute Video Super-Resolution powered by the Intel® Library for Video Super Resolution
-
Universal Network Traffic Analysis for Malicious Traffic Detection using RappNet: A Privacy-Preserving Approach
-
A Comprehensive Study on Efficient and Accurate Machine Learning-Based Malicious PE Detection
-
Weakly supervised learning for network traffic classification
-
Most cited. R1DIT: Privacy-Preserving Malware Traffic Classification with Attention-Based Neural Networks
-
Multi-Task Hierarchical Learning Based Network Traffic Analytics
-
Machine learning based malware detection on encrypted traffic: A comprehensive performance study
-
TLS Encrypted Application Classification Using Machine Learning with Flow Feature Engineering
-
Most cited. Multitask LSTM Model for Human Activity Recognition and Intensity Estimation Using Wearable Sensor Data
-
Most cited. NetML: A Challenge for Network Traffic Analytics
-
Geospatial object detection using deep networks
Full list and citation counts on Google Scholar.
Open source
Datasets, challenge baselines, paper code and course material.
-
NetML Competition 2020
Network traffic analytics challenge I co-organized: open dataset, baselines and evaluation for malware and traffic classification.
-
HAR-UML20
Human activity recognition dataset I collected and open-sourced with the ACANETS Lab.
-
Encrypted Malware Detection
Code for the comprehensive performance study of machine learning malware detection on encrypted traffic.
-
MultiTask-LSTM-HAR
Code for the IEEE Internet of Things Journal multi-task LSTM activity recognition paper.
-
Multi-Task Hierarchical Learning
Code for the multi-task hierarchical network traffic analytics paper.
-
Encrypted App Classification
Code for the TLS encrypted application classification paper with flow feature engineering.
-
MSIT3103 GenAI Assignments
Assignment notebooks for the graduate generative AI course I developed at Clark University.
Teaching
I was part-time faculty at Clark University, where I developed MSIT 3103: Generative AI Model Development, a graduate course for Fall 2025. The assignment notebooks are public, so the exercises can be run by anyone: MSIT3103-GenAI-assignments. Earlier, as a graduate student at UMass Lowell, I was a Teaching Assistant for the Logic Design course in Fall 2018, coordinating lab work and running tutoring sessions.
Games
Wizardic Quest is a lightweight pixel-art wizard arena prototype built in pure HTML5 Canvas and ES modules with no bundler: move, shoot, defeat monsters, gain XP and gold, level up, and collect essence for auto-generated daily quests. It exists as a playground for responsive entity scaling, an inventory and pickup loop, and iterative rendering and debug tooling.
Contact
I am open to new opportunities and always happy to talk about production LLM systems, search and retrieval, or evaluation — reach me at any of these.