Onur Barut, PhD

Lead ML Engineer · Applied AI, GenAI & Search

I build LLM systems that run unattended at catalog scale and can prove their own quality — enrichment platforms, retrieval-plus-LLM classification, embedding pipelines, and the evaluation harnesses that gate every model change. Before that I was an AI Software Architect at Intel and a PhD researcher in deep learning for network security.

  • PhD, UMass Lowell
  • 8+ years in ML
  • Catalog-scale GenAI · 100+ retailer feeds
  • Adjunct faculty, Clark University (Fall 2025)
Portrait of Onur Barut
01

About

I build production AI systems that run unattended at scale and can prove their own quality. Today I am the Lead Machine Learning Engineer at Wizard Commerce, where I own the AI catalog-enrichment platform: the categories, typed attributes, summaries and embeddings behind a search index of tens of millions of listings assembled from 100+ retailer feeds. Most of my work sits where large language models meet retrieval and data quality — structured-output extraction, hybrid search, embedding pipelines, orchestration on Airflow and Cloud Run, and evaluation harnesses that decide which model actually ships. Before Wizard I was an AI Software Architect at Intel, working on multimodal RAG, VLM-generated synthetic data and hardware-aware inference optimization, and I earned my PhD in Computer Engineering at UMass Lowell for transformer-based network security models. I also developed a graduate generative AI course for Clark University. I am open to new opportunities — Staff or Lead roles in applied AI, GenAI, and search and recommendations.

02

Selected work

Platform, model and data-quality work behind a catalog search index of tens of millions of listings. Company-internal names, customers and systems are deliberately omitted.

  • AI catalog enrichment platform

    51 registered job types

    Owner and primary author of two successive generations of the service that turns raw retailer feeds into search-ready categories, typed attributes, summaries and embeddings. Took it from research-grade code with manual file handoffs to a job framework that runs whole-catalog campaigns unattended and is ingested continuously by the data platform.

    • Python 3.12
    • asyncio
    • Pydantic
    • Cloud Run
    • Parquet
  • Recategorization at catalog scale

    34.0% → 44.9% on a 256-product audit set

    Owned LLM product categorization into a ~6,100-leaf taxonomy across three engine generations, ending hallucinated category paths by generating strict Literal-typed response schemas over retrieved candidates. Replayed an operations error set into a repeatable evaluation loop: on a separate 138-product operations error set, exact-category fixes rose 20 → 39 and right-department fixes 33 → 78 with zero regressions. A controlled A/B on 1,199 random listings with retrieval held fixed lifted agreement with production labels 90.2% → 91.0% (19 wins, 9 losses).

    • Structured outputs
    • Hybrid retrieval
    • Elasticsearch
    • vLLM
    • OpenAI Batch API
  • Retailer feed mapping service

    87–99% per-attribute accuracy (median ~93%), 11 garment-size attributes

    Built and owned a Cloud Run service that onboards retailer feeds onto a ~6,750-category taxonomy and a ~1,450-attribute schema: hybrid Elasticsearch retrieval (BM25 + kNN + RRF) proposes candidates and an LLM selects under a dynamically generated Literal schema, so it cannot invent a label. Also cross-mapped a next-generation attribute schema onto the legacy repository, covering roughly 1,280 of ~1,450 attributes (about 88%).

    • Elasticsearch
    • BM25 + kNN + RRF
    • GraphQL
    • Cloud Run
    • Docker
  • Orchestration and release ownership

    2× batches in flight (50 → 100)

    Took over the enrichment DAG family in the data-engineering team's Airflow repository across roughly 100 pull requests: retailer and sample-size filters, and an idempotent Cloud Run operator that persists the operation name and re-attaches to an in-flight job on retry. Diagnosed that DAG limits and pools ignore deferred tasks — the limits looked correct but bounded nothing — and shipped per-backend pools.

    • Apache Airflow
    • Cloud Composer
    • Cloud Run
    • PySpark
    • pytest
  • Open-weight models, chosen on evidence

    Self-hosted 35B edged GPT-4.1-nano, 0.714 vs 0.698

    Led the move of catalog enrichment from per-token vendor APIs to self-hosted open-weight models (Qwen3 / 3.5 / VL, GPT-OSS, Gemma on vLLM behind a LiteLLM gateway), landing a 68-file, ~20.7k-line integration, keeping the vendor batch path as a pluggable fallback, and holding production up through a compute-capacity interruption by re-pointing a live job to an external GPU-cloud model on a two-line config change. Models were picked on benchmark evidence — a config-driven LLM-as-judge harness (severity rubrics, strict-JSON verdicts, coverage, agreement, defect-rate and cost metrics, text and vision judging) alongside reference-free heuristic rubrics, which showed an 8B open-weight model matching an 80B one on 754-variant name normalization and quantified an open-weight VLM hallucinating numeric specs ~3× more often (4.4% vs 1.4%).

    • vLLM
    • LiteLLM
    • Qwen3 / Qwen3-VL
    • GPT-OSS
    • LLM-as-judge
  • Catalog data-quality program

    Applied size coverage 11% → 79% on one feed cohort

    Turned anecdotal quality complaints into measured programs: read-only Elasticsearch audits quantified ~4.7M documents that carried a valid size prefix but no size fields, and a normalized size attribute out of enum on ~31% of ~11.2M documents. The fix was deterministic rather than another LLM pass — a fill-only, evidence-ledgered, dry-run-by-default pipeline routed through the standard ingestion path. Separately built a conformance validator that checked 26 enrichment configs (25 per-vertical plus a fallback) against the schema and taxonomy and enumerated 1,044 conformance issues across eight classes — 365 of them low-severity name-similarity pairs — against staging snapshots, before any of them reached production.

    • Elasticsearch aggregations
    • Delta Lake
    • Dry-run/ledger design
    • Airflow
    • pandas
  • Near-duplicate image detection

    Rerank-latency benchmark

    A research benchmark for near-duplicate listing detection in a recommendation rerank step under a hard latency budget: a classical hash / HSV / ORB + RANSAC cascade against triplet-loss fine-tuned CNN backbones and a multimodal embedding model with Matryoshka truncation, all through one harness that sweeps thresholds for precision/recall and measures warm and cold latency against explicit PASS/FAIL budgets.

    • PyTorch
    • OpenCV
    • Triplet loss
    • Qwen3-VL-Embedding
    • Streamlit
  • Conversational shopping features

    Catalog-grounded

    Worked on the shopping assistant's prompt layer — soft-constraint entity extraction, brand and entity extraction merged into one async call, and hard-coded size lists replaced with values fetched from the catalog API — then an LLM-judged pipeline that decides which attributes a category genuinely requires, so the assistant asks only the clarifying questions that category actually needs. Later prototyped a retrieval-grounded, steerable shopping experience over a hybrid BM25 + kNN pipeline.

    • Prompt engineering
    • FastAPI
    • SSE
    • Elasticsearch RRF
    • MongoDB
  • Multimodal RAG and video super-resolution

    Open-sourced at Intel

    As AI Software Architect at Intel: trained and open-sourced a multimodal visual RAG model on a LLaMA backbone, generated VLM-based synthetic data to fine-tune a smaller language model for document question answering, and open-sourced a video super-resolution model reported at +2% PSNR with reduced artifacts at minimal additional compute.

    • LLaMA
    • Multimodal RAG
    • PyTorch
    • OpenVINO
    • ONNX
03

Experience

  1. Wizard Commerce Lead Machine Learning Engineer

    Oct 2024 – Present · Remote · MA

    AI shopping company. Owner of the AI catalog-enrichment platform: categories, typed attributes, summaries and embeddings for a search index of tens of millions of listings built from 100+ retailer feeds.

    • Owned the AI catalog-enrichment platform across two service generations and three repositories, taking it from a research-grade service with manual file handoffs to a job framework of 51 registered jobs that runs whole-catalog campaigns unattended and is ingested continuously by the data platform.
    • Led the migration of catalog enrichment from per-token vendor APIs to self-hosted open-weight models (Qwen3 / 3.5 / VL, GPT-OSS, Gemma on vLLM behind a LiteLLM gateway), selecting each model on benchmark evidence — a self-hosted 35B model edged GPT-4.1-nano on a 381-variant summary benchmark (0.714 vs 0.698) — keeping the vendor batch API as a pluggable fallback, and holding production up through a compute-capacity interruption by re-pointing a live job to an external GPU-cloud model on a two-line config change.
    • Selected models per task with evaluation-first benchmarks: 754-variant name normalization (98.9% accuracy for the best vendor-API model, with an 8B open-weight model matching the 80B), 1,077-variant vision-language recategorization (92.8% full-path exact match for the leading vendor model; the open-weight 8B led subcategory accuracy), and a 381-variant summary benchmark.
    • Owned LLM product categorization into a ~6,100-leaf taxonomy across three engine generations, eliminating hallucinated category paths by generating strict Literal-typed response schemas over retrieved candidates.
    • Ran catalog-scale campaigns: ~1.7M listings in a taxonomy migration, a multi-million-listing recategorization campaign, 9M+ records lite-enriched, ~3.5M listings size-enriched across 100+ retailer feeds, and a ~275k-product brand pass across 100+ retailer feeds.
    • Migrated catalog embeddings from a paid vendor API to a self-hosted fine-tuned Qwen3 model, backfilled 10 product categories, and fixed a silent data-loss bug so the full set of per-facet vectors reaches the search index.
    • Took over the enrichment Airflow DAG family in the data-engineering team's repository (roughly 100 pull requests), diagnosing that DAG limits and pools ignore deferred tasks and shipping per-backend pools that doubled batches in flight (max active runs 50 → 100), plus an idempotent Cloud Run operator that re-attaches to an in-flight job on retry.
    • Shipped a deterministic, LLM-free size and color fix pipeline — fill-only, evidence-ledgered, dry-run by default, routed through the standard ingestion path — that lifted applied size coverage 11% → 79% on one feed cohort — 100% LLM-judged accuracy on the variant-evidenced letter/numeric/waist tiers (313/313) and 98% on the text-derived default tier — validated on a staging cohort ahead of production rollout.
  2. Clark University Adjunct Faculty (part-time)

    Fall 2025 · Clark University

    • Developed MSIT 3103: Generative AI Model Development, a graduate course on building with generative AI models, for Fall 2025.
    • Published the course assignment notebooks as a public repository so students — and anyone else — can run the exercises: MSIT3103-GenAI-assignments.
  3. Intel Corporation AI Software Architect

    Jun 2022 – Oct 2024 · Remote / MA

    • Generated synthetic data with a vision-language model to fine-tune a smaller language model for document question answering.
    • Trained and open-sourced a multi-modal visual RAG model on a LLaMA backbone for retail security.
    • Designed and open-sourced deep learning models for network-AI projects and optimized them for Intel hardware against customer compute budgets, reported at up to 50% higher throughput.
    • Developed and open-sourced a video super-resolution model reported at +2% PSNR with reduced artifacts at minimal additional compute cost.
    • Led research on network security and video quality enhancement, publishing and presenting more than five papers internally and externally.
  4. University of Massachusetts Lowell Research Assistant, ACANETS Lab

    Aug 2018 – May 2022 · MA

    • Raised malicious traffic detection above 90% and improved model expansion capability with a transformer-based deep learning architecture.
    • Co-organized the NetML 2020 network traffic analytics competition, and collected and open-sourced the HAR-UML20 human activity recognition dataset.
    • Developed a multi-task LSTM model for activity classification and intensity estimation with over 95% accuracy.
  5. Intel Corporation Graduate Intern for Machine Learning

    May – Aug 2019 · CA

    • Built end-to-end machine learning pipelines for network traffic analysis and improved throughput by 15% by optimizing the flow feature selection algorithm.
  6. Aselsan System Design Engineer

    Feb 2014 – Jul 2018 · Turkey

    • Led the team responsible for flight-test data acquisition tasks and system integration tests.
    • Increased flight-test data acquisition speed 5× by replacing the PCM interface with Ethernet.
    • Contributed to Electronic Warfare Self-Protection (EWSP) integration projects with flight data acquisition.

Education

PhD, Computer Engineering — University of Massachusetts Lowell, 2022

Dissertation: Network Traffic Analysis and Malware Detection Using Deep Neural Networks

Dean's Gold Medal Award, 2022

MS, Electrical and Electronics Engineering — Middle East Technical University, 2018

Thesis: Geospatial object recognition using deep networks for satellite images

BS, Electrical and Electronics Engineering — Middle East Technical University, 2014

Minor Degree in Aerospace Engineering, Middle East Technical University, 2015

04

Skills

Ordered by depth — the first items in each group are where I have designed and owned production systems.

LLM & GenAI engineering

  • Structured outputs & dynamic Pydantic/Literal schemas
  • Candidate-constrained decoding
  • Prompt & grounding design (few-shot, anti-pattern lists, strict JSON, enum grounding)
  • OpenAI chat / Batch / realtime APIs
  • Batch-vs-realtime cost routing
  • Hallucination mitigation & numeric post-validation
  • Open-weight LLM/VLM deployment (Qwen3 / 3.5 / VL 0.6B–80B, GPT-OSS, Gemma)
  • vLLM, TEI, LiteLLM / OpenAI-compatible endpoints
  • Multimodal & vision-language prompting
  • Enrichment mode and arbitration design
  • Agent prompt layers & agent-skill authoring

ML modeling & evaluation

  • LLM-as-judge design (text and vision, severity rubrics, evidence parity)
  • Multi-stage LLM pipeline architecture
  • Per-task model selection by benchmark
  • Data-quality auditing & root-cause analysis at catalog scale
  • Reference-free generation metrics (faithfulness, hallucination, completeness, consistency)
  • Benchmark & latency-harness design
  • Deep learning research and training (transformers, multi-task LSTM, triplet-loss metric learning, PyTorch)
  • Entity resolution with human-in-the-loop
  • Rule-based extraction & normalization
  • Majority-vote ensembling
  • Classical CV (OpenCV ORB/RANSAC) and DBSCAN clustering

Search & retrieval

  • Hybrid retrieval (BM25 + kNN + RRF) with LLM selection
  • Text and multimodal embedding pipelines
  • Fine-tuned vs base embedding A/B
  • Matryoshka dimensions & per-attribute vectors
  • Embedding backfills
  • Elasticsearch dense_vector mappings
  • Elasticsearch aggregations at 10M+ documents
  • Taxonomy & attribute-schema modeling
  • Retrieval evaluation (Precision@k, top-1 accuracy, consensus labelling)

Data engineering

  • Parquet / PyArrow nested schemas & data contracts
  • GCS (Hive partitioning, filter pushdown)
  • PySpark / Spark SQL & medallion warehouse architecture
  • Delta Lake
  • MongoDB (job documents, atomic id allocation, Motor async)
  • MySQL 8 (transactions, strict mode, utf8mb4)
  • Redis
  • Polars, pandas, DuckDB
  • GraphQL client engineering (token refresh, pagination, bulk mutations)
  • Bin-packing / hash partitioning for multi-million-row exports

MLOps, orchestration & serving

  • Apache Airflow / Cloud Composer (TaskFlow, dynamic task mapping, TriggerDagRun fan-out, pools, deferrable and custom operators, Triggerer internals, XCom vs Variable semantics)
  • GCP Cloud Run jobs (long-running operations, idempotent re-attach)
  • Idempotency & retry safety (backoff with jitter, circuit breakers, async rate limiting, checkpoint/resume)
  • Cost-aware reliability engineering
  • Celery + Redis distributed tasks
  • FastAPI services and Typer CLIs
  • Release management (dev → staging → prod promotion chains)
  • Dry-run / apply, evidence ledgers, canaries and quarantine-restore patterns

Cloud & infrastructure

  • GCP Cloud Run & GCS
  • Cloud Composer
  • Secret Manager, Artifact Registry, IAM presigned URLs
  • Vertex AI model-as-a-service
  • Third-party GPU cloud workflows
  • Docker
  • uv / poetry, ruff, pre-commit
  • kustomize + GitHub Actions multi-environment deploys
  • AWS Bedrock (multimodal embeddings, boto3)
  • Inference optimization on Intel hardware (ONNX, OpenVINO)

Languages & tooling

  • Python 3.10–3.12 (asyncio, aiohttp, threading, typing, Pydantic, dataclasses, pandas, pyarrow, numpy)
  • SQL (MySQL 8, Spark SQL)
  • pytest (fixtures, parametrization, mocking, regression baselines, mutation testing)
  • Bash / shell orchestration
  • YAML config systems
  • Git & large-scale branch integration
  • Streamlit and internal-tool building
  • Jinja2 / HTML / Chart.js / openpyxl reporting
  • JavaScript (ES modules), HTML5 Canvas
  • MATLAB, C/C++, PyTorch, TensorFlow

Leadership & practice

  • End-to-end technical ownership across repositories and teams
  • Cross-team contracts and stakeholder communication (data engineering, search, product, data operations, leadership)
  • Evaluation-first model adoption
  • Cost and capacity reasoning
  • Incident ownership and root-cause analysis
  • Code review and delegation
  • Technical writing: runbooks, design and decision documents, architecture docs, handoff guides
  • AI-assisted engineering (coding agents, custom agent skills, repo guidelines, LLMs as generators and judges)
  • Teaching and mentoring
05

Publications

333 citations · h-index 7 · i10-index 7 — Google Scholar, September 2026

A star marks the three most-cited papers; citation counts shown only for those.

  1. RET-Net: A CNN Framework for Real-Time Traffic Classification Using Key-Byte Mechanism

    IEEE Transactions on Network and Service Management, 2026.

  2. Malware Detection for Portable Executables Using a Multi-input Transformer-Based Approach

    IEEE ICNC, 2024. DOI — Malware Detection for Portable Executables Using a Multi-input Transformer-Based Approach

  3. AWS Compute Video Super-Resolution powered by the Intel® Library for Video Super Resolution

    Mile-High Video Conference (MHV '24, ACM), 2024. DOI — AWS Compute Video Super-Resolution powered by the Intel® Library for Video Super Resolution

  4. Universal Network Traffic Analysis for Malicious Traffic Detection using RappNet: A Privacy-Preserving Approach

    IEEE CNS 2023 (poster). DOI — Universal Network Traffic Analysis for Malicious Traffic Detection using RappNet: A Privacy-Preserving Approach

  5. A Comprehensive Study on Efficient and Accurate Machine Learning-Based Malicious PE Detection

    IEEE CCNC, 2023. DOI — A Comprehensive Study on Efficient and Accurate Machine Learning-Based Malicious PE Detection

  6. Weakly supervised learning for network traffic classification

    IEEE NAS, 2022. DOI — Weakly supervised learning for network traffic classification

  7. Most cited. R1DIT: Privacy-Preserving Malware Traffic Classification with Attention-Based Neural Networks

    IEEE Trans. Network and Service Management, 2022 (early access). 69 citations. DOI — ★Most cited. R1DIT: Privacy-Preserving Malware Traffic Classification with Attention-Based Neural Networks

  8. Multi-Task Hierarchical Learning Based Network Traffic Analytics

    IEEE ICC, 2021. DOI — Multi-Task Hierarchical Learning Based Network Traffic Analytics

  9. Machine learning based malware detection on encrypted traffic: A comprehensive performance study

    NSysS 2020 (ACM), 2020. DOI — Machine learning based malware detection on encrypted traffic: A comprehensive performance study

  10. TLS Encrypted Application Classification Using Machine Learning with Flow Feature Engineering

    ICCNS 2020 (ACM), 2020. DOI — TLS Encrypted Application Classification Using Machine Learning with Flow Feature Engineering

  11. Most cited. Multitask LSTM Model for Human Activity Recognition and Intensity Estimation Using Wearable Sensor Data

    IEEE Internet of Things Journal, 2020. 95 citations. DOI — ★Most cited. Multitask LSTM Model for Human Activity Recognition and Intensity Estimation Using Wearable Sensor Data

  12. Most cited. NetML: A Challenge for Network Traffic Analytics

    2020. 50 citations. arXiv

  13. Geospatial object detection using deep networks

    SPIE Proceedings, 2019. DOI — Geospatial object detection using deep networks

Full list and citation counts on Google Scholar.

06

Open source

Datasets, challenge baselines, paper code and course material.

  • NetML Competition 2020

    Network traffic analytics challenge I co-organized: open dataset, baselines and evaluation for malware and traffic classification.

    26 stars · co-organizer

  • HAR-UML20

    Human activity recognition dataset I collected and open-sourced with the ACANETS Lab.

    2 stars · dataset

  • Encrypted Malware Detection

    Code for the comprehensive performance study of machine learning malware detection on encrypted traffic.

    6 stars · paper code

  • MultiTask-LSTM-HAR

    Code for the IEEE Internet of Things Journal multi-task LSTM activity recognition paper.

    3 stars · paper code

  • Multi-Task Hierarchical Learning

    Code for the multi-task hierarchical network traffic analytics paper.

    2 stars · paper code

  • Encrypted App Classification

    Code for the TLS encrypted application classification paper with flow feature engineering.

    paper code

  • MSIT3103 GenAI Assignments

    Assignment notebooks for the graduate generative AI course I developed at Clark University.

    course material

07

Teaching

I was part-time faculty at Clark University, where I developed MSIT 3103: Generative AI Model Development, a graduate course for Fall 2025. The assignment notebooks are public, so the exercises can be run by anyone: MSIT3103-GenAI-assignments. Earlier, as a graduate student at UMass Lowell, I was a Teaching Assistant for the Logic Design course in Fall 2018, coordinating lab work and running tutoring sessions.

08

Games

Wizardic Quest is a lightweight pixel-art wizard arena prototype built in pure HTML5 Canvas and ES modules with no bundler: move, shoot, defeat monsters, gain XP and gold, level up, and collect essence for auto-generated daily quests. It exists as a playground for responsive entity scaling, an inventory and pickup loop, and iterative rendering and debug tooling.

09

Contact

I am open to new opportunities and always happy to talk about production LLM systems, search and retrieval, or evaluation — reach me at any of these.