Machine learning · Research & engineering

hi, stelios here.

I build ML systems.
And investigate where they fail.

World models, generative reconstruction and reliable software. I develop controlled experiments and working systems, with the evidence and limitations kept in view.

01 / Selected work

From a research question
to a working system.

Five projects, with the contribution, evidence and limits kept together.

01

BSc thesis
September 2026
Excellent · 10/10

Inverse problems · PyTorch · Medical imaging

When a generative prior
helps—and when it fails.

Score-based reconstruction of undersampled MRI, from faithful reproduction to uncertainty and domain shift.

I reimplemented a published MRI reconstruction solver in PyTorch, converted its pretrained JAX/Flax checkpoint, and studied reconstruction quality, sampling cost and the reliability of uncertainty estimates.

Within 0.15 dB

Thesis reports PSNR agreement with the reference on 256 BraTS test slices, across 4×, 8× and 24× undersampling.
Thesis, Table 5.1

Methods, findings & limitations
Four retrospective MRI examples at 8× undersampling, comparing zero-filled input, reconstructed images and ground truth.
Figure from the BSc study: retrospective MRI reconstruction at 8× undersampling. “Ours” identifies the implemented reconstruction pipeline, not a new model architecture. No clinical validation. Open full figure.

What I implemented

The inverse-problem pipeline, measurement operators, conditioning and data consistency, four solver modes, checkpoint conversion and experiment analysis. The original model architecture and pretrained prior are credited to the reference work.

What the experiments showed

Sample averaging improved reconstruction at additional sampling cost. Short adaptation was evaluated under domain shift, including a subject-disjoint OASIS-1 study. Uncertainty-guided acquisition did not outperform random selection under an equal extra-column budget.

What this does not establish

These are retrospective, single-coil reconstruction experiments on public imaging datasets. Uncertainty ranking is not a calibrated probability of failure. There was no prospective scanner study or clinical validation.

02

ForgeRL / ForgeBench
Agent routing · Evaluation

Reinforcement learning · Model routing · Sandboxed execution

Code repair with
an inspectable decision policy.

An authored benchmark and evidence dashboard for studying how a bounded coding agent allocates model calls after visible test feedback.

ForgeBench recorded study explorer with task and test evidence.
Recorded evidence explorer. Open a repair to inspect its patch and test outcomes.

I built the multi-file repair harness, isolated executor, durable spending ledger and trajectory dashboard to compare fixed model use, escalation, hand-written rules and learned routing. The language models are not fine-tuned.

50 scenarios · 10 repository families

Miniature Python repositories with disjoint training, validation and test families. The v0.2 study completed 300 evaluation and 180 controller-training episodes. Inspect recorded prompts, supplied files, patches, test outcomes, retries, model switches, tokens and cost.

The transfer pilot and four-seed follow-up show where routing and verification help—and where they do not. Explore a recorded repair with its source, patch and final test results.

System, experiment & limitations

Bounded execution

Recorded replay is free to browse. An optional curated trial makes one GPT-OSS 20B request for a fixed task, with isolated verification and persistent spending limits. Live trials are separate from benchmark results; visitors cannot submit code or arbitrary prompts. Provider failures remain visible.

Policy comparison

Strong-only, cheap-only, escalation-on-failure, static and adaptive policies share a six-call, ten-decision cap. The controlled research profile routes GPT-OSS 20B and 120B through a fixed OpenRouter provider. Hidden checks grade the final candidate after all routing decisions.

Transfer pilot and four-seed follow-up

A separately frozen transfer pilot completed 162 episodes across 27 new miniature tasks and six policies. The simpler learned baseline solved 17/18 primary test tasks; fitted-Q, strong-only and escalation solved 16/18. One seed and six test families do not establish general superiority. All policies shared the same additional verification rule.

A later four-seed replication revisited the same, now-exposed catalog in 1,296 attempted episodes. On its original primary slice, strong-only solved 131/144 at lower accounted model cost than the fitted-Q router's 128/144. VERIFY-on and VERIFY-off each solved 372/432 attempts across policies. Four provider failures remain in the counts; this is not new-task generalization.

Limits of the evidence

These are authored miniature repositories, not evidence of general repository repair or long-horizon autonomy. Sparse controller states use a declared fallback. The dashboard distinguishes actual coverage, provider charges and uncertain reservations; no general policy advantage is claimed.

03

Former Head Engineer
Jun 2022–Jul 2026
Pro bono

Full-stack systems · Security · Operations

A practical home for
a medical association.

AsklepiosMed brings the Paphos Medical Association’s member services into one maintained platform.

I developed and donated AsklepiosMed while working as Head Engineer for the Paphos Medical Association, pro bono. My role ended in July 2026. The capabilities below describe the platform today, including subsequent development.

Member experience
Profile review, passkeys, Wallet membership verification and personal communication preferences.
Association operations
Content publishing, applications, meetings, attendance and scoped member casework.
Production work
Role boundaries, encrypted sensitive records, backups, restore checks and service monitoring.
Scope & engineering boundaries

Implementation

React, Express and PostgreSQL, with nginx and systemd on a VPS. The work includes application flows and the operational checks needed to maintain them.

Boundaries

A single-VPS deployment is not a highly available infrastructure. Encryption of selected records and backups is not whole-disk or end-to-end encryption. Membership verification does not certify a medical licence. Private source and member data are not published here.

04

MTA-Scan
Live data · Evaluation

Data engineering · FastAPI · Interactive maps

From subway observations
to an inspectable signal.

A live subway data pipeline with an interactive map, arrival-spacing proxy forecasts and inspectable baseline comparisons.

MTA Scan live subway map, feed freshness and observation queue.
Workspace snapshot · October 9, 2026. Counts change as feeds update. Map © Mapbox © OpenStreetMap contributors.

I implemented feed ingestion, the API and an interactive review workflow with freshness states, native Mapbox layers, filtering and explicit snapshot export. Autonomous history collection now supports chronological 15/30-minute evaluation against persistence and seasonal baselines, alongside the separate constructed replay.

Live observations
Inspect the network, filter a line or station and export the successful snapshot with its selected time window.
Visible failure states
Feed freshness and provider failures stay visible. A labelled map fallback preserves the data review workflow.
History & forecasting evidence
Inspect collection health, held-out errors and readiness. The target is future feed-predicted arrival spacing; early measurements are feasibility evidence.
Data & evaluation limits

What the live system establishes

Public-feed integration, bounded historical storage and automatic temporal evaluation. Forecasts require at least 14 days plus coverage and freshness checks. The target is a later arrival-estimate proxy, not actual train passages, passenger waiting time or validated incident prediction.

What the replay does not establish

The small replay contains three constructed scenarios, not official MTA incident ground truth or an independent benchmark. Higher recall in this fixture comes with more false alarms than the baselines. Neither the replay nor a working live map establishes validated incident prediction.

05

Inference Systems Lab
GPU serving · Performance

vLLM · RTX 4090 & A100 · Reproducible measurement

Measure the serving trade-offs.

Frozen GPU experiments connecting request traces to throughput, latency, device telemetry and output agreement.

I built a bounded streaming benchmark and fixed the model revision, container, workload and settings before execution. The first 1,536-request pilot on RTX 4090 was followed by a separate counterbalanced experiment across two model sizes, two GPU classes, prefix patterns, cache modes and four repeats.

16,384 measured requests · 2 GPUs

Qwen2.5 1.5B and 7B · vLLM 0.10.2 · RTX 4090 and A100 80GB. All requests completed at the HTTP level. Paired output hashes frequently differed, so throughput ratios do not establish lossless speedup or answer quality.

Measured results & limits

Observed throughput

At concurrency 32, the later study measured cached/uncached throughput ratios of 1.23–1.47 with shared prefixes across its GPU/model combinations; unique prefixes were near 1.00. Four-repeat means and ranges, latency and exact-output hash counts are in the report.

Scope of the comparison

Each hardware class used one allocated GPU and synthetic fixed-length prompts. Output text often differed. The $3.45 allocation cost is an estimate; exact provider billing is unavailable. Neither study measures answer quality, quantization or general production performance.

Ongoing research

World models
Ongoing · Unpublished
My ongoing, unpublished research studies imagination horizons, critic stability and policy selection in latent world models. Controlled simulator comparisons have produced task-dependent outcomes, including failed controller and selection hypotheses.

Questions & limits I use those failures to examine learning objectives, evaluation targets and prediction error. Limited task, world-model and training-seed coverage constrains generalization; simulated control experiments are not physical-robot deployment.

Discuss the research

02 / Try the work

Small interfaces.
Inspectable systems.

Three selected live demos. Use the supplied examples; please don’t enter personal or confidential data.

ForgeRL · ForgeBench research dashboard

Explore 50 authored scenarios and the experiments recorded for each task. Follow prompts, patches, tests and routing decisions; inspect the full JSON trajectory and accounted cost.

Read-only evidence dashboard; browsing makes no inference requests. Catalog size and measured evaluation coverage are reported separately.

Quick walkthrough

Compare recorded policy results and coverage, then filter tasks by category or split. Choose an available recorded run to inspect its trajectory, patch, test outcomes and final files. Tasks without published runs are labeled explicitly.

Source

MTA-Scan · NYC subway monitor

Explore live subway observations on a Mapbox vector map, filter the network and inspect a separate constructed replay.

The small constructed replay reports both recall and false alarms. Model scores are separate from official incident reports.

Quick walkthrough

Filter a subway line, inspect a station and export its current snapshot. Use the separate replay timeline to examine a constructed scenario.

Source

DeID · Text review tool

Review detected entities, correct missed or unwanted redactions, and export the transformed text with your review decisions.

English NER and explicit transformation policies. Human review supports correction; it does not guarantee anonymity.

Quick walkthrough

Analyse a supplied document. Review a detected span, redact a missed selection, then export your decisions.

Read the engineering decisions and test evidence

Source

03 / Background

Research curiosity.
Engineering follow-through.

I enjoy the part where an elegant idea meets an inconvenient result.

My work moves between machine learning experiments and software that has to keep working after deployment. I care about clear baselines, reproducible analysis and explaining what an experiment does not show.

For research, that means preserving negative results. For products, it means paying attention to access boundaries, recovery paths and the person using the interface.

Education

BSc, Computer Science
National and Kapodistrian University of Athens
Completed June 2026 · Degree classification: Very Good (Λίαν Καλώς)
BSc thesis: Excellent (Άριστα), 10/10
Score-based generative models for undersampled MRI reconstruction. Supervisor: Vasileios Nakos.

Working toolkit

Python, PyTorch, scientific evaluation and model-based reinforcement learning. React, Node.js, PostgreSQL and Linux for application development and operations.

Research / ML CV PDF
ML Systems / Software CV PDF

04 / Get in touch

Have a question
worth investigating?

Based in the New York City metropolitan area. I’m happy to discuss machine learning, software engineering and research opportunities.

stelios@stelioszach.com