Project / Sep 20, 2026
Reliable LLM Experiments
Reproducible experiments for measuring LLM application quality, regressions, and failure modes.
Status: exploring
A collection of focused experiments around reliability questions in LLM applications.
The first experiments will separate transport success from task success, compare deterministic checks with model-based evaluation, and track behavior across prompt and model versions.