AI Systems Engineer · Crispin
Independent project
- Built and privately used a Telegram-based AI assistant using a thin router and specialist agents to organise work in Notion and act through Google Calendar.
- Designed 300+ production-faithful evals spanning routing, tool selection and arguments, full-chain behaviour and multi-turn state; used them to reproduce and isolate failure modes observed in real workflows.
- Debugged silent partial writes, brittle calendar actions and eval-production drift; converted failures into regression coverage, then redesigned the system around production-matching schemas, batch and single-call tools, and code-enforced guarantees.
- Benchmarked model and reasoning configurations by workflow, balancing quality, latency and cost; retained higher reasoning where cheaper settings caused agents to skip tools and answer without grounding.