Careers

Eval Engineer

San Francisco · Full-time · In-person, 5 days/week

Build tests that prove agent controls still work when something tries to break them.

What you will work on

Build adversarial harnesses against the policy gate, identity boundaries, and audit trail.
Land CI checks that block releases when known scenarios lose required evidence or decisions.
Turn field failures into regression tests for approvals, scope, and containment.
Keep the eval corpus current as tools, MCP servers, and sub-agents change.

Built (not only used) adversarial or red-team infrastructure that caught a real bug.
Production code on a CI path.
Comfortable in agent frameworks (MCP or similar) and security tooling.
Shipped at least one release-blocking check someone tried to disable.

Email a short note and something you have built to work@deixic.com.