Founding AI Quality & Release Engineer (Remote US/CAN)
Engineering · Posted 25 days ago
This is our first dedicated quality-infrastructure hire—and it is a software engineering role, not a traditional QA position.
- Way of working
- Remote
- Location
- New York, NY
- Pay range
- $170,000 to $200,000
- Level
- Senior
- Experience
- 7 to 15 years
- Type
- Full time
- Visa sponsorship
- Not offered for this role
- The company
- Software Development · 20 to 50 people
Skills that matter here
The full description
This is our first dedicated quality-infrastructure hire—and it is a software engineering role, not a traditional QA position.
You’ll write code most days: test harnesses, CI pipelines, release gates, and the LLM-agent systems that execute and evaluate our tests. You won’t spend your time manually running test cases. Agents do that here.
Your product is the verification and release system itself: the agentic test harness, evaluation logic, CI signal, release gates, deployment pipeline, and pre-production environments that carry every build from merge to customer.
Your mission: make a green build mean something, make upgrades safe, and make releases boring.
The role has two deliberately protected pillars:
- AI-powered verification (~70%) — Own the trustworthiness of our test signal, including agent-run harnesses, LLM graders, regression coverage, and automated release gates. Close the gaps through which bugs currently escape to customers.
- Release and environment engineering (~30%) — Own the mechanics of shipping, including the release pipeline, CI health, artifact publication, and the reliability of our demo and staging environments.
What this role is not
- It is not manual test execution. The manual workload exists because the automated signal is not yet trusted. Your job is to fix the underlying system—not staff the symptom.
- It is not a release gatekeeper. You won’t be the person who relies on intuition to approve or reject releases. You’ll build systems that make release readiness visible and stop unsafe releases automatically, with evidence.
- It is not a hidden 24/7 production on-call role. You’ll participate in business-hours escalations, as every senior engineer does, and you’ll make incidents rarer and easier to diagnose. Formal after-hours production on-call is a separate function that we will staff as the need matures.
Full job description here
How hiring runs
- 1Intro Screen
- 2Technical Interview
- 3Take-Home Assignment & Review
- 4Final Interview with Founders
Interested in this one?
There is no apply button here on purpose. Tell us about yourself, we book a short call, and if this role fits we walk you through the company and ask before anything is sent. Always free for you.
Tell us about you