All open roles

Founding AI Quality & Release Engineer (Remote US/CAN)

Engineering · Posted 25 days ago

This is our first dedicated quality-infrastructure hire—and it is a software engineering role, not a traditional QA position.

Way of working
Remote
Location
New York, NY
Pay range
$170,000 to $200,000
Level
Senior
Experience
7 to 15 years
Type
Full time
Visa sponsorship
Not offered for this role
The company
Software Development · 20 to 50 people

Skills that matter here

PythonTypeScriptGitHub ActionsCI/CDDockerKubernetesHelmAWSSnowflakeLLMs

The full description

This is our first dedicated quality-infrastructure hire—and it is a software engineering role, not a traditional QA position.

You’ll write code most days: test harnesses, CI pipelines, release gates, and the LLM-agent systems that execute and evaluate our tests. You won’t spend your time manually running test cases. Agents do that here.

Your product is the verification and release system itself: the agentic test harness, evaluation logic, CI signal, release gates, deployment pipeline, and pre-production environments that carry every build from merge to customer.

Your mission: make a green build mean something, make upgrades safe, and make releases boring.

The role has two deliberately protected pillars:

- AI-powered verification (~70%) — Own the trustworthiness of our test signal, including agent-run harnesses, LLM graders, regression coverage, and automated release gates. Close the gaps through which bugs currently escape to customers.

- Release and environment engineering (~30%) — Own the mechanics of shipping, including the release pipeline, CI health, artifact publication, and the reliability of our demo and staging environments.

What this role is not

- It is not manual test execution. The manual workload exists because the automated signal is not yet trusted. Your job is to fix the underlying system—not staff the symptom.

- It is not a release gatekeeper. You won’t be the person who relies on intuition to approve or reject releases. You’ll build systems that make release readiness visible and stop unsafe releases automatically, with evidence.

- It is not a hidden 24/7 production on-call role. You’ll participate in business-hours escalations, as every senior engineer does, and you’ll make incidents rarer and easier to diagnose. Formal after-hours production on-call is a separate function that we will staff as the need matures.

Full job description here

How hiring runs

  1. 1Intro Screen
  2. 2Technical Interview
  3. 3Take-Home Assignment & Review
  4. 4Final Interview with Founders

Interested in this one?

There is no apply button here on purpose. Tell us about yourself, we book a short call, and if this role fits we walk you through the company and ask before anything is sent. Always free for you.

Tell us about you
Tell us about you