Forward Deployed Machine Learning Engineer
Ai ml · Posted 14 days ago
We are looking for a Forward Deployed Machine Learning Engineer with 3+ years of experience to be the first MLE dedicated to Protege's Benchmarks and Evaluations vertical. You'll work directly with the GM and researchers to build the technical foundation for AI model evaluation — a critical capability at one of the mos...
- Way of working
- Remote
- Location
- Remote
- Pay range
- $170,000 to $270,000
- Level
- Mid
- Experience
- 3 to 8 years
- Type
- Full time
- Visa sponsorship
- Not offered for this role
- The company
- Data Infrastructure and Analytics · 50 to 200 people
Skills that matter here
The full description
We are looking for a Forward Deployed Machine Learning Engineer with 3+ years of experience to be the first MLE dedicated to Protege's Benchmarks and Evaluations vertical. You'll work directly with the GM and researchers to build the technical foundation for AI model evaluation — a critical capability at one of the most exciting data infrastructure companies in AI, backed by a16z, CRV, and others.
What will you be doing?
- Partner with the GM and early customers to define, design, and build benchmarks and evals across different domains and modalities
- Build and own the backend infrastructure: data pipelines, execution environments, storage, and orchestration
- Stand up sandboxed environments for agentic evals requiring tools, code execution, or multi-step tasks
- Own the engineering portion of customer engagements end to end
- Identify repeatable eval patterns and infrastructure gaps to drive product opportunities
Key Requirements
- 4+ years of engineering experience with hands-on ML model evaluation work
- Prior ownership of backend and infrastructure (data pipelines, execution environments)
- Experience building benchmarks, evals, or human data pipelines for LLMs (strongly preferred)
- High ambiguity tolerance and a strong bias to action in fast-moving environments
- Strong written communication skills for customer-facing and cross-functional work
Interested in this one?
There is no apply button here on purpose. Tell us about yourself, we book a short call, and if this role fits we walk you through the company and ask before anything is sent. Always free for you.
Tell us about you