Software Engineer, AI Platform
Data · Posted 6 days ago
We're looking for a Software Engineer, AI Platform with 3-4+ years of experience in data platform or infrastructure engineering who has owned production pipelines handling terabyte-to-petabyte scale data processing. You should be comfortable working with LLM-driven ETL systems and making reliability/cost/throughput tra...
- Way of working
- On site
- Location
- San Francisco, CA
- Pay range
- $180,000 to $250,000
- Level
- Mid
- Experience
- 3 to 8 years
- Type
- Full time
- Visa sponsorship
- Not offered for this role
- The company
- Software Development,Technology, Information and Internet · under 20 people
Skills that matter here
What you would be doing
- Own the data platform that powers every AI feature across the company, serving Fortune 500 customers like CVS Health, Aon, and PVH
- Run and evolve a complex LLM-driven ETL pipeline handling 10-30 terabytes of inference per customer per week — continuous 24/7 processing, not batch jobs
- Build agent transformation infrastructure that turns LLM and agent outputs into structured, queryable data for the product layer
- Improve reliability, accuracy, throughput, and cost of LLM-driven jobs in production
- Build observability, evals, and tooling so the team can debug, iterate, and measure system performance quickly
- Partner with AI engineers to expose new capabilities through the platform and shape the interfaces they build on
- Participate in on-call rotation and incident response (paid additionally on top of base salary)
The full description
We're looking for a Software Engineer, AI Platform with 3-4+ years of experience in data platform or infrastructure engineering who has owned production pipelines handling terabyte-to-petabyte scale data processing. You should be comfortable working with LLM-driven ETL systems and making reliability/cost/throughput tradeoffs in a fast-moving startup environment. Bonus points if you have experience with AI-enabled ETLs and distributed compute systems.
Responsibilities
- Own the data platform that powers every AI feature across the company, serving Fortune 500 customers like CVS Health, Aon, and PVH
- Run and evolve a complex LLM-driven ETL pipeline handling 10-30 terabytes of inference per customer per week — continuous 24/7 processing, not batch jobs
- Build agent transformation infrastructure that turns LLM and agent outputs into structured, queryable data for the product layer
- Improve reliability, accuracy, throughput, and cost of LLM-driven jobs in production
- Build observability, evals, and tooling so the team can debug, iterate, and measure system performance quickly
- Partner with AI engineers to expose new capabilities through the platform and shape the interfaces they build on
- Participate in on-call rotation and incident response (paid additionally on top of base salary)
Interested in this one?
There is no apply button here on purpose. Tell us about yourself, we book a short call, and if this role fits we walk you through the company and ask before anything is sent. Always free for you.
Tell us about you