Software Engineer, AI Platform

Role responsibilities

Develop and scale core AI platform primitives and shared foundations to enable rapid and safe deployment of AI products. Partner with product teams to provide production-ready guardrails and optimize AI system performance, latency, and cost.

Requirements

Requires experience with LLM, ML platforms, or infrastructure, with a strong focus on scaling reliability and quality. Preferred qualifications include 2-4 years of software engineering experience and proficiency in TypeScript, Node.js, and data processing tools like Spark or Ray.

Key skills

LLM, ML Platform, Infrastructure, TypeScript, Node.js, Apache Spark, Ray, MLOps, ML Serving, API Design, Observability, Prompting, Model Integration, Data Processing Pipelines, Backend Development, Full-stack Development

Keywords

AI Platform, LLM, MLOps, TypeScript, Node.js, Apache Spark, Ray, Infrastructure, Observability, Model Integration, Context Management, API, Backend, Full-stack, Data Pipelines, ML Serving, Prompting, Evals, Release Gates, Scalability, Latency, Cost Optimization, Software Engineering, AI Agents, Guardrails