Software Engineer, AI Platform

Role responsibilities

Develop and scale shared AI platform primitives and production-ready guardrails to accelerate the shipment of AI features. Operate critical AI systems in production, focusing on observability, latency, cost, and the safe adoption of new models and providers.

Requirements

Requires a passion for scaling AI systems and experience with LLM or ML infrastructure. Candidates should be adaptable, possess extreme ownership, and ideally have 2-4 years of software engineering experience with TypeScript and Node.js.

Key skills

LLM, ML Platform, Infrastructure, Backend Development, TypeScript, Node.js, Apache Spark, Ray, MLOps, ML Serving Infrastructure, Prompting, Model Integrations, Observability, Data Processing Pipelines, API Design, System Scaling

Keywords

AI Platform, LLM, MLOps, TypeScript, Node.js, Apache Spark, Ray, Infrastructure, Observability, Model Integration, Context Management, Data Pipelines, API, Backend, Full-stack, Scaling, Reliability, Latency, Evals, Release Gates, Guardrails, Software Engineering, AI Agents, ML Serving