Role responsibilities
Lead the architectural design and delivery of core AI platform systems, including the LLM Gateway and Knowledge Base infrastructure. Oversee AI FinOps for cost optimization and collaborate cross-functionally to build production-grade AI agents.
Requirements
Requires at least 5 years of software engineering experience in ML/AI infrastructure or distributed systems. Proficiency in Python and a systems language like Go, Rust, or C++ is essential, along with deep knowledge of LLM orchestration and vector databases.
Key skills
ML/AI Infrastructure, LLM Systems, Distributed Platform Services, Python, Go, Rust, C++, API Design, Microservices, Vector Databases, Model Serving Architectures, AI FinOps, Orchestration Patterns, Agent Frameworks, Observability Tools, Fine-tuning
Keywords
Artificial Intelligence, Large Language Models, LLM Gateway, AI FinOps, Vector Databases, Python, Go, Rust, C++, Microservices, Distributed Systems, Model Serving, PII Redaction, Observability, Fine-tuning, Machine Learning, Cloud Providers, API Design, Infrastructure, Agent Frameworks