Senior Software Development Engineer, AWS Mantle

Role responsibilities

Lead the technical vision and architecture for the AWS Mantle distributed inference engine powering Amazon Bedrock. Drive cross-organizational initiatives to scale AI infrastructure while ensuring high performance, reliability, and zero-trust security.

Requirements

Requires 5+ years of professional software development and architecture experience, including leadership as a tech lead or mentor. A bachelor's degree in Computer Science or a related field is required, with a preference for advanced degrees and experience in large-scale AI solutions.

Key skills

Distributed Systems, Machine Learning Systems, System Design, Software Architecture, Java, C++, Python, Go, Rust, Capacity Management, API Design, Zero Trust Security, vLLM, TensorRT, Triton Inference Server, Scalability

Keywords

AWS Mantle, Amazon Bedrock, Distributed Inference Engine, Foundation Models, Generative AI, Machine Learning, Distributed Computing, Zero Operator Access, ZOA, Latency, Reliability, Scalability, Operational Excellence, vLLM, TensorRT, Triton Inference Server, Java, C++, Python, Go, Rust, API, Cloud Infrastructure, System Design, Software Development Life Cycle, SDLC, Capacity Management, High Performance Computing, Zero Trust, AI Infrastructure