Senior Software Development Engineer, AWS Mantle

Role responsibilities

Lead the technical vision and architecture for the AWS Mantle distributed inference engine powering Amazon Bedrock. Drive cross-organizational initiatives to scale AI infrastructure while ensuring high performance, reliability, and zero-trust security.

Requirements

Requires 5+ years of professional software development and architecture experience, including leadership as a tech lead or mentor. A bachelor's degree in Computer Science or a related field is required, with a preference for advanced degrees and experience in large-scale AI solutions.

Key skills

Distributed Systems, Machine Learning Systems, System Design, Software Architecture, Java, C++, Python, Go, Rust, Capacity Management, API Design, Zero Trust Security, vLLM, TensorRT, Triton Inference Server, Scalability

Keywords

AWS Mantle, Amazon Bedrock, Distributed Inference Engine, Foundation Models, Generative AI, Machine Learning, Distributed Computing, Zero Operator Access, ZOA, Latency, Reliability, Scalability, Operational Excellence, vLLM, TensorRT, Triton Inference Server, Java, C++, Python, Go, Rust, System Design, API Experience, Cloud Infrastructure, Capacity Management, Software Development Life Cycle, SDLC, Code Reviews, Source Control, Internet Scale