Sr. Software Dev Engineer, SageMaker AI

Role responsibilities

Design and deliver core components of the SageMaker data preparation platform, focusing on auto-labeling and LLM-as-judge evaluation systems. Lead the evolution of human-in-the-loop services and provide technical leadership through mentoring and architectural decision-making.

Requirements

Requires at least 5 years of professional software development experience, including leadership in system design and architecture. Preferred qualifications include a bachelor's degree in computer science and hands-on experience with ML pipelines and LLMs.

Key skills

Software Development, System Architecture, Distributed Systems, Machine Learning Infrastructure, Large Language Models, Data Processing, Auto-labeling, Human-in-the-loop Workflows, LLM-as-Judge, Technical Leadership, Mentoring, Design Patterns, Scaling, Reliability Engineering, Prompting, Fine-tuning

Keywords

SageMaker, AI, Machine Learning, LLM, Data Labeling, AWS, Cloud Computing, Distributed Systems, Data Quality, Evaluation Frameworks, HITL, Ground Truth, Fine-tuning, Prompting, Structured Output, Confidence Calibration, Software Development Life Cycle, Code Reviews, Source Control Management, Build Processes, Testing, Operations, ML Pipelines, Data Processing Systems, Evaluation Infrastructure