Senior Software Engineer (Agentic Coding RL Environments)

DataAnnotation
Salt Lake City, UTFULL_TIMEPosted Jul 29, 2026

Role responsibilities

Build coding RL environments and benchmarks to evaluate agent performance on realistic software engineering tasks. Design tasks, review model outputs, and establish success criteria to improve future models.

Requirements

Requires professional experience shipping scaled production systems and expertise in at least one major tech stack. Candidates must possess strong engineering judgment and the ability to work independently.

Key skills

TypeScript, Python, Ruby, PHP, Java, Rust, Go, C++, Software Engineering, Code Review, RL Environments, Benchmarking, Red-teaming, Test Writing, Production Systems

Keywords

RL Environments, Agentic Coding, Benchmarks, TypeScript, Python, Ruby, PHP, Java, Rust, Go, C++, Production Systems, Red-teaming, Software Engineering, Model Evaluation, Frontier Models, Code Review

Want jobs like this matched to you?

SimpleCareer scores fresh postings against your résumé so you only see the matches that matter.

Get started free