Senior Software Engineer (Agentic Coding RL Environments)

DataAnnotation
Chicago, ILFULL_TIMEPosted Jul 29, 2026

Role responsibilities

Build coding RL environments and benchmarks to test agent performance on realistic software engineering tasks. Design tasks, review model outputs, and establish success criteria to improve future models.

Requirements

Requires professional experience shipping scaled production systems and expertise in at least one common tech stack. Strong engineering judgment and the ability to work independently are essential.

Key skills

TypeScript, Python, Ruby, PHP, Java, Rust, Go, C++, Software Engineering, Code Review, RL Environments, Benchmarking

Keywords

RL Environments, Agentic Coding, Software Engineering, TypeScript, Python, Ruby, PHP, Java, Rust, Go, C++, Benchmarks, Red-teaming, Production Systems, Model Evaluation, Frontier Models

Want jobs like this matched to you?

SimpleCareer scores fresh postings against your résumé so you only see the matches that matter.

Get started free