Principal Product Manager

Yammer
Redmond, WAPosted Jul 29, 2026

Embed in the post-training loop: work day-to-day with research and applied ML teams during fine-tuning and RLHF cycles, reviewing model outputs and giving structured feedback on quality, tone, and behavior Run RLHF/preference data campaigns: partner with data and labeling teams to scope what human preference data gets collected, for which behaviors, and why Build and maintain behavior evals: translate qualitative judgment calls ("this response felt too hedgy," "this refused when it shouldn't have") into evaluation sets that can be tracked release over release Own the feedback loop: turn user research, enterprise customer feedback, and production incident learnings into concrete post-training priorities — closing the gap between "users are unhappy with X" and "the next fine-tune addresses X" Make the tuning tradeoffs explicit: helpfulness vs. caution, consistency vs. personality, latency/cost vs. quality — and drive alignment across research, safety, and product leadership on where the line sits Represent Responsible AI and enterprise requirements into training priorities — compliance behaviors, refusal policies, and brand voice all have to be reflected in what the model is actually tuned to do. Bachelor's Degree AND 10+ years experience in product/service/program management or software development Bachelor's Degree AND 15+ years experience in product/service/program management or software development OR equivalent experience. 6+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework). 8+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn). 8+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).

Want jobs like this matched to you?

SimpleCareer scores fresh postings against your résumé so you only see the matches that matter.

Get started free