Software Engineer (Remote)

Role responsibilities

Evaluate and benchmark the coding capabilities of advanced AI models to ensure accuracy and reliability. This includes reviewing AI-generated code, validating solutions against real-world tasks, and maintaining evaluation datasets.

Requirements

Requires a Bachelor's or Master's degree in Computer Science or a related field with over 3 years of professional software engineering experience. Proficiency in one or more major programming languages and a strong grasp of algorithms and data structures are essential.

Key skills

AI Code Evaluation, Benchmarking, Code Review, Debugging, Python, Java, C/C++, Go, Swift, Objective-C, PHP, SQL, Data Structures, Algorithms, Software Design Principles, Technical Writing

Keywords

AI, Large Language Models, LLM, Software Engineering, Code Evaluation, Benchmarking, Python, Java, C++, Go, Swift, Objective-C, PHP, SQL, Data Structures, Algorithms, Debugging, Code Review, Human Feedback, Technical Accuracy, Software Design, Maintainability, Edge Cases, Failure Modes, Grading Rubrics