Software Engineer – AI Code Evaluation & Benchmarking
Software Engineer – AI Code Evaluation & Benchmarking Jobs at Turing |
Are you an experienced software engineer with strong programming, debugging, and code review skills? Turing is offering a remote contractor opportunity for software engineers to evaluate AI-generated code, test programming solutions, and help improve the coding capabilities of advanced artificial intelligence systems.
This opportunity is designed for experienced developers who enjoy solving complex technical problems, reviewing code quality, and working with emerging AI technologies.
📌 Job Overview
- Job Title: Software Engineer – AI Code Evaluation & Benchmarking
- Company: Turing
- Job Category: Software Engineering / Artificial Intelligence
- Job Type: Contractor Assignment
- Work Arrangement: Remote
- Location Requirement: United States only
- Experience Required: 3+ years of professional software engineering experience
- Education: Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field
- Contract Duration: 1 month
- Expected Start: Next week, according to the listing
- Minimum Commitment: 20 hours per week
- Daily Commitment: At least 4 hours per day
- Time Zone Requirement: 4 hours of overlap with Pacific Standard Time (PST)
- Evaluation Process: Online automated coding challenge covering Python and Docker
Important: This position is explicitly listed for US-based candidates only. Applicants outside the United States should confirm eligibility before applying.
📝 Job Description
Turing works with leading AI research laboratories to improve the reasoning, problem-solving, and coding capabilities of large language models (LLMs).
For this role, experienced software engineers will evaluate AI-generated code, validate programming solutions against real-world requirements, identify technical issues, and help develop reliable benchmarks for measuring AI coding performance.
Your work will help researchers understand where AI coding systems perform well and where they need improvement.
🛠️ Key Responsibilities
- Review AI-generated code for correctness, efficiency, and maintainability.
- Evaluate programming solutions against technical requirements.
- Debug code, reproduce issues, and verify fixes.
- Assess AI-generated explanations and implementation approaches.
- Create and maintain coding evaluation datasets and benchmarks.
- Develop grading rubrics for programming tasks.
- Identify edge cases and weaknesses in AI-generated solutions.
- Document findings and provide structured feedback.
- Collaborate with project teams to maintain consistent evaluation standards.
🎯 Required Qualifications
Applicants should have:
- At least 3 years of professional software engineering experience.
- A Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
- Strong programming skills in one or more supported languages.
- Knowledge of data structures, algorithms, and software design principles.
- Experience with debugging and code review.
- Familiarity with Git and modern software development workflows.
- Strong analytical thinking and problem-solving abilities.
- Excellent written communication and attention to detail.
Apply NOw