π» Software Engineer – AI Code Evaluation & Benchmarking
π» Software Engineer – AI Code Evaluation & Benchmarking | Turing
Are you an experienced Software Engineer with strong Python, Git, and Docker skills looking for a remote opportunity in AI? Turing is hiring Software Engineers to help evaluate, benchmark, and improve the coding capabilities of advanced AI models.
This role is ideal for professionals with experience in software development, code review, debugging, testing, and technical problem-solving who want to contribute to the development of next-generation AI systems.
πΌ Job Details
Position: Software Engineer – AI Code Evaluation & Benchmarking
Company: Turing
Job Type: Contractor
Location: πΊπΈ US Candidates Only
Duration: 1 month
Expected Start: Next week
Commitment: Minimum 20 hours/week
Daily Requirement: At least 4 hours/day
PST Overlap: 4 hours required
π§ Required Skills
Python
Git
Docker
Software Engineering
Code Review
Debugging
Data Structures & Algorithms
Software Testing
AI/LLM Evaluation
π What You'll Do
As a Software Engineer, you will:
Review and evaluate AI-generated code.
Check code for correctness, efficiency, and maintainability.
Debug software and reproduce technical issues.
Validate AI-generated solutions against real-world engineering tasks.
Evaluate AI reasoning and technical explanations.
Create and improve coding benchmarks and evaluation datasets.
Identify edge cases and common AI coding failures.
Provide structured feedback to improve AI model performance.
Help establish quality standards for AI coding evaluations.
π Requirements
Candidates should have:
Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
3+ years of professional software engineering experience.
Strong proficiency in at least one programming language such as Python, Java, C/C++, Go, Swift, Objective-C, PHP, or SQL.
Strong knowledge of algorithms, data structures, software design, and debugging.
Professional code-review experience.
Familiarity with Git and modern software development workflows.
Strong written communication and attention to detail.
Experience with AI/ML annotation, NLP, prompt engineering, LLM evaluation, or AI-generated code evaluation is a strong advantage.
π€ Why This Role?
This opportunity allows experienced software engineers to work on cutting-edge AI projects and help improve the coding capabilities of advanced LLMs.
If you are eligible and interested, check the Turing application requirements and referral process before applying.
π§ͺ Evaluation Process
The selection process includes an online automated coding challenge, including a Python and Docker test.
Apply NOw