💻 Senior Software Engineer – AI Evaluation / Coding Agents | Remote Job at Turing
💻 Senior Software Engineer – AI Evaluation / Coding Agents | Remote Job at Turing
Are you an experienced software engineer with strong coding, code review, and AI development skills? 🤖 Turing is looking for senior software engineering professionals to help evaluate and improve advanced AI coding models.
In this role, you will work with AI coding agents across real-world software repositories, assess AI-generated code, identify technical errors, and provide detailed feedback to improve model performance.
This opportunity is ideal for experienced engineers who enjoy solving practical engineering problems, reviewing code quality, and working with modern AI tools.
📌 Job Details
- 🏢 Company: Turing
- 💼 Position: Senior Software Engineer – AI Evaluation / Coding Agents
- 🌎 Location: Remote — North America only
- 📄 Job Type: Independent Contractor / Freelance
- 💰 Compensation: $100–$150 per hour
- ⏰ Availability: 20–40 hours per week
- 🕒 Time Zone Requirement: At least 6 hours of overlap with Pacific Time per day
- 📅 Duration: Approximately 3 months
- 🚀 Start Date: As soon as possible
🛠️ Required Skills
- 🐍 Python
- 💻 TypeScript and JavaScript
- ⚙️ Go, Java, or another major production programming language
- 🐙 GitHub and version control
- 🔄 CI/CD pipelines
- 🌐 Open-source software
- 🤖 Large Language Models (LLMs)
- 🔍 Code reviews and code analysis
- 🧪 Software testing and evaluation
- 📝 Technical documentation and written communication
💼 Roles and Responsibilities
1. 🤖 Evaluate AI coding agents working on real-world software repositories.
2. 🔍 Review AI-generated code for technical correctness, reliability, maintainability, and robustness.
3. 🧠 Identify errors, weaknesses, and failure patterns in AI-generated solutions.
4. 📋 Design and refine evaluation rubrics and criteria for comparing AI-generated code.
5. ✅ Review and label evaluation data while maintaining high quality standards.
6. ⚙️ Build and maintain pipelines and infrastructure for data generation, collection, and evaluation workflows.
7. 📝 Document findings and provide clear recommendations to improve AI model performance.
8. 🤝 Collaborate with researchers and engineers to turn technical judgments into scalable evaluation processes.
🎓 Required Qualifications
- 💼 At least 5 years of hands-on software engineering experience.
- 💻 Strong proficiency in Python, TypeScript, JavaScript, Go, Java, or another major production programming language.
- 🏗️ Experience working with substantial, real-world software codebases.
- 🔍 Strong code review skills and sound technical judgment.
- 🧠 Ability to explain why code is correct, incorrect, or in need of improvement.
- ✍️ Excellent written communication skills.
- 🤖 Experience using modern LLMs or AI coding tools.
⭐ Additional Experience That Can Help
Experience in the following areas is beneficial but not required:
- AI model evaluation
- AI coding agents
- RLHF (Reinforcement Learning from Human Feedback)
- Preference data
- Evaluation rubric design
- AI model post-training
💰 Compensation and Engagement
- 💵 Hourly Rate: $100–$150
- ⏰ Weekly Commitment: 20–40 hours
- 📅 Project Duration: Approximately 3 months
- 📄 Engagement Type: Independent contractor
Applicants should provide their specific expected hourly rate during the application process. Final compensation and engagement terms will depend on the project's requirements and the agreed rate.
🧪 Hiring and Evaluation Process
Candidates can expect the following evaluation stages:
1. 🤖 AI Interview: Approximately 25 minutes.
2. 💻 Practical Code/AI Evaluation: Approximately 30 minutes.
3. 👥 Hiring Manager Interview: Approximately 20 minutes.
The practical exercise focuses on reviewing and evaluating AI-generated code rather than competitive programming or algorithm puzzles.
🌟 Why Consider This Opportunity?
- 💰 Competitive advertised compensation of $100–$150 per hour.
- 🌎 Remote freelance work.
- 🤖 Direct involvement in improving advanced AI coding systems.
- 💻 Opportunity to apply senior-level engineering judgment.
- 🧠 Work with real-world repositories and AI coding agents.
- 📅 A focused project lasting approximately three months.
🎯 Who Can Apply?
This opportunity is intended for experienced software engineers who have at least five years of hands-on engineering experience, strong code review abilities, and familiarity with modern AI coding tools.
Important eligibility requirement: The role is restricted to candidates in North America only. Applicants must also be able to commit 20–40 hours per week and provide at least six hours of daily overlap with Pacific Time.
Apply Now