💻 Senior Software Engineer – AI Evaluation / Coding Agents at Turing

💻 Senior Software Engineer – AI Evaluation / Coding Agents at Turing Are you an experienced software engineer interested in improving the next generation of AI coding tools? Turing is seeking skilled software engineers to evaluate AI-generated code, review coding agent performance, and help improve the quality and reliability of advanced AI models. This is a freelance, fully remote opportunity for engineers with strong programming, code review, and technical problem-solving skills. 💰 Compensation: $100–$150 per hour Please note that the position is open to candidates in North America only. 📌 Job Overview - 🏢 Company: Turing - 💼 Job Title: Senior Software Engineer – AI Evaluation / Coding Agents - 🌍 Work Mode: Fully Remote - 📍 Location: North America only - 💵 Hourly Compensation: $100–$150 - 📄 Employment Type: Independent Contractor / Freelance - ⏳ Project Duration: Approximately 3 months - 🕒 Availability: 20–40 hours per week - 🌐 Time-Zone Requirement: At least 6 hours of Pacific Time overlap per day - 🚀 Expected Start: As soon as possible - 🎁 Referral Bonus: $500 shown on the listing; this is a referral incentive, not the applicant's compensation. 🏢 About Turing Turing is an AI infrastructure company that works with leading AI research laboratories to accelerate model development through high-quality training data, evaluations, and engineering expertise. In this role, software engineers will help evaluate AI coding models and determine whether their generated code is correct, reliable, maintainable, and suitable for real-world software projects. 🔍 Job Responsibilities Selected candidates will work with AI coding agents and real-world software repositories. Key responsibilities include: - 💻 Reviewing AI-generated code for correctness, quality, and maintainability. - 🔎 Identifying bugs, technical weaknesses, and failure patterns in AI coding agents. - 📋 Designing and improving evaluation rubrics and criteria for comparing AI-generated solutions. - 🏷️ Reviewing and labeling technical data while maintaining high quality standards. - ⚙️ Building and maintaining pipelines and infrastructure for data generation and evaluation. - 📝 Writing clear technical reports, findings, updates, and recommendations. - 🤝 Collaborating with AI researchers and software engineers to improve evaluation workflows. - 🧠 Explaining why a code implementation succeeds, fails, or requires improvement. 🎓 Required Qualifications Applicants should have the following skills and experience: - At least 5 years of hands-on software engineering experience. - Strong proficiency in Python, TypeScript, JavaScript, Go, or another major production programming language. - Experience working with substantial real-world codebases. - Strong code-review and technical analysis skills. - Ability to identify bugs and evaluate different implementation approaches. - Strong written communication and technical documentation skills. - Experience using modern large language models (LLMs) or AI coding tools. - Familiarity with GitHub, version control, and software development workflows. 🛠️ Required and Relevant Technical Skills The listing highlights the following skills: - Python - TypeScript - JavaScript - Go - Java - GitHub - CI/CD - Open-source software - Large Language Models (LLMs) - Code reviews - Code analysis Experience with every programming language is not necessarily required; applicants should demonstrate strong proficiency in at least one major production language and relevant software engineering experience. ⭐ Preferred Experience The following experience is an advantage but is not mandatory: - LLM evaluation. - AI coding agents. - Reinforcement Learning from Human Feedback (RLHF). - Preference data evaluation. - Evaluation rubric design. - AI model post-training. Candidates with strong software engineering judgment and code-review experience may be suitable even without previous professional experience in AI model evaluation. 💰 Compensation and Work Schedule The advertised compensation is $100–$150 per hour. Detail Information Hourly rate $100–$150 Weekly availability 20–40 hours Project duration Approximately 3 months Contract type Independent contractor Work arrangement Remote Time-zone overlap At least 6 hours with Pacific Time per day Applicants should provide their expected hourly rate during the application process. Confirm the final rate, payment terms, and contract conditions with Turing. The advertised hourly rate is not a guarantee of earnings; actual compensation depends on the agreed rate, approved hours, and contract terms. 🧪 Evaluation and Interview Process The hiring process includes three stages: 1. AI Interview — Approximately 25 minutes Candidates will complete an AI interview as part of the initial evaluation. 2. Practical Code / AI Evaluation Exercise — Approximately 30 minutes This exercise focuses on reviewing AI-generated code, identifying technical issues, and evaluating implementation quality. It is not primarily a competitive programming or algorithm-puzzle test. 3. Hiring Manager Interview — Approximately 20 minutes Shortlisted candidates will discuss their technical experience, judgment, and suitability for the project. 🌎 Who Can Apply? This role is intended for experienced software engineers who meet the technical requirements and can work within the required schedule. ⚠️ Important location restriction: The job description explicitly states North America only. Candidates based in Pakistan or other regions outside North America do not meet the stated location requirement. Applicants should confirm eligible countries and any work-location requirements on the official application page. Apply Now