πŸ’» Software Engineer – AI Code Evaluation & Benchmarking

πŸ’» Software Engineer – AI Code Evaluation & Benchmarking | Turing Are you an experienced Software Engineer with strong Python, Git, and Docker skills looking for a remote opportunity in AI? Turing is hiring Software Engineers to help evaluate, benchmark, and improve the coding capabilities of advanced AI models. This role is ideal for professionals with experience in software development, code review, debugging, testing, and technical problem-solving who want to contribute to the development of next-generation AI systems. πŸ’Ό Job Details Position: Software Engineer – AI Code Evaluation & Benchmarking Company: Turing Job Type: Contractor Location: πŸ‡ΊπŸ‡Έ US Candidates Only Duration: 1 month Expected Start: Next week Commitment: Minimum 20 hours/week Daily Requirement: At least 4 hours/day PST Overlap: 4 hours required πŸ”§ Required Skills Python Git Docker Software Engineering Code Review Debugging Data Structures & Algorithms Software Testing AI/LLM Evaluation πŸ“‹ What You'll Do As a Software Engineer, you will: Review and evaluate AI-generated code. Check code for correctness, efficiency, and maintainability. Debug software and reproduce technical issues. Validate AI-generated solutions against real-world engineering tasks. Evaluate AI reasoning and technical explanations. Create and improve coding benchmarks and evaluation datasets. Identify edge cases and common AI coding failures. Provide structured feedback to improve AI model performance. Help establish quality standards for AI coding evaluations. πŸŽ“ Requirements Candidates should have: Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field. 3+ years of professional software engineering experience. Strong proficiency in at least one programming language such as Python, Java, C/C++, Go, Swift, Objective-C, PHP, or SQL. Strong knowledge of algorithms, data structures, software design, and debugging. Professional code-review experience. Familiarity with Git and modern software development workflows. Strong written communication and attention to detail. Experience with AI/ML annotation, NLP, prompt engineering, LLM evaluation, or AI-generated code evaluation is a strong advantage. πŸ€– Why This Role? This opportunity allows experienced software engineers to work on cutting-edge AI projects and help improve the coding capabilities of advanced LLMs. If you are eligible and interested, check the Turing application requirements and referral process before applying. πŸ§ͺ Evaluation Process The selection process includes an online automated coding challenge, including a Python and Docker test. Apply NOw