01 · The role
What you would do
- Review the code and behavior of AI coding agents working in real-world repositories
- Judge whether the agents' solutions are correct, robust and maintainable, and pinpoint where they fail
- Draft and iterate on the rubrics and criteria used to judge preference data
- Label and review data carefully enough to catch subtle problems
- Build and maintain pipelines for generating, collecting and evaluating data
- Write up findings and recommendations, working closely with researchers and engineers
02 · Requirements
What they ask for
- Five or more years of hands-on software engineering experience
- Strong skills in Python, TypeScript/JavaScript, Go or another major production language, with experience in large real-world codebases
- Strong code-review skills, sound technical judgment and clear written communication
- Hands-on use of current LLMs or AI coding tools
- Residence in North America, and availability for 20–40 hours a week with at least 6 hours a day of overlap with US Pacific time
- Pass Turing's evaluation: an AI interview (about 25 minutes), a practical code and AI evaluation exercise (about 30 minutes) and a hiring-manager interview (about 20 minutes)
Helpful, not required
- Experience with LLM evaluation, coding agents, RLHF, preference data, rubric design or post-training
- Code review
- AI evaluation
- Coding agents
- Rubric design
- Software engineering
03 · Eligibility
Who can apply
Remote, North America only.
Not in Africa
As far as the listing and Turing's country rules show, this role is not open to people living in Nigeria, Kenya, Ghana, South Africa or Egypt. Turing in Africa
Apply from where you live, as yourself. Using a VPN or someone else's identity to get around a country rule breaks these platforms' terms, and it is the quickest way to lose an account and any unpaid earnings.
04 · Applying
How to get in
You apply through Turing's own process. The steps from sign-up to first paid task are on its profile.
- How to pass AI training assessments: what the assessment checks, and how to prepare.
- Getting paid from Africa: PayPal, Payoneer, Airtm, Wise and more. It covers which of Turing's payout routes work where you live, and what they cost.
05 · Source
About this listing
We last confirmed this opening on Oct 31, 2026. Rates and hours come from the listing unless the note beside the rate says otherwise. Where the listing names no countries, the Africa status is our reading of it and of what is known of Turing's country rules, set out on its profile, and never marks a role more open than they show. The listing itself has the final word.
The listing on work.turing.com(opens in a new tab)