01 · The role
What you would do
- Write rubrics for evaluating how AI agents handle multi-step tasks
- Debug agent traces to find where and why an agent went wrong
- Stress-test agents on realistic workflows to expose their failures
02 · Requirements
What they ask for
- At least two years in backend engineering, AI automation or complex systems integration
- A record of building and maintaining production software with cleanly separated services
- Fluency in two or more major programming languages, such as Python, JavaScript, Go or Java, plus work with SQL databases
- Practical experience with live, non-mocked systems and multi-turn interactions
- Clear, dense technical feedback on how complex systems behave
- Live in a country on Outlier's permitted list, and verify your identity with a valid ID
Helpful, not required
- Building multi-stage tasks in which gathered data feeds a reasoned result
- Connecting agents to live tools such as Supabase, Gmail and other APIs
- Keeping an agent's state across sessions, for example in a MEMORY.md file
- Spotting subtle failures such as privacy leaks, an agent overstepping its authority, or indirect prompt injection
- AI agents
- Python
- JavaScript
- SQL
- Debugging
- Evaluation rubrics
03 · Eligibility
Who can apply
Remote. The page accepts applicants globally, which means the countries Outlier's Flexible Working Guidelines allow work from: Egypt and South Africa are on that list, while Nigeria, Kenya and Ghana are not.
Some African countries
Open in some African countries only: check the listing for which. Outlier in Africa
Apply from where you live, as yourself. Using a VPN or someone else's identity to get around a country rule breaks these platforms' terms, and it is the quickest way to lose an account and any unpaid earnings.
04 · Applying
How to get in
You apply through Outlier's own process. The steps from sign-up to first paid task are on its profile.
- How to pass AI training assessments: what the assessment checks, and how to prepare.
- Getting paid from Africa: PayPal, Payoneer, Airtm, Wise and more. It covers which of Outlier's payout routes work where you live, and what they cost.
05 · Source
About this listing
We last confirmed this opening on Oct 31, 2026. Rates and hours come from the listing unless the note beside the rate says otherwise. Where the listing names no countries, the Africa status is our reading of it and of what is known of Outlier's country rules, set out on its profile, and never marks a role more open than they show. The listing itself has the final word.
The listing on outlier.ai(opens in a new tab)