Skip to content
Domain expertsFreelanceSome African countries

Physician (MD/DO) – Medical AI Evaluation

On Mindrift, run by Toloka

$35/hr

Practicing physicians score written clinical cases for a medical AI benchmark, checking each case, its proposed answer and the reasoning behind it. It suits doctors who live outside the US and hold an active, unrestricted US medical license; medical students, unlicensed graduates and non-physician clinicians are not eligible.

Opens the listing on jobs.workable.com. ASV earns nothing from this link. Disclosure

Pay

$35/hr

About $35 an hour equivalent, paid per approved task at one flat rate based on estimated task time. QA and adjudication tasks pay more, and a one-time $50 reward follows your first approved production task.

Type
Freelance
Hours
Project-based; an estimated 10–20 hours a week while the project is active, at times you choose; not a minimum or a guarantee
Africa
Some countries
Platform
Mindrift
Posted
Oct 30, 2026

01 · The role

What you would do

  • Work through written patient cases drawn from health records, each set with a question, a suggested answer and a deliberately wrong option
  • Grade each case for clinical accuracy and completeness, for clues that give the answer away, and for how well the correct and wrong options are built
  • Test whether the answer can be reached from the case details alone, repair weak reasoning steps and explain each verdict in a few sentences
  • Read cases blind alongside two other physicians, after which a physician settles any disagreement

02 · Requirements

What they ask for

  • A medical degree (MD or DO) and a current US license with no restrictions, which Mindrift verifies when you join and again each month
  • A completed residency or board certification, and patient care in recent years; attending physicians are favored
  • Experience diagnosing and treating conditions across many organ systems, as in internal, family, emergency or hospital medicine
  • Sound clinical judgment: weighing a differential, deciding what to do next and following current guidelines
  • Written English at C1 level or above

Helpful, not required

  • Earlier work judging medical AI, reviewing clinical material or exam questions, or labeling and checking medical data
  • Internal medicine
  • Clinical reasoning
  • Differential diagnosis
  • Medical AI evaluation

03 · Eligibility

Who can apply

Remote, posted for South Africa, with an identical posting for Egypt. It is for physicians living outside the US who hold an active, unrestricted US medical license.

Countries named in the listing: South Africa.

Some African countries

Open in some African countries only: check the countries above, and the listing itself. Mindrift in Africa

Apply from where you live, as yourself. Using a VPN or someone else's identity to get around a country rule breaks these platforms' terms, and it is the quickest way to lose an account and any unpaid earnings.

04 · Applying

How to get in

You apply through Mindrift's own process. The steps from sign-up to first paid task are on its profile.

05 · Source

About this listing

We last confirmed this opening on Nov 1, 2026, and it was posted on Oct 30, 2026. Rates and hours come from the listing unless the note beside the rate says otherwise. Where the listing names no countries, the Africa status is our reading of it and of what is known of Mindrift's country rules, set out on its profile, and never marks a role more open than they show. The listing itself has the final word.

The listing on jobs.workable.com(opens in a new tab)

More open roles like this.

All openings

The platform

Mindrift

Toloka

Toloka's project-based platform for experts and writers who train AI.

VariesSelectiveGeneralist, Software & code, Math & science, Languages, Domain experts

Mindrift

Ready to apply? Read the listing first.

Check the rate, the hours and who can apply against the listing, follow the platform's own steps, and keep a second application going.

Physician (MD/DO) – Medical AI Evaluation

$35/hr

Apply(opens in a new tab)