Moonlight MCQA - Arabic Generalist Job at AuraOne Human Data, Remote

  • AuraOne Human Data
  • Remote

Job Description

Moonlight MCQA - Arabic Generalist is a remote Arabic specialist track for evaluating arabic evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.

Why this role matters

Multilingual model quality depends on reviewers who can read Arabic the way a native speaker does. AuraOne uses these reviewers to set the bar for tone, formality, and cultural register before a model ever ships to Arabic users.

Responsibilities

  • Evaluate Arabic model responses for fluency, accuracy, register, and cultural fit for Moonlight MCQA - Arabic Generalist assignments.
  • Compare paired arabic evaluation outputs and pick the stronger response with a written rationale.
  • Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
  • Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.
  • Calibrate against the AuraOne Arabic rubric in weekly reviewer-quality cycles.
  • Surface ambiguous prompts back to the program team so the rubric can be sharpened.
  • Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.

Qualifications

  • Native or near-native Arabic fluency with strong written-English ability for Moonlight MCQA - Arabic Generalist work.
  • Demonstrable experience editing, translating, or evaluating Arabic content.
  • Comfort applying multi-page rubrics consistently across long evaluation batches.
  • Clear written reasoning that names the issue and the standard being applied.
  • Reliable async availability for at least 10 hours per week.
  • Prior model-evaluation, annotation, or human-rater experience is a plus.

Example tasks

  • Score a pair of Arabic responses to a customer-support prompt and pick the better one with a 1-2 sentence rationale.
  • Flag formality mismatches in arabic evaluation outputs (T/V usage, honorifics, regional register).
  • Rewrite a model's Arabic response so it reads naturally and tag the original error category.
  • Audit a 50-row evaluation batch for rubric consistency and surface drift back to the program lead.

Nice to have

  • Background in Arabic linguistics, journalism, or translation studies.
  • Experience with TMS tools, MQM error taxonomies, or other structured QA frameworks.
  • Familiarity with LLM evaluation rubrics and inter-rater agreement workflows.

Skills

  • Multilingual evaluation
  • Native-speaker review
  • Rubric application
  • LLM output evaluation
  • Arabic evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$24–$30 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, For contractors, Freelance, 10 hours per week

Similar Jobs

Standard Logistics

Local CDL-A Asphalt Tanker Driver - Home Daily Job at Standard Logistics

 ...Job Description Standard Logistics is Now Hiring Local CDL-A Asphalt Tanker Driver in Myerstown, PA $6,000 Sign-On Bonus - Home Daily - 5 Days On, 2 Days Off Earn Up to $29.87 per Hour*- 401(k) with Company Match \n \n Standard Logistics operates flatbed and dry... 

City of Gulfport

Gulfport Firefighter Recruit Job at City of Gulfport

 ...Firefighter RecruitCity of Gulfport, MississippiDepartment: 290 FireFLSA Status: Non-ExemptSalary Range: $39,590.20 - $49,657.32Position...  ...defined as employees whose duties are vital to maintain basic municipal functions during an emergency.Responsibilities: This position... 

Seneca Holdings

Computer Defense Network Analyst Job at Seneca Holdings

 ...of the Seneca Nation.Seneca Technologies is hiring a Computer Network Defense Analyst. The Computer Network Defense (CND) Analyst supports a...  ...analyst plays a critical role in protecting information systems through continuous monitoring, threat detection, vulnerability... 

Department of the Interior

Supervisory Wildland Firefighter (Unit Fire Chief) Job at Department of the Interior

 ...Supervisory Wildland Firefighter (Unit Fire Chief) As a Supervisory Wildland Firefighter (Unit Fire Chief) your duties will include but are not limited to the following: # Supervises multiple Wildland Firefighters and provides second-level supervision over their... 

The Gellman Team

Real Estate Transaction Coordinator Job at The Gellman Team

 ...BIG? At The Gellman Team, St. Louis' #1 Real Estate Team, and the top eXp Realty team in...  ...'re looking for an exceptional closing coordinator who thrives in a dynamic, fast-paced environment...  ...think critically and swiftly when a transaction doesn't go exactly according to plan.As...