Posted
13 Aug 2026
Last seen
15 Aug 2026
Location
Germany
Lifecycle
fresh
Grade
C
About the jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.Position: UI / UX Design ExpertType:ContractCompensation:$80–$150/hourLocation:RemoteRole Responsibilities
Design precise, task-specific grading criteria for real-world digital product and UX deliverables.
Score AI-generated and human work samples against criteria with detailed written justifications.
Apply consistent, evidence-based judgment for reproducible and defensible scores.
Incorporate structured feedback from senior reviewers and iterate quickly on work.
Work independently and asynchronously to evaluate and improve AI model performance.
QualificationsMust-Have
5+ years of professional experience in product design, UI/UX, or design systems.
Background at leading digital-product and UX studios or in-house product-design teams.
Experience in Product / UI / Design Systems Design, UX Lead, or UX Writing.
Deep fluency in interaction and visual design, design systems, and Figma.
Exceptionally strong written communication skills.
Detail-oriented and comfortable with peer-reviewed judgment.
PreferredPrior experience with AI training, evaluation, or human-data projects.Application Process (Takes 20–30 mins to complete)
Submit your resume, portfolio, or relevant professional background.
Qualified applicants may complete a brief assessment or submit additional information.
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.Originally posted on Himalayas
Design precise, task-specific grading criteria for real-world digital product and UX deliverables.
Score AI-generated and human work samples against criteria with detailed written justifications.
Apply consistent, evidence-based judgment for reproducible and defensible scores.
Incorporate structured feedback from senior reviewers and iterate quickly on work.
Work independently and asynchronously to evaluate and improve AI model performance.
QualificationsMust-Have
5+ years of professional experience in product design, UI/UX, or design systems.
Background at leading digital-product and UX studios or in-house product-design teams.
Experience in Product / UI / Design Systems Design, UX Lead, or UX Writing.
Deep fluency in interaction and visual design, design systems, and Figma.
Exceptionally strong written communication skills.
Detail-oriented and comfortable with peer-reviewed judgment.
PreferredPrior experience with AI training, evaluation, or human-data projects.Application Process (Takes 20–30 mins to complete)
Submit your resume, portfolio, or relevant professional background.
Qualified applicants may complete a brief assessment or submit additional information.
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.Originally posted on Himalayas