YO HR Consultancy
AI trainer
Title: French AI Data Trainer – Remote
Location: Remote
Role Overview
We are seeking a detail-oriented and analytically strong AI Safety & Trust Evaluation Specialist to support the development of safer, more reliable AI systems. In this fully remote, hourly contractor role, you will evaluate AI-generated responses, assess reasoning quality, and provide expert safety-focused annotations in both French and English.
Your work will directly contribute to improving the safety alignment of large language models by identifying risks, labeling sensitive content, and ensuring outputs comply with strict safety policies. This includes exposure to sensitive material, and requires strong emotional resilience and professional judgment.
Key Responsibilities
Evaluate AI-generated content for accuracy, safety, and policy compliance
Annotate and label safety-critical datasets in English and French with high linguistic precision
Identify unsafe outputs related to:
Hate and harassment
Sexual content
Violence and self-harm
Bias and misinformation
Illegal or harmful activities
Malicious content or code
Compare multiple AI responses and score them based on safety and quality rubrics
Identify model failure patterns such as evasion, escalation, or unsafe normalization
Conduct red-teaming and adversarial testing to uncover model vulnerabilities
Document findings clearly, including reasoning behind safety judgments
Support refinement of annotation guidelines and edge-case decision frameworks
Ensure consistency in policy interpretation across evaluations
Required Qualifications
Bachelor’s degree or equivalent experience in Linguistics, Communications, Psychology, Law, Policy, Security Studies, or related field
Native or near-native French proficiency (reading and writing)
Minimum C1 English proficiency (reading and writing)
Experience in Trust & Safety, content moderation, policy enforcement, risk operations, or safety evaluation
Proven LLM red teaming experience (ability to test model safety boundaries and document findings)
Strong analytical judgment and ability to work with ambiguous policy situations
High attention to detail and ability to explain decisions clearly and consistently
Comfortable working independently in a remote contractor setup
Preferred Qualifications
Prior experience in AI training data, annotation, or model evaluation
Familiarity with tools such as ChatGPT, Gemini, Perplexity, or similar AI systems
Experience working with structured safety taxonomies or labeling frameworks
Background in investigative or policy-driven analytical roles
To apply for this job please visit yohrconsultancy.hiresome.ai.