User Experience Designer

Join a specialized project focused on evaluating large language models (LLMs) within professional UX and product design workflows. This role centers on identifying and mitigating contextual misuse risks in AI-generated outputs, such as privacy violations, manipulative patterns, and unsafe advice. You will assess LLM responses to prompts related to onboarding flows, consent mechanisms, healthcare and finance UX patterns, and accessibility. The position requires developing or refining scoring rubrics that address privacy risk, dark patterns, policy evasion, user harm, and clarity. You will deliver concise evaluations, including scores, rationales, and actionable recommendations for safer outputs, and design red-team prompts that simulate realistic misuse scenarios. This opportunity is ideal for experienced UX professionals with a strong background in regulated domains and a passion for advancing AI safety.

Responsibilities

• Review and evaluate LLM outputs for a range of UX/product design scenarios, focusing on risk factors such as privacy, manipulation, and user safety
• Develop, refine, and apply structured scoring rubrics across multiple risk dimensions
• Write clear, concise evaluations with scores, rationales, and improvement suggestions
• Propose and design red-team prompts to test model robustness against misuse
• Collaborate with stakeholders to ensure evaluation criteria align with industry standards and regulatory requirements
  
  

Skills And Requirements

• Minimum 7 years of experience in UX/Product Design or UX Research, preferably in regulated sectors (e.g., healthcare, finance)
• Proven expertise in developing evaluation rubrics or conducting structured reviews
• Deep understanding of privacy-by-design, consent UX, accessibility standards, and risk assessment in persuasive UX
• Strong analytical and written communication skills, with the ability to articulate complex findings clearly
• Familiarity with AI/LLM safety, policy evasion, and user harm mitigation is highly desirable
• Ability to work independently and deliver high-quality, actionable insights within set timelines
  
  

About Twine

Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally.

Our Mission

Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.