Quality Analyst

About Company:

Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018. It helps companies connect with remote software developers using AI-powered vetting and matching technology. Originally branded as the “Intelligent Talent Cloud, "enabled companies to “spin up their engineering dream team in the cloud” by sourcing and managing vetted global talent.

In recent years, they have evolved to support AI infrastructure and AGI workflows, offering services in model training, fine-tuning, and deployment—powered by their internal AI platform, ALAN, and backed by a vast talent network. They reported $300 million in revenue and reached profitability. Their growth is driven by demand for annotated training data from AI labs, including major clients like OpenAI, Google, Anthropic, and Meta.

Job Description:

Job Title: Quality Analyst

Location: Pan India

Experience: 2+ yrs.

Job Type : Contract to hire.

Work Mode: Remote

Notice Period: Immediate joiners.

Roles & Responsiblities:

Role Overview:

In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills. The ideal candidate should have the ability to read, summarize, review and break down large content into smaller logical blocks, conduct research online, validate claims made in content through online research, and work with the LLM (Large Language Models) to solve puzzles! The projects will also help you learn how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world! Your role is critical in helping fine-tune and improve large language models (like gpt), and will make you an expert on how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!

What does day-to-day look like:

You would spend time answering a variety of interesting analytical questions and creating scenarios that can train the LLM models to get better. Here are a couple of examples which models might get wrong and you would have to give the correct answer and explanation to enable the models to learn:

• Based on a given distribution of sales by month across locations, could you analyze which location has grown the most? (Hint: what time period should we look at? Should we account for sudden variability at the beginning?
• In a small town, there are four distinct neighborhoods: Oak, Pine, Maple, and Elm. A postman is assigned to deliver mail and can only deliver to two neighborhoods in one day, with certain rules (e.g. Oak is always visited before Pine). If he delivers to Oak and Elm on the first day, which neighborhoods does the carrier deliver to on the second day?
• Note: No other prior specialized domain experience is needed.

Requirements:

• English Proficiency: Ability to read and write in English with a high degree of comprehension skills.
• Analytical Skills: Good research and analytical skills
• Feedback Skills: Ability to provide constructive feedback and detailed annotations.
• Creative Thinking: Creative and lateral thinking abilities.
• Communication: Excellent communication and collaboration skills.
• Independence: Self-motivated and able to work independently in a remote setting.
• Technical Setup: Desktop/Laptop set up with a good internet connection.

Preferred Qualifications:

• Bachelor's degree or undergraduate in Engineering, Literature, Journalism, Communications, Arts, Statistics, or a related field.
• Proven experience of 2+ yrs in Quality Assurance, data annotation, or content review workflows Strong attention to detail, especially with text accuracy and formatting validation
• Experience writing professionally (business analysts, research analyst, copywriter, journalist, technical writer, editor, translator, etc.)
• Understanding of Excel and Google Suite.
• Proficiency in Data interpretation, Logical reasoning and Basic arithmetic is preferred