(US) QA Auditor (Sampling, Quality Gates, Release Readiness)
Actively Reviewing the ApplicationsCodvo.ai
On-site
Posted 10 hours ago
•
Apply by June 18, 2026
Job Description
QA Auditor (Sampling, Quality Gates, Release Readiness) - USA
JD: QA Auditor — Surgical Video Annotation (Sampling, Quality Gates, Release Readiness)
Location: USA | Type: Full-time
Reports to: Quality Lead / Program Lead
Role goal: Protect dataset quality at scale by running sampling-based audits, enforcing quality gates, and ensuring every dataset release is audit-ready and meets acceptance thresholds.
About Us
At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.
Responsibilities
Execute sampling plans (stratified by label type, difficulty, site/surgeon/device, model confidence) for ongoing QA and release audits.
Audit annotations against guidelines + ontology; score defects using standardized rubrics (severity, type, root cause).
Run and validate quality gates prior to release:
completeness/coverage checks
schema/constraint checks (illegal combinations, temporal consistency, boundary rules)
defect density and rework thresholds
Generate rework tickets with precise instructions; track closure and verify fixes.
Partner with Annotation Lead to drive calibration actions (training refreshers, guideline clarifications, examples library).
Maintain QA dashboards: defect rate, rework %, gate pass rate, audit cycle time, top error patterns by annotator/team/label type.
Support release readiness: ensure required artifacts are complete for the Evidence Pack (QA results, sampling logs, sign-offs).
Escalate systematic issues to Adjudication/Clinical Review (definition gaps, ambiguous classes, recurring edge cases).
Deliverables (what you produce weekly)
QA audit reports (sample size, findings, severity distribution, root-cause categories)
Gate status + release checklist sign-off recommendations
Rework queue and closure verification
Trend insights and corrective action plan (top 3 issues + fixes)
Requirements
3–7+ years in data QA / annotation QA / operations quality; experience auditing labeled datasets (video preferred).
Strong command of sampling-based QA: stratified sampling, acceptance thresholds, and audit scoring.
High attention to detail; comfortable reading and enforcing detailed SOPs/guidelines.
Strong documentation skills; can write clear defect descriptions and rework instructions.
Comfortable with dashboards/spreadsheets; basic metric literacy (defect density, rework, throughput).
Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.
Quick Tip
Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.
Related Similar Jobs
View All
Technical Account Manager
Peoplefy
India
Full-Time
Testing
Dashboards
Engine Field Service Technician - Level III
Cummins India
India
Full-Time
Communication
Sales
Engineering
+85
Special Agent: Military/ Law Enforcement Expertise
Federal Bureau of Investigation (FBI)
India
Full-Time
₹1–1 LPA
Safety
Training
International Law
+19
Food and Beverage Specialist (New Product Development)
Wellversed
India
Full-Time
Product Development
Engineering
Documentation
+32
talent acquisition operations coordinator - afternoon shift
Randstad Hungary
India
Full-Time
Administrative Tasks
Documentation
Interview Coordination
+33
Quick Apply
Upload your resume to apply for this position