Pr Writer / Ai Code Evaluator

We are seeking a PR Writer / AI Code Evaluator with a Software Engineering background to help evaluate and improve the performance of AI coding models. In this role, you will work within real Git-based codebases and assess how effectively AI systems implement engineering tasks.

The position focuses on reviewing AI-generated code as if it were a pull request (PR) in a production environment. Candidates will guide the AI through iterative improvements while ensuring the final output meets professional software engineering standards.

You will evaluate AI-generated code by assigning scoped engineering tasks within an existing codebase. After the AI produces a solution, you will review the implementation similarly to a PR review process. This includes providing feedback, suggesting improvements, and iteratively refining the code until it reaches production-ready quality.

Beyond verifying correctness, the role requires assessing engineering quality, including system design, maintainability, test coverage, handling of edge cases, commit structure, documentation, and overall readiness for code review.

You will also produce structured comparative feedback to measure the performance of different AI models, helping identify strengths and weaknesses in their engineering output.

The ideal candidate should have a strong background in software engineering, experience working with Git workflows, and familiarity with professional code review practices. Experience writing or reviewing pull requests, evaluating code quality, and understanding software design principles is essential.

Candidates should be comfortable analyzing code for:

• Architecture and design decisions
• Test quality and coverage
• Edge case handling
• Commit hygiene and clarity
• Review readiness and maintainability

Strong written communication skills are important, as the role requires producing clear and structured feedback on model performance.

This role directly contributes to improving the reliability and engineering capability of AI coding systems. By evaluating real-world tasks and guiding iterative improvements, you will help ensure AI models can produce production-grade software solutions.

Interested candidates can start the evaluation process using the following link:

https://app.alignerr.com/signin?referral-code=6c777641-8666-42b1-ad5a-721399bef8a2&program=f279c190-f752-11f0-a378-431be9e5e882

If you want, I can also:

• turn this into a LinkedIn job post,
• create a shorter version for social media, or
• make a resume-friendly description if you're sharing it as a referral.