
Product Manager - Remote
YO IT Consulting
Job description
Product Manager / Product Owner
Role Type:
Contractor
Location:
Remote
We are seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving advanced AI systems.
Youโll apply your product expertise to assess AI-generated content, specifications, and product documentation.
No prior AI experience is required.
This is strictly an evaluation and analysis role
. It does not involve roadmap ownership, delivery management, sprint facilitation, stakeholder leadership, or program management. Candidates should have strong product management or product ownership experience.
Scope of Work
-
Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications.
-
Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions.
-
Provide detailed rationales and actionable feedback for each evaluation.
-
Identify content that is fluent but fails to address the intended question or user need.
-
Detect factual inaccuracies, inconsistencies, and violations of prompt requirements.
-
Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency.
Preferred Qualifications
-
Professional experience as a Product Manager or Product Owner.
-
Native-level English fluency and excellent written communication skills.
-
Experience creating and reviewing PRDs, specifications, acceptance criteria, release notes, or decision documents.
-
Ability to evaluate content for technical stakeholders, executives, and end users.
-
Strong critical analysis, attention to detail, and written feedback skills.
-
Ability to work independently and meet deadlines in a remote environment.
-
Familiarity with AI model evaluation, RLHF, or annotation is a plus, but not required.