Professional Services Practice Reviewer Job at Mercor, San Francisco, CA

ZG12aEdBYjdQQ0QxQWliN3g5RlhxSGE2S3c9PQ==
  • Mercor
  • San Francisco, CA

Job Description

The role We're hiring working professional services practitioners to audit AI work product in their own field , not to produce it. You'll see an AI agent's complete attempt at a realistic task from your job: the task as written, what the agent did, the files it produced, and the scoresheet an AI grader filled in afterwards. You bring the judgment of someone who does this work for a living, and answer four questions: Is this a real task? Would it come up in this job, described this way? Realistic, borderline, or contrived. Is the domain content right? Are the standards, figures, regulations and constraints accurate and consistent, or is something subtly wrong in a way only a practitioner would catch? Does the grading hold up? The grader answered eleven yes/no questions about the finished work: correct format, fabricated figures, requirements met, terminology, and so on. You go through them with the files open and say where you disagree, and why. Is the score defensible? Band the work yourself. Could a practitioner use it? Accept it? Then check the reported score against your band. About an hour per item. You never perform the task or redo the agent's work. Who we're looking for Five roles. Apply to the one that's actually yours: Project Management Specialists. 5+ years running real project plans, schedules and budgets that other people worked to. PMP a plus. Lawyers. US-qualified and in active practice, 4+ years post-admission, drafting your own documents rather than only reviewing. Accountants and Auditors. 4+ years owning a close, an audit file or a set of financial statements. CPA or CA strongly preferred. Software Developers. 3+ years shipping production code that other engineers maintained after you. Computer and Information Systems Managers. 4+ years owning an IT function, its budget and its vendors. We want people who know the field cold: anyone who has reviewed a junior's work product, signed an audit opinion, run a code review that changed a design, or been through a project post-mortem. Less of a fit are people who managed the function without ever producing the artifact, and certification-only candidates with no delivery history. Also required: near-native business English, because you write a short reason for every judgment, and enough comfort with a spreadsheet or PDF to check whether the numbers in it reconcile.

Job Tags

Contract work

Similar Jobs

SOMERSET STAFFING

SAP ABAP Lead Consultant Job at SOMERSET STAFFING

 ...Job description SAP ABAP Lead Consultant Reno, Nevada- Hybrid Description We are seeking a senior SAP ABAP Lead Developer to design, build, and support complex SAP technical solutions within ECC and S/4HANA environments. Key Responsibilities Lead SAP... 

HVMG

Regional Director of Marketing Strategy Job at HVMG

Regional Director of Marketing StrategyAs the Regional Director of Marketing Strategy with HVMG, you'll play a vital role in shaping the marketing performance of our hotel portfolio across multiple markets and brands. This role will lead and support our property teams... 

SCS Engineers

Civil or Environmental Engineering Intern Job at SCS Engineers

 ...a world where environmental systems and infrastructure strengthen the health, safety and resilience of communities - from reducing methane emissions at landfills to producing alternative energy, from repurposing contaminated properties to sequestering carbon. As a 10... 

P&A Industrial Fabrications

Weaver Job at P&A Industrial Fabrications

 ...P&A Industrial, located in Roxboro, NC, is a leading manufacturer of high-quality textile products. The company is committed to providing a safe, respectful, and team-oriented workplace where employees can develop their skills and build lasting careers. As a Weaver, you... 

Harford Gymnastics

Part time gymnastics teacher Job at Harford Gymnastics

Part time gymnastics teacherEducationNecessary to have basic gymnastics knowledge and the ability to relate well with children. A Love...  ...teacher at the Harford Gymnastics Center. We are an established gym facility located in Harford County minutes from Bel Air, MD. Necessary...