Skip to content
Role Trackr

Senior Software Engineer, Model Evaluation

Clera · Remote · $180K to $250K

$180K to $250K

Found on Clera's Ashby board. Last checked Nov 20.

About the role

ABOUT THE ROLE

Join an early-stage AI company building agents for manufacturing and supply chain operations. In this research-focused engineering role, you will work with procurement and manufacturing experts to create benchmarks, train models, and improve agents used in real operational workflows.

WHAT YOU'LL DO

  • Design benchmarks and evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
  • Work with domain experts to scope tasks, write reference answers and rubrics, and build graders.
  • Train and fine-tune models hands-on, using evaluation results to guide experiments.
  • Identify agent failures, develop improvements, and validate those improvements with measured results.
  • Help establish research and evaluation practices as an early member of the team.

WHAT WE'RE LOOKING FOR

  • At least 3 years of experience, with senior- or staff-level capability.
  • Experience designing and writing benchmarks or evaluations.
  • Experience authoring tasks, including defining scope, creating reference solutions or rubrics, and checking task quality.
  • Hands-on experience training and fine-tuning models, beyond using models through APIs.
  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
  • Supply chain, procurement, manufacturing, or early-stage startup experience is a plus.

COMPENSATION & BENEFITS

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship policy was not provided.

LOCATION

Fully remote in the United States.

Apply on Clera's site, opens in a new tabYou apply on their site and press submit yourself.

Have an account? Track it in Role Trackr (opens in a new tab)

Similar roles from last night.

TeamSnap · Remote
Clera · San Francisco, CA · $225K to $330K
SnapMagic · San Francisco, CA or remote · $160K to $200K
Affirm · Remote · $130K to $180K

More roles like this →