Skip to content
Role Trackr

AI Engineer

Mastra · Remote

Found in last night's run on Mastra's Ashby board.

About the role

We’re looking for an AI engineer. You’ll work on features that help developers understand their agents’ behavior, evaluate their performance, and improve them over time.

This is a hands-on engineering role. You’ll move between experiments, benchmarks, and product code, taking what you learn from evaluating agents and using it to shape the framework.

Why:

  • We’re starting to build more and more agentic features into Mastra: Trace intelligence, and we’re working on various Agent Learning features to automatically self-improve agents (Autoevals + Suggestions, Rollouts).
  • In addition, we’ve been increasingly running Mastra primitives like memory on industry-standard benchmarks and using the results to fine-tune configuration.

What you’ll do

Build the features that make this possible: tools for understanding traces, evaluating agent behavior, and turning results into improvements.

Run experiments on Mastra’s primitives, investigate where they perform well and where they fall short, and use those findings to improve their configuration and behavior. You’ll help turn that work into capabilities developers can use in their own applications.

You have:

  • Shipped agents and agentic applications into production
  • Tuned and tweaked them to improve accuracy
  • You need to be able to benchmark your results against existing datasets, or intelligently creating.

ABOUT MASTRA

Mastra is the open-source TypeScript framework for building AI agents. Built by the team behind Gatsby, backed by Y Combinator https://www.ycombinator.com and Spark Capital https://www.sparkcapital.com, with $35M raised total. We went from 0 to 28k+ stars https://github.com/mastra-ai/mastra and 2M+ weekly npm downloads https://npmtrends.com/@mastra/core in less than 2 years.

Small team, shipping fast, fully remote. Most of us work across North American and European time zones.

Apply on Mastra's site, opens in a new tabYou apply on their site and press submit yourself.

Have an account? Track it in Role Trackr (opens in a new tab)

Similar roles from last night.

Plaid · San Francisco, CA or remote · $249K to $368K
I noticed ownership spanned fraud model discovery, deployment, and production monitoring.
Plaid · New York, NY or remote · $249K to $368K
I noticed the role combined fraud research with production machine learning.
Clover Health · Remote · $169K to $220K
I noticed ownership spanned RAG pipelines, agent workflows, and HIPAA safeguards.
Plaid · New York, NY or remote · $229K to $315K
I noticed the role spans fraud research, model deployment, and ongoing production improvement.

More roles like this →