Cantina Labs

Machine Learning Engineer, Core Evaluations

Europe, United States full-time Mid Salary not listed
full-time Mid level Technology & IT Curated
Sign in to apply Free account — we bring you straight back to this role.

About the role

About Cantina:

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

About the Role:

We are seeking an experienced Machine Learning Engineer (MLE) to focus on audio model evaluation, specifically for speech generation and recognition models.

This role involves designing and developing comprehensive model evaluation pipelines for both development and production environments, as well as creating automated dashboards for reporting evaluation results.

As the founding member of our evaluation team, the ideal candidate is expected to leverage their experience to lead our evaluation efforts and play a key role in the future growth of the evaluation team.

What You’ll Do:

Designing model evaluation pipelines for models in development and production

Designing user studies for subjective model evaluations.

Converting requirements into measurable metrics.

Designing and developing automated evaluation dashboard to see model performances and compare results.

Training new models to capture new and different evaluation metrics.

Communicating with the model team to help design better models based on the evaluation results.

Communicating with the data team to help decide the type of data necessary to improve model performance.

Communication with the product-manager to make sure product requirements are correctly measured.

Help grow the evaluation team as the founding member.

Lead the evaluation team in the future.

What You’ll Bring:

Strong experience and intuition for designing metrics that capture model performance.

Strong experience with designing user studies on Mechanical Turk or similar platforms. .

Strong experience with model training and fine-tuning for model evaluation.

Strong statistical knowledge and experience to statistically compare evaluation results and take decisions.

Very strong engineering and programming skills.

Experience with training ASR, TTS models.

Experience at ML teams working on large-scale machine learning problems. (>3B models with >1m hours of data)

Compensation:

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles:

Competitive salary and generous company equity

Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina

42 days of paid time off, including:

15 PTO days

10 sick days

15 company holidays

2 floating holidays

Generous parental leave & fertility support

401(k) retirement savings plan

Lifestyle spending account – $500/month to use however you’d like

Complimentary lunch and snacks for in-office employees

One Medical membership, and more!

Interview prep

Walk in with sharper answers.

Use these suggested prompts to prepare. They are not questions supplied by the employer.

Mid
Technology & IT Data Analysis Mid level full-time

Practice questions

  1. Tell us about work you have done that is close to the Machine Learning Engineer, Core Evaluations role.
  2. How would you approach your first 30 days at Cantina Labs?
  3. Which of Data Analysis have you used recently, and what did it help you achieve?
  4. Describe a time you solved a problem without waiting to be told exactly what to do.
  5. How do you handle busy days, changing priorities, or pressure at work?

Prepare before the call

  • A recent example that proves your experience with Data Analysis.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the Machine Learning Engineer, Core Evaluations role at Cantina Labs. My relevant experience is [your example], where I [your action] and achieved [your result].

Related jobs.

More roles from this company or category.