V4C.ai

Lead Data Engineer, Databricks (Remote, US)

United States remote Senior Salary not listed
remote Senior level Technology & IT Curated
Sign in to apply Free account — we bring you straight back to this role.

Check location eligibility. Remote describes how the work is done; it does not necessarily mean applications are accepted worldwide. Check the location and residency requirements in this listing before applying.

About the role

About V4C
V4C is a pure-play Databricks partner, and in under two years we have earned 850+ Databricks certifications across 325+ customers and been named Databricks' 2026 Partner of the Year (C&SI Emerging).
As a Lead Data Engineer, you will lead the build of production Lakehouse pipelines on customer engagements, working directly with customers and often Databricks' own field teams. Every technical hire here gets a certification roadmap built for them and taught in-house by Databricks-approved trainers, plus a dedicated Employee Success Manager whose only responsibility is your experience at V4C.
The Role
Lead Data Engineers are the technical backbone of V4C delivery. You lead the engineering workstream on an engagement — translating an architecture into working pipelines, setting the patterns the team follows, and owning the quality of what ships. You will work across batch and streaming, on messy enterprise source systems, under real deadlines, and in front of the customer explaining what you built and why. The difference from a Data Engineer is ownership: you are accountable for a workstream and the engineers on it.
Responsibilities

Lead engineering on customer engagements, from design through production handover

Build and optimize batch and streaming pipelines using PySpark, SQL, and Delta Lake on Databricks

Implement Medallion architecture across cloud ecosystems and set the layer conventions the team follows

Own performance and cost: benchmark Spark jobs, tune SQL, right-size compute, and explain the trade-offs to the customer

Implement data quality and validation as code, including Lakeflow expectations and automated testing in CI

Mentor mid-level and junior engineers through code review, pairing, and design feedback

Partner with the Data Architect on design decisions, and escalate when implementation reveals the design will not hold

Requirements

7+ years of data engineering plus experience leading projects or teams

Strong proficiency in Python, SQL, Apache Spark, and Delta Lake

Production experience building both batch and streaming pipelines at enterprise scale

Hands-on experience with AWS, Azure, or GCP and its data services

Experience with data modeling, Git, and CI/CD for data workloads

Demonstrated experience optimizing Spark performance and managing platform cost

Strong client communication skills, including the ability to explain technical trade-offs to a non-technical stakeholder

Preferences

Healthcare or life sciences experience preferred but not required

Existing Databricks Certified Data Engineer Associate or Professional certification

Hands-on experience with Unity Catalog, Lakeflow, or Databricks Asset Bundles

Experience with dbt, Airflow, or equivalent orchestration and transformation tooling

Experience migrating a legacy ETL estate to a modern cloud platform

Consulting or client-facing engineering background

Benefits

Unlimited PTO

Health Care Plan (Medical, Dental & Vision)

Retirement Plan (401k, IRA)

Life Insurance (Basic, Voluntary & AD&D)

Family Leave (Maternity, Paternity)

Short Term & Long Term Disability

Training & Development

Originally posted on Himalayas

Interview prep

Walk in with sharper answers.

Use these suggested prompts to prepare. They are not questions supplied by the employer.

Senior
Technology & IT MySQL Python Remote Collaboration SQL Senior level remote

Practice questions

  1. Tell us about work you have done that is close to the Lead Data Engineer, Databricks (Remote, US) role.
  2. How would you approach your first 30 days at V4C.ai?
  3. Which of MySQL, Python and Remote Collaboration have you used recently, and what did it help you achieve?
  4. How have you led people, improved a process, or made a hard decision in a previous role?
  5. How do you stay organised and communicate clearly when working remotely?

Prepare before the call

  • A recent example that proves your experience with MySQL, Python and Remote Collaboration.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the Lead Data Engineer, Databricks (Remote, US) role at V4C.ai. My relevant experience is [your example], where I [your action] and achieved [your result].

Related jobs.

More roles from this company or category.