Description
Who you are
You are a Databricks-focused Data Engineer who understands that great data platforms are only as valuable as the products, AI workflows, and experiences they enable. You bring deep, production-grade expertise across the Databricks platform and know how to connect platform capabilities to real business outcomes.
You thrive in ambiguity and can quickly assess a client's data landscape to recommend and implement the right solutions. You understand that in consulting, your Databricks depth is most valuable when it connects platform capabilities to the products and experiences clients actually use — and you're as comfortable in a product design conversation as you are building a DLT pipeline.
You excel at translating complex data challenges into clear technical requirements and can confidently navigate conversations with everyone from data scientists to executives. Your engineering principles are mature and grounded in real-world experience across various industries and scales.
You have an interest in and a curiosity about data platforms and the latest advances in data technology.
What you will be doing
- Design and build production data pipelines using Lakeflow Declarative Pipelines, Autoloader, and Structured Streaming, with end-to-end ownership of ingestion, transformation, data quality expectations, and CI/CD deployment via Declarative Automation Bundles.
- Architect and implement Lakehouse solutions on Databricks — medallion architecture, Delta Lake, Unity Catalog — tailored to the client's analytics, AI, and application needs.
- Build and maintain Databricks transformation layers — DLT pipelines, PySpark notebooks, and dbt — with data quality constraints and SLAs baked in.
- Design and maintain the data and AI foundations — Unity Catalog, Feature Store, MLflow, and Model Serving — that power production ML, agent workflows, and AI-enabled digital products.
- Collaborate with product and backend engineers to design data models, APIs, and application data contracts — ensuring the platform serves the product, not just the warehouse.
- Consult with clients to understand their data challenges, develop data strategies, and implement sustainable solutions.
- Adapt your approach based on project needs — sometimes leading data architecture discussions with clients, other times supporting internal teams with specialized data expertise.
- Work within multi-cloud environments — primarily AWS and Azure — anchoring data platform recommendations around Databricks where it fits the client's architecture and goals.
- Champion data governance through Unity Catalog — access control, lineage, data quality policies, and compliance — as a first-class part of every engagement, not an afterthought.
- Design data-to-application architectures — including Lakebase-backed services and Databricks Apps — that connect governed data to AI workflows, digital products, and user-facing experiences.
- Help build Livefront's Databricks practice — contributing to accelerators, internal enablement, certification goals, and Databricks partner go-to-market materials alongside delivery work.
Why you should apply
- You want to work with passionate and talented people who are always looking for ways to make things better.
- You desire a work environment where respect, mutual trust, and egoless collaboration are paramount.
- You want colleagues who take their work seriously but not themselves, and who know how to let loose and have a good time.
- You like being part of a team with a reputation for excellence that gives back to the community by educating, mentoring, and sponsoring.
- You want to work on products and accounts that have outsized impact and reach.
- You believe in sweating the details, giving a damn about quality, and taking pride in going the extra mile.
- You want to help build a data practice specialization from the ground up — shaping how we go to market with Databricks, what we build as accelerators, and what it means to do this kind of work at a digital product company.
What you bring to the table
- 3-5 years of data engineering experience with at least 2 years in production Databricks environments, preferably in a consulting or client delivery context.
- Solid working knowledge of AWS and Azure cloud services relevant to Databricks deployments — storage, networking, IAM, and compute — with GCP familiarity a plus.
- Deep, production-grade Databricks expertise: Lakeflow Declarative Pipelines, Autoloader, Structured Streaming, Lakeflow Jobs, Unity Catalog (including fine-grained access control and lineage) — demonstrated through shipped production workloads, not prototypes.
- Proven experience designing Lakehouse architectures — medallion patterns, Delta Lake table design, partitioning, Z-ordering, and query optimization — at production scale.
- Hands-on experience with data pipeline testing, observability, and CI/CD for data — including unit testing, data quality frameworks, and version-controlled deployments via Git and Declarative Automation Bundles.
- Strong proficiency in SQL and Python, with the ability to write clean, performant, and maintainable code.
- Understanding of data modeling, schema design, and query optimization.
- Excellent communication skills with the ability to explain complex data concepts to both technical and non-technical stakeholders.
- Strong problem-solving skills with the ability to navigate ambiguous requirements and deliver pragmatic solutions.
- Above-average discipline and personal organization skills.
- Obvious comfort with critique and peer review in the context of an iterative development process.
- A demonstrated hunger for personal and professional growth.
- A self-evident love and care for the craft of data engineering.
Bonus points if you…
- Have worked with real-time streaming technologies (Kafka, Kinesis, etc.).
- Have hands-on experience with alternative cloud data platforms — useful context for migrations and competitive assessments, though Databricks is our primary platform focus.
- Have experience in healthcare or fintech domains.
- Have hands-on experience with MLOps or LLMOps on Databricks — MLflow experiment tracking, model registry, Model Serving endpoints, or Vector Search for RAG pipelines.
- Have experience with Java, Go, or Scala.
- Have strong illustration skills for technical diagramming and data architecture documentation.
- Speak, write, and/or educate publicly about data engineering topics.
- Have contributed to open-source data projects.
- Hold or are actively pursuing a Databricks certification (Data Engineer Associate or Professional, or Apache Spark Developer) — we treat these as meaningful signals of platform depth, and they directly support our Databricks partner growth goals.
- Have experience with Databricks Apps, or Lakebase — early familiarity with where the Databricks platform is heading is a strong differentiator.
What to expect
Additional information
Similar jobs
Est. 132,500 USD
At Livefront, we help companies design and build world-class digital products that command attention and inspire joy. We’ve helped household names like CVS, Samsung, General Mills, and Optum create experiences that have…
Who we are DigiCert is a global leader in intelligent trust. We protect the digital world by ensuring the security, privacy, and authenticity of every interaction. Our AI-powered DigiCert ONE platform unifies PKI, DNS, a…
Est. 120,000 EUR
(REQ ID: CSQ427R209)Databricks is redefining what organisations can achieve with data and AI. As the unified platform powering the world's most ambitious data-driven enterprises, we sit at the intersection of cloud migra…
Est. 120,000 GBP
Requisition # CSQ327R269 As a Forward Deployed Engineer Architect you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the archit…
Est. 271,425 USD
Databricks builds the world's leading data and AI platform, used by tens of thousands of organizations to turn raw data into decisions that matter. The Lakeflow Engineering team owns the entirety of the ETL product line:…
Est. 120,000 GBP
REQ ID: FEQ127R254 Location: Hybrid – London As a Senior Forward Deployed Engineering - Architect you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks p…
Est. 180,875 USD
FEQ427R216At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and ana…
P-1577 As a Sr. Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead desig…
Req ID: CSQ327R52Location: Tokyo, Japan As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own…
Req ID: CSQ427R97Location: Tokyo, Japan Mission We are FDEs! The Forward Deployed Engineering team is a highly specialized, customer-facing unit within Databricks. We work with strategic customers to design, build, and p…
Est. 120,000 GBP
P-1514 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. W…
Est. 120,000 EUR
CSQ327R45 As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design…
Est. 90,000 GBP
The Role As a Sr. Solutions Engineer, you will independently lead technical engagements for customers, owning discovery, solution design, and platform demonstrations. You are a builder who can code, architect, and presen…
Est. 120,000 EUR
CSQ427R34 As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design…
Est. 165,000 USD
P-1388 As a Sr. Manager of the Data & AI Support Engineering team, you will lead and manage a team of Technical Solutions Engineers responsible for driving deep technical resolutions for complex customer issues acros…
P-375 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We…
Est. 120,000 GBP
FEQ327R417 The Role As a Sr. Solutions Engineer, you will independently lead technical engagements for customers, owning discovery, solution design, and platform demonstrations. You are a builder who can code, architect,…
Est. 120,000 GBP
CSQ327R39 As a Forward Deployed Engineer (FDE) for the Emerging Enterprise & Digital Natives business in EMEA. you will work with customers to build and productionize solutions to their data & AI challenges using…
Est. 120,000 GBP
Req ID: CSQ127R149 Location: London, United Kingdom - Hybrid Job Role: Senior Forward Deployed Engineer - Senior Architect level Recruiter: Dina Hussain We’re hiring for multiple roles within our FDE team. As a Forward D…
CSQ427R228 As a Senior Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lea…
Est. 251,550 USD
CSQ227R53 Databricks is redefining what organisations can achieve with data and AI. As the unified platform powering the world's most ambitious data-driven enterprises, we sit at the intersection of cloud migrations, AI…
P-1403 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. W…
Est. 221,000 USD
At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do th…
Est. 120,000 GBP
P-1584 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. W…
Est. 90,000 GBP
REQ ID: FEQ427R344 Location: London, UK Recruiter: Kanwal Matharu At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to creat…
Est. 120,000 EUR
CSQ427R35 As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design…
Est. 80,000 EUR
CSQ427R154 As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead desig…
Est. 226,000 USD
P-925 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We…
Est. 251,550 USD
PLEASE NOTE: Due to federal contract requirements and client site access obligations, an active U.S. government security clearance is required. The position is based in the Washington, D.C., Maryland, or Virginia metropo…
Est. 260,200 USD
FEQ227R233While candidates in the listed location(s) are encouraged for this role, candidates in other locations will be considered.At Databricks, our core principles are at the heart of everything we do; creating a cult…