Description
The Job in short
The Data Enablement team is here to enable every team in the organisation with their data needs. Our job starts the moment that data enters our platform and ends when it reaches whoever needs it. We are a small, senior team of data and AI engineers, working across customer data, product knowledge, and the data the organisation runs on.
We bring data in, reconcile it into one version people can rely on, and make it available to the right audience. Increasingly that audience is agents as well as people, so everything we build has to work for both. Two things must hold at every step: that only the right people can see it, and that we can prove it is correct. You build the platform that makes both possible.
As a Senior Data Engineer you own the foundation: the lakehouse, the pipelines that fill it, and the layers that serve it. We treat data as a product, so each one has a named owner, a documented contract with the teams who consume it, and stated expectations on freshness and quality. That includes Data as a Service, where internal and external teams run analytics on data held in our AI-powered Banking OS.
This is not only a tabular data job. A large part of it is a versioned documentation corpus, kept current, deduplicated and traceable across many product versions, and much of it arrives semi-structured rather than clean. The consumers are not only dashboards either. You build and maintain the MCP tools that let AI agents query documentation, API specs and release history directly. That is a meaningful part of the role, not a side project.
We hold pipelines to the same standard as application code: tested, reviewed, deployed through CI/CD, observable in production, and promoted properly across environments. If that is already how you think about data engineering, you will recognise this team quickly.
Meet the job
- Develop and maintain pipelines extracting data from many sources: RDBMS, Change Data Capture and streaming endpoints.
- Process data ranging from observability metrics to bank accounts and transactions, in a highly secure and compliant manner.
- Transform raw data into business-ready analytical models on a Data Lakehouse.
- Guard data consistency, quality and end to end governance across the full lifecycle.
- Unstructured data at scale. Ingest and maintain a large versioned documentation corpus: incremental sync, change tracking, deduplication and freshness. Much of it is public or semi-structured source material rather than clean tabular data.
- Agent-facing data tools. Build and maintain MCP tools that let AI agents query documentation, API specs and release history. A meaningful part of this role.
- Pipelines as software. GitHub Actions CI/CD, automated tests, observability and proper environment promotion across Fabric and Databricks. We automate through GitHub, and we expect the same engineering discipline from data pipelines as from application code.
How about you
- A Bachelor's or Master's degree in Computer Science, Data Science or a related field.
- 5+ years of experience in data engineering, preferably Microsoft Fabric, Azure Databricks or Spark. Strong experience on another major cloud is fine if you are ready to convert.
- Expertise in Data Lakehouse concepts and Delta Lake.
- Working knowledge of data regulation and compliance, and the judgement to know when to involve Legal.
- Strong technical leadership. You can drive a piece of work end to end, take the calls with other value streams and stakeholders yourself, and keep it moving without a project manager.
- Excellent written and verbal communication skills in English.
- Proactive, autonomous and self-sufficient. You work independently on your own projects and take the calls with other value streams and stakeholders yourself.
- Python and SQL depth, including pipeline and query performance work.
Strong pluses
- Experience with data contracts and making a platform other teams can self-serve from.
- A BI layer in production, such as Power BI.
- Machine learning fundamentals, enough to work with AI engineers as a peer.
- Retrieval and vector search. Building or maintaining the vector and hybrid search layer that AI products query.
- Preparing data for model training or fine-tuning, including anonymisation of sensitive data.
- Instrumenting retrieval so its quality can be measured by someone else.
Our tech stack
- Languages: Python, SQL.
- Platform: Microsoft Fabric, Azure Databricks, Delta Lake, Azure Blob, Cosmos DB, Azure Key Vault.
- Processing and orchestration: PySpark, Fabric pipelines and notebooks.
- Ops: GitHub Actions, Fabric deployment pipelines, Power BI.
- AI surface: MCP, vector and hybrid search.
Similar jobs
Est. 84,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 84,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Who we are DigiCert is a global leader in intelligent trust. We protect the digital world by ensuring the security, privacy, and authenticity of every interaction. Our AI-powered DigiCert ONE platform unifies PKI, DNS, a…
Who we are DigiCert is a global leader in intelligent trust. We protect the digital world by ensuring the security, privacy, and authenticity of every interaction. Our AI-powered DigiCert ONE platform unifies PKI, DNS, a…
Est. 840,000 SEK
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
The Job in short The Data Enablement team is here to enable every team in the organisation with their data needs. Our job starts the moment that data enters our platform and ends when it reaches whoever needs it. We are…
Est. 120,000 EUR
(REQ ID: CSQ427R209)Databricks is redefining what organisations can achieve with data and AI. As the unified platform powering the world's most ambitious data-driven enterprises, we sit at the intersection of cloud migra…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and…
Est. 165,000 USD
(ID: 2026-1572) Axle is a bioscience and information technology company that offers advancements in translational research, biomedical informatics, and data science applications to research centers and healthcare organiz…
Est. 271,425 USD
Databricks builds the world's leading data and AI platform, used by tens of thousands of organizations to turn raw data into decisions that matter. The Lakeflow Engineering team owns the entirety of the ETL product line:…
GAQ327R175 About the Role This role is a part of the Finance Organisation. As Finance Data Lead on the Finance Data and AI team, you will be the technical authority behind the data pipelines, AI systems, and internal app…
Est. 165,000 USD
P-1388 As a Sr. Manager of the Data & AI Support Engineering team, you will lead and manage a team of Technical Solutions Engineers responsible for driving deep technical resolutions for complex customer issues acros…
CSQ227R215 As a Staff Designated Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialised support and tailored technical solutions for Datab…
Est. 144,000 USD
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
Est. 120,000 GBP
FEQ327R417 The Role As a Sr. Solutions Engineer, you will independently lead technical engagements for customers, owning discovery, solution design, and platform demonstrations. You are a builder who can code, architect,…
Est. 120,000 GBP
REQ ID: FEQ127R254 Location: Hybrid – London As a Senior Forward Deployed Engineering - Architect you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks p…
Est. 120,000 EUR
We are looking for an Engineering Manager or experienced Team Lead with a strong Data Engineering background to lead and scale the teams building our high-reliability, secure, and linearly scalable Data direction. This r…
Est. 120,000 GBP
Alpha Financial Markets Consulting (Alpha) is a leading global consultancy to the financial services industry. We are a boutique management consulting firm that offers the world’s top industry players a competitive edge…
CSQ227R215 As a Senior Designated Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Data…
P-1377 Mission As a Senior ML and AI Technical Solutions Engineer, you play a critical role by helping customers debug and maintain stable GenAI and ML Workloads with AI agent systems using the Databricks Platform. You w…
Est. 124,000 USD
About DevRev At DevRev, we're building the future of work with Computer – your AI teammate. Unlike traditional tools, Computer unifies all your data sources, tools, and workflows into a single AI-ready platform, giving e…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 120,000 GBP
ReqID: FEQ327R328 Recruiter: Kanwal Matharu Location: London, United Kingdom - Hybrid Skills: Data Science, Machine Learning, AI, LLM, GenAI As a Senior Specialist Solutions Engineer (SSE), ML Engineering, you will be th…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…