Description
Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. Deployed by over 85 health plans, including many of the top 20, and representing more than 270 million lives, Machinify brings together a fully configurable and content-rich, AI-powered platform along with best-in-class expertise. We’re constantly reimagining what’s possible in our industry, creating disruptively simple, powerfully clear ways to maximize financial outcomes and drive down healthcare costs.
As a Senior Data Engineer, you’ll be at the heart of transforming raw external data into powerful, trusted datasets that drive payment, product, and operational decisions. You’ll work closely with product managers, data scientists, subject matter experts, engineers, and customer teams to build, scale, and refine production pipelines — ensuring data is accurate, observable, and actionable.
You’ll also play a critical role in onboarding new customers, integrating their raw data into our internal models. Your pipelines will directly power the company’s ML models, dashboards, and core product experiences. If you enjoy owning end-to-end workflows, shaping data standards, and driving impact in a fast-moving environment, this is your opportunity.
What You’ll Do
- Design and implement robust, production-grade pipelines using Python, Spark SQL, and Airflow to process high-volume file-based datasets (CSV, Parquet, JSON).
- Lead efforts to canonicalize raw healthcare data (837 claims, EHR, partner data, flat files) into internal models.
- Own the full lifecycle of core pipelines — from file ingestion to validated, queryable datasets — ensuring high reliability and performance.
- Onboard new customers by integrating their raw data into internal pipelines and canonical models; collaborate with SMEs, Account Managers, and Product to ensure successful implementation and troubleshooting.
- Build resilient, idempotent transformation logic with data quality checks, validation layers, and observability.
- Refactor and scale existing pipelines to meet growing data and business needs.
- Tune Spark jobs and optimize distributed processing performance.
- Implement schema enforcement and versioning aligned with internal data standards.
- Collaborate deeply with Data Analysts, Data Scientists, Product Managers, Engineering, Platform, SMEs, and AMs to ensure pipelines meet evolving business needs.
- Monitor pipeline health, participate in on-call rotations, and proactively debug and resolve production data flow issues.
- Contribute to the evolution of our data platform — driving toward mature patterns in observability, testing, and automation.
- Build and enhance streaming pipelines (Kafka, SQS, or similar) where needed to support near-real-time data needs.
- Help develop and champion internal best practices around pipeline development and data modeling.
What You Bring
- 6+ years of experience as a Data Engineer (or equivalent), building production-grade pipelines.
- Strong expertise in Python, Spark SQL, and Airflow.
- Experience processing large-scale file-based datasets (CSV, Parquet, JSON, etc) in production environments.
- Experience mapping and standardizing raw external data into canonical models.
- Familiarity with AWS (or any cloud), including file storage and distributed compute concepts.
- Experience onboarding new customers and integrating external customer data with non-standard formats.
- Ability to work across teams, manage priorities, and own complex data workflows with minimal supervision.
- Strong written and verbal communication skills — able to explain technical concepts to non-engineering partners.
- Comfortable designing pipelines from scratch and improving existing pipelines.
- Experience working with large-scale or messy datasets (healthcare, financial, logs, etc.).
Similar jobs
Est. 124,000 USD
Vulcan Elements is manufacturing American rare-earth permanent magnets for a secure, resilient future. With a focus on national security and economic resiliency, we serve critical industries such as defense, aerospace, a…
We are a Canadian leader in digital automotive solutions. Our flagship brands -AutoTrader.ca, AutoSync, Dealertrack Canada and CMS - help Canadians buy, sell, and finance vehicles with confidence. AutoTrader.ca is Canada…
Est. 60,000 GBP
THE POSITION Our roster has an opening with your name on it We're looking for a Software Engineer to join one of our Core Marketing Platforms teams, where you'll build and optimize high-performance microservices that pow…
Est. 175,000 USD
Company Introduction We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did I ever live without Coupang?” Born out of an obsession to make shopping, eating, and living…
Est. 115,000 USD
Solutions Analyst Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert…
About the Role At PubMatic, data operates at unmatched scale. As a Senior Machine Learning Platform Engineer, you will design and scale the infrastructure and frameworks that enable machine learning development, experime…
Est. 152,500 USD
About SRS Acquiom SRS Acquiom delivers the smartest way to run a deal™ through a platform and services designed to help deal parties manage complex M&A and loan agency transactions more efficiently. Based in Denver,…
About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional talent, trusted data and intelligence, and world-class partnerships – all united by our pioneering agentic marketing plat…
Est. 165,000 USD
WHO WE ARE Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain cu…
Est. 250,000 USD
We’re looking for a Principal Architect to lead the design and delivery of complex, multi-domain systems spanning cloud, data, and AI. This role is ideal for a deeply experienced engineer who owns the hardest architectur…
Est. 115,000 USD
About Judi Health Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with…
Est. 250,000 USD
We’re looking for a Principal Architect to lead the design and delivery of complex, multi-domain systems spanning cloud, data, and AI. This role is ideal for a deeply experienced engineer who owns the hardest architectur…
About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore…
About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore…
Est. 141,000 USD
Cloud Architect Location: Houston, TX This is a 4 month assignment with potential to extend Houston, local OR be able to travel to Houston, TX to be at customer site every other week for a 4-5days/week Company Overview R…
Est. 140,000 USD
Who We Are Flagship Pioneering is a biotechnology company that invents and builds platform companies that change the world. We bring together the greatest scientific minds with entrepreneurial company builders and assemb…
Est. 124,000 USD
About Judi Health Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with…
Robots & Pencils is seeking an AI Engineer to design, build, and deploy production-grade AI systems that deliver measurable business value. This is a hands-on engineering role focused on implementation and delivery.…
Est. 120,000 USD
Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. Deployed by over 85…
Est. 120,000 USD
The Opportunity We're looking for a Product Manager who is passionate about understanding customer problems, validating opportunities, and leading cross-functional teams to deliver measurable business outcomes. You'll ow…
Est. 125,000 USD
The Opportunity We're looking for a Product Manager who is passionate about understanding customer problems, validating opportunities, and leading cross-functional teams to deliver measurable business outcomes. You'll ow…
Est. 125,000 USD
The Opportunity We're looking for a Product Manager who is passionate about understanding customer problems, validating opportunities, and leading cross-functional teams to deliver measurable business outcomes. You'll ow…
At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.…
Est. 120,000 PLN
Ambition Needs a Place to Grow. At Playtika, we create mobile games enjoyed by millions worldwide. Combining the scale of a public company (NASDAQ: PLTK) with the speed and ownership of a startup, we are a global leader…
Est. 144,000 USD
The Nuclear Company is the fastest growing AI tech-enabled startup in the nuclear and energy space, pioneering a fleet-scale approach to building the next generation of nuclear reactors. Through our design-once, build-ma…
Est. 124,000 USD
About the Company General Matter is enriching uranium in America. Our goal is to design, build, and operate the world’s lowest-cost enrichment services in the United States. Our mission is to restore America’s ability to…
Est. 95,000 USD
Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and economics. At Inovalon, w…
Est. 115,000 USD
THE POSITIONOur roster has an opening with your name on it FanDuel Group is looking to add a Senior Product Analyst to join our Sports Product team. You will be responsible for driving business results and empowering dat…
Est. 120,000 PLN
EBS is a rapidly expanding, entrepreneurial technology company and part of Alarm.com. Alarm.com is the leading cloud-based platform for smart security and the Internet of Things. More than 7.6+ million home and business…
Black Duck Software, Inc. helps organizations build secure, high-quality software, minimizing risks while maximizing speed and productivity. Black Duck, a recognized pioneer in application security, provides SAST, SCA, a…