Senior Machine Learning Engineer - Orchestration - Applied AI & LLMs (x/f/m)
Paris, Île-de-France, France · Posted 1 month agoDescription
Set a new pulse for healthcare!
What you'll do
- Define and own the evaluation strategy for our AI agentic system — metrics, protocols, datasets, and tooling
- Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
- Run systematic experiments to assess reasoning, factuality, robustness, and user experience
- Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
- Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices
Life at Doctolib Tech
- Our solutions are built on a single fully cloud-native platform that supports web and mobile app interfaces, multiple languages, and is adapted to country and healthcare specialty requirements.
- Our stack is composed of Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.
- We leverage AI ethically across our products to empower patients and health professionals. Discover our AI vision here.
Who you are
- Hold an MSc or PhD in Computer Science, Machine Learning, Data Science, or a related field
- Have 7+ years of hands-on experience working with large language models (e.g., GPT, Claude, Llama, or BERT-like architectures)
- Have proven experience evaluating agentic or reasoning systems (e.g., autonomous agents, tool-using LLMs, dialogue systems, or task-oriented assistants)
- Have a strong track record in experiment design, metric definition, and evaluation automation
- Are able to bridge research and production, influencing both modeling and product decisions
- Have excellent communication skills, a collaborative mindset, and are fluent in English
- Have experience in the clinical or medical domain and sensitivity to ethical or regulatory challenges in healthcare AI
What we offer
- Free comprehensive health insurance (basic package) for you and your children
- 25 days of paid vacation per year, plus up to 14 days of RTT
- Free mental health and coaching services through our partner Moka.care
- Work from abroad for up to 10 days per year thanks to our flexibility days policy
- Lunch vouchers (Swile card) worth €8.50 per working day, with €4.50 covered by Doctolib
- A subsidy from the work council to refund part of the membership to a sport club or a creative class
- 50% reimbursement of your public transport subscription
- ParentCare Program: Enjoy full salary coverage (100%) during your first month of birth leave, and 75% during the second, covered by Doctolib
- Enrollment in Doctolib's long-term employee value sharing plan called DoctoGrowth
- For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
- Relocation support in case of international mobility
- Access to the best AI tools for coding, development and dedicated training
Our interview process
- Recruiter Interview
- Technical Deep Dive
- Data System Design
- Behavioral Interview
- At least one reference check
Job details
- Permanent position
- Full-time
- Hybrid in our Levallois-Perret office (up to 2 remote days per week)
- Start date: as soon as possible
We welcome everyone
Your data privacy
Similar jobs
Est. 120,000 EUR
Your Impact We are looking for a Senior Machine Learning Engineer to join the ML Engineering team in Patient Solutions. Your mission will be to improve how people access quality care and manage their health over time by…
Est. 80,000 EUR
Your Impact We are looking for a Senior AI Engineer to join the Customer Care Contact team in the Business Performance domain. Your mission will be to build AI-powered tools that revolutionize how healthcare professional…
Est. 90,000 EUR
Set a new pulse for healthcare! We are looking for a Senior Corporate Security Engineer to join the Corporate Security team in SecOps. Your mission will be to secure everything Doctolibers rely on to do their best work i…
Est. 80,000 EUR
We are looking for a Senior DataOps Engineer to join the Data and AI Platform team. Your mission will be to improve and maintain an efficient, reliable and scalable platform that enables Data Product developers and owner…
Est. 80,000 EUR
Your Impact We are looking for a Senior Data Engineer to join the AI Team working on our AI Medical Companion. Your mission will be to build and optimize the data foundations that power safe, scalable, and impactful AI m…
Est. 80,000 EUR
Your Impact We are looking for a Senior Site Reliability Engineer to join the Core Reliability & Observability team in Platform Engineering. Your mission will be to shape Doctolib's observability strategy and ensure…
Est. 80,000 EUR
Your Impact We are looking for a Senior Data Engineer into our engineering team at Doctolib. Your mission will be to build data products that provide insights and support decision-making across Doctolib, helping to trans…
Est. 90,000 EUR
Join our mission, join Doctolib! We are looking for a Senior AI Engineer to join the Patient team in Paris. The Patient domain sits at the heart of Doctolib's mission: ensuring everyone has better access to the care they…
Est. 120,000 EUR
We are looking for an Engineering Manager to join the OREO (Observability Reliability Engineering Obsession) team in Platform Engineering. As an Engineering Manager, your mission will be to lead the Reliability & Obs…
Est. 80,000 EUR
Set a new pulse for healthcare! We are looking for a Staff Machine Learning Engineer - Retrieval to join our AI team working on Clinical decision support and Medical Knowledge. Your mission will be to ground clinical AI…
Est. 90,000 EUR
Your Impact We are looking for a Senior Site Reliability Engineer to join the Core Reliability & Observability team in Platform Engineering. Your mission will be to shape Doctolib's observability strategy and ensure…
Est. 80,000 EUR
Join a team of passionate and hardworking entrepreneurs to transform healthcare! Working in the tech team at Doctolib involves building innovative products and features to improve the daily lives of care teams and patien…
Est. 120,000 EUR
Your Impact We are looking for an Engineering Manager to lead an SRE team dedicated to platform reliability and observability within Platform Engineering. Your mission will be to grow and lead a team of Site Reliability…
Est. 65,000 EUR
Set a new pulse for healthcare! We are looking for a Research Scientist to join the Doctolab team (Doctolib Clinical AI Research Lab). Your mission is to build accurate, well-calibrated, and clinically reliable models of…
Est. 90,000 EUR
Your Impact We are looking for a Staff Site Reliability Engineer to join our SRE team dedicated to platform reliability within Platform Engineering. Your mission will be to act as a technical leader driving Doctolib's re…
Est. 90,000 EUR
Your Impact We are looking for a Senior MLOps Engineer to join the Panda Team (Data & ML Operations) in Data & AI Platform team. Your mission will be to build and maintain secure ML pipelines in production, trans…
Est. 120,000 EUR
What we do Join a team of passionate and hardworking entrepreneurs to transform healthcare! Working in the tech team at Doctolib involves building innovative products and features to improve the daily lives of care teams…
Est. 120,000 EUR
Your Impact We are looking for a Staff DataOps Engineer to join the Data and AI Platform team. Your mission will be to shape our data platform strategy and architecture, driving enterprise-scale solutions that accelerate…
Est. 85,000 EUR
Your Impact We are looking for a Senior Site Reliability Engineer to join our SRE team dedicated to platform reliability within Platform Engineering. Your mission will be to ensure Doctolib's platform remains reliable, s…
Est. 120,000 EUR
We are looking for an Engineering Manager to join the OREO (Observability Reliability Engineering Obsession) team in Platform Engineering. As an Engineering Manager, your mission will be to lead the Reliability & Obs…
Est. 80,000 EUR
What you'll do We are looking for a Staff Mobile Engineer with strong expertise in React Native to join our Patient domain at Doctolib. As a Mobile Staff Engineer, your mission will be to work on transforming the Doctoli…
Est. 120,000 EUR
What you’ll do We are looking for a Senior Staff Machine Learning Engineer to join the Clinical team in the AI and Machine Learning Department. You'll lead the technical direction of AI systems that enhance clinical deci…
Est. 120,000 EUR
Set a new pulse for healthcare! We are looking for an Engineering Manager to join the Scheduling team in Berlin. Your mission will be to give practitioners their day back: reclaiming the admin time they spend creating an…
Est. 120,000 EUR
Your Impact We are looking for a Staff Site Reliability Engineer to join our SRE team dedicated to platform reliability within Platform Engineering. Your mission will be to act as a technical leader driving Doctolib's re…
Est. 90,000 EUR
Your Impact We are looking for a Senior Site Reliability Engineer to join our SRE team dedicated to platform reliability within Platform Engineering. Your mission will be to ensure Doctolib's platform remains reliable, s…
Est. 90,000 EUR
We are looking for a Staff Data Engineer - AI to join the AI team at Doctolib. As a Staff Data Engineer AI, your mission will be to build robust data pipelines - from data capture to monitoring - to power our AI systems…
Est. 70,000 EUR
Join ACAI (Advanced Calendar Improvement), a team dedicated to making day-to-day practice operations more efficient and less mentally exhausting for healthcare professionals and their teams. Practice operations are often…
Est. 61,500 EUR
Your Impact We are looking for a Fullstack Software Engineer to join the PAX (Patient App Experience) team, working at the heart of Doctolib’s patient experience. The team builds and evolves key patient-facing features,…
Est. 120,000 EUR
About the Team The IT Core Finance squad owns and runs the information systems that power Doctolib's Finance function across France, Germany, Italy and the Netherlands: Accounting (GL, AP, AR), Sourcing & Procurement…
Est. 80,000 EUR
We are looking for a Java Software Engineer, with strong experience in Java and Spring Boot, to join Doctolib’s Platform team, ATP. The team builds the backend foundations that power our distributed services. Java and Sp…