Description
At Mitratech, we are a team of innovators focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.
For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.
As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!
About the AI Platform Organization
Mitratech’s AI mission is to turn its legal data and products into a unified, safe AI platform that powers the top legal workflows in every core solution and drives meaningful gains in legal team productivity and AI-influenced revenue.
The mandate is not just to ship isolated AI features. The AI organization owns the platform, standards, and integration patterns that make it possible for product teams to ship safe, impactful AI that improves customer outcomes. The organization is designed using Team Topologies: stream-aligned product teams sit at the top, an AI Platform layer sits in the middle, and Cloud & Data Foundation sits below. This role sits in the middle layer and builds the connective tissue that powers AI across Mitratech.
About the Role
This role leads the combined AI Quality & Governance function, initially bringing together two closely related areas: Governance & Policy, and Evaluations & Observability. Over time these may grow into separate teams with separate leaders, but today they are tightly linked in both problem space and execution model.
You will own the platform that makes AI systems at Mitratech measurable, observable, governable, and production ready. The role combines platform engineering, applied AI quality, incident ownership, and practical governance implementation.
This is explicitly a hands-on leadership role. The team begins small — likely one to two direct reports — and you are expected to spend roughly half of your time writing and reviewing production code while the organization scales. Near-term success depends on a leader who wants to build as well as manage.
What You Will Do
- Own the AI evaluations and observability platform — tracing, logs, dashboards, quality signals, and operational feedback loops for prompts, model calls, tool use, and user outcomes
- Design and operationalize automated and human-in-the-loop evaluation strategies, integrating regression checks for quality, safety, latency, and cost into engineering and release processes
- Establish the standards that define production-ready AI across the organization — evaluation criteria, release gates, incident playbooks, and long-term quality metrics
- Build and operate AI guardrails and policy enforcement capabilities: content controls, PII detection and redaction, audit logging, and request- or workflow-level policy checks
- Translate emerging governance and risk expectations into working engineering systems and platform controls rather than static documentation
- Own platform-level SLOs and tier-two incident support for AI behavior issues, partnering with product teams who remain first-line owners for features they ship
- Act as an internal authority on AI quality and governance and participate in customer-facing conversations where product quality, safety, observability, or governance posture must be explained credibly
- Hire, mentor, and grow the team over time — the combined function may later evolve into separate Quality/Observability and Governance/Policy teams
What We Are Looking For
You have 8+ years of software engineering experience including meaningful experience leading engineers as a manager or technical lead. You have shipped production AI systems and have hands-on experience with the operational complexity they introduce.
- Strong experience designing and operating production backend systems and APIs
- Demonstrated hands-on experience building, shipping, or operating production AI systems — ideally including LLM-powered or agentic workflows
- Experience with AI observability, evaluation, or debugging systems — whether through platforms such as LangSmith or LangFuse, or through internally built equivalents
- Practical experience designing or operating AI guardrails: content filtering, redaction, access controls, or other controls around model or agent behavior
- Familiarity with AI governance and risk frameworks such as NIST AI RMF or ISO/IEC 42001, and the ability to engage thoughtfully with legal, compliance, and security stakeholders
- A strong bias toward hands-on execution, platform thinking, and creating paved roads for other teams
Nice to Have
- Experience in legal technology, regulated SaaS, or other environments where auditability and defensibility matter
- Experience with privacy-sensitive systems and PII handling
- Experience participating in AI incident reviews, red-team exercises, or internal review boards for production AI systems
The Stack Context
- Engineering environment primarily uses Python and TypeScript
- Platform operates across AWS and OCI
- Observability tooling is being established — LangFuse experience relevant but not req
Similar jobs
Robots & Pencils is seeking an AI Engineer to design, build, and deploy production-grade AI systems that deliver measurable business value. This is a hands-on engineering role focused on implementation and delivery.…
Here’s a summary of the role: You’ll be a Senior Software Engineer helping shape how AI is built, deployed, and scaled across Diligent’s platform. Working at the intersection of Applied Science, Product, and Engineering,…
Est. 250,000 USD
We’re looking for a Principal Architect to lead the design and delivery of complex, multi-domain systems spanning cloud, data, and AI. This role is ideal for a deeply experienced engineer who owns the hardest architectur…
Est. 250,000 USD
We’re looking for a Principal Architect to lead the design and delivery of complex, multi-domain systems spanning cloud, data, and AI. This role is ideal for a deeply experienced engineer who owns the hardest architectur…
Est. 155,000 USD
The future of aerospace and defense starts here. Ursa Major was founded to revolutionize how America and its allies access and apply high-performance propulsion, from hypersonics to solid rocket motors, satellite maneuve…
APPLICATIONS FROM OUTSIDE COLOMBIA WILL NOT BE CONSIDERED FOR THIS ROLERobots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that int…
Est. 124,000 USD
CentralReach is a leading provider of autism and IDD care software for Applied Behavior Analysis (ABA), multidisciplinary therapy, and special education. Trusted by more than 200,000 users, we enable therapy providers, e…
Netradyne harnesses the power of Computer Vision and Edge Computing to revolutionize the modern-day transportation ecosystem. We are a leader in fleet safety solutions. With growth exceeding 4x year over year, our soluti…
Est. 175,000 USD
Vectra® is the leader in AI-driven threat detection and response for hybrid and multi-cloud enterprises. The Vectra AI Platform delivers integrated signal across public cloud, SaaS, identity, and data center networks in…
Est. 140,000 USD
Who We Are Flagship Pioneering is a biotechnology company that invents and builds platform companies that change the world. We bring together the greatest scientific minds with entrepreneurial company builders and assemb…
Est. 144,000 USD
The Nuclear Company is the fastest growing AI tech-enabled startup in the nuclear and energy space, pioneering a fleet-scale approach to building the next generation of nuclear reactors. Through our design-once, build-ma…
Est. 125,000 USD
Are you ready to make an impact?The Tech Ex Labs Senior Product Owner will define and deliver the roadmap for the firm's portfolio of proprietary software assets and AI capabilities. This role partners with business lead…
Est. 140,000 USD
Who We Are Flagship Pioneering is a biotechnology company that invents and builds platform companies that change the world. We bring together the greatest scientific minds with entrepreneurial company builders and assemb…
Glance AI is an AI commerce platform shaping the next wave of e-commerce with inspiration-led shopping, less about searching for what you want and more about discovering who you could be. Operating in 140 countries, Glan…
Est. 140,000 USD
About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to…
Glance AI is an AI commerce platform shaping the next wave of e-commerce with inspiration-led shopping, less about searching for what you want and more about discovering who you could be. Operating in 140 countries, Glan…
Est. 120,000 GBP
About Baringa Baringa is a global consulting firm that partners with leaders to drive change and create value. With deep industry expertise, and enabled by advanced technology, the firm helps clients to deliver with grea…
OPSWAT, a global leader in IT, OT, and ICS critical infrastructure cybersecurity, delivers an end-to-end platform that gives public and private sector organizations and enterprises the critical advantage needed to protec…
Join us in bringing joy to customer experience. Five9 is a leading provider of cloud contact center software, bringing the power of cloud innovation to customers worldwide. Living our values everyday results in our team-…
At Jamf, we believe in an open, flexible culture based on respect and trust. Our track record and thriving work environment all stem from the freedom we grant ourselves to get the job done right. We take pride in helping…
Est. 120,000 PLN
At Jamf, we believe in an open, flexible culture based on respect and trust. Our track record and thriving work environment all stem from the freedom we grant ourselves to get the job done right. We take pride in helping…
Est. 105,000 USD
At NiCE, we don’t limit our challenges. We challenge our limits. Always. We’re ambitious. We’re game changers. And we play to win. We set the highest standards and execute beyond them. And if you’re like us, we can offer…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…
About JazzX AI: Vision: Enterprises operating on institutional intelligence—governed, self-improving, and scalable beyond individual expertise. JazzX AI is defining the future of enterprise work—by building AI-native dig…
Est. 105,000 USD
At NiCE, we don’t limit our challenges. We challenge our limits. Always. We’re ambitious. We’re game changers. And we play to win. We set the highest standards and execute beyond them. And if you’re like us, we can offer…
Est. 141,000 USD
Cloud Architect Location: Houston, TX This is a 4 month assignment with potential to extend Houston, local OR be able to travel to Houston, TX to be at customer site every other week for a 4-5days/week Company Overview R…
Est. 175,000 USD
Company Introduction We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did I ever live without Coupang?” Born out of an obsession to make shopping, eating, and living…
Est. 165,000 USD
WHO WE ARE Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain cu…
Est. 180,000 USD
About Us SharkNinja is a global product design and technology company, with a diversified portfolio of 5-star rated lifestyle solutions that positively impact people’s lives in homes around the world. Powered by two trus…
Est. 141,000 USD
About Judi Health Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with…