Description
The Joblogic Story
Established in 1998, Joblogic is the UK’s #1 Field Service Management (FSM) software platform. We are a global business with offices in the UK, Pakistan, and Vietnam. Since our management buy-out in 2013, we have grown from ~£500K ARR to ~£35M+ ARR and expanded our team from 11 to 500+ people.
Recently, we secured a strategic growth investment from Vista Equity Partners — a global technology investor specialising in enterprise software. This investment includes over £100 million in new primary capital and will fuel our next phase of growth by accelerating our AI-first roadmap, expanding our platform into CAFM (Computer-Aided Facilities Management) capabilities, and supporting our expansion across Europe and beyond.
With Vista’s backing, we’re transforming from a successful UK business into a global scaling SaaS rocket ship, and we’d love for you to join us on our journey to £100M ARR across international markets.
Joblogic provides software to service contractors who install and maintain the built environment. Our platform helps businesses streamline operations, improve profitability, ensure compliance, and achieve rapid growth. With over 100,000 users across industries including HVAC, plumbing, electrical maintenance, facilities management, and building fabric maintenance, we are entering a new era of intelligent automation, predictive maintenance, and data-driven decision-making for service firms.
About the Role
We are building Joblogic’s AI Agent Platform — a multi-tenant system for designing, versioning, evaluating, and running AI agents that work across email, voice, SMS, WhatsApp, and CRM channels on behalf of our customers. The platform is built on a LangGraph runtime with a full agent lifecycle: a prompt-driven agent builder, a tool and knowledge-base registry, human-in-the-loop review, an agent memory subsystem, and a rigorous evaluation harness backed by LangSmith and PromptFoo.
We are looking for a mid-level AI/ML Engineer to help us design, build, and continuously improve these agents. In this role you will own agent behaviour end to end — crafting and engineering prompts, wiring up tools and retrieval, and, most importantly, building the evaluations and datasets that prove an agent is doing the right thing before and after it ships. You will also bring applied machine learning depth: working with our execution and conversation data, building models and analyses that make agents smarter, and using platforms such as Databricks or AWS SageMaker to train, track, and serve them.
You will work closely with product, backend, and platform engineers, and your work will directly shape how tens of thousands of field-service businesses experience intelligent automation.
What You’ll Do
- Build and improve AI agents — design agent behaviour on our LangGraph runtime, configure abilities, attach tools and knowledge bases, and take agents from draft through evaluation to production deployment.
- Prompt engineering — author, version, and systematically improve system prompts (managed via our LangSmith prompt registry), applying techniques such as few-shot examples, structured output, tool-use guidance, and context management to get reliable behaviour from LLMs.
- Design and run evaluations — build datasets, author heuristic and LLM-judge rubrics, run offline evaluations and online scoring against live executions, set pass/fail thresholds, and track quality and regression/drift over time. This is central to the role.
- Retrieval & knowledge (RAG) — build and tune retrieval-augmented generation over our knowledge bases — chunking, embeddings, and hybrid/vector search — to keep agent answers grounded and faithful.
- Tools & integrations — develop and integrate the tools agents call (HTTP, MCP, and recipe/workflow tools), extending what agents can do across our own and third-party systems.
- Data analysis — analyse execution traces, conversation transcripts, and outcome data to find failure modes, quantify quality, and drive prioritised improvements.
- Applied ML — build, train, evaluate, and deploy machine learning models (e.g. classification, extraction, ranking, forecasting) that support agent behaviour and the wider AI-first roadmap, including predictive maintenance and data-driven decisioning.
- MLOps — use platforms such as Databricks or AWS SageMaker for feature engineering, experiment tracking, model training, and serving, with reproducible pipelines.
- Observability & quality — use tracing and monitoring (LangSmith, Application Insights) to debug agent runs in production and close the loop from live behaviour back into datasets and prompts.
- Collaborate & ship — work in a cross-functional team using tools such as Jira and Slack, write clear documentation, and ship iteratively with a strong quality bar.
Essential Experience and Skills
- Strong Python engineering skills, with experience building production services and clean, well-tested code.
- Hands-on experience building LLM-powered applications or AI agents — for example with LangChain / LangGraph, the OpenAI / Anthropic APIs, or comparable frameworks — including tool/function calling and agentic (ReAct-style) loops.
- Demonstrable prompt engineering skill: designing, iterating on, and versioning prompts, and understanding how to steer and constrain model behaviour reliably.
- Practical experience with LLM evaluation: building datasets, defining rubrics/metrics (heuristic and LLM-as-judge), running evals, and interpreting results to improve a system. This is a core requirement.
- A solid machine learning foundation: framing problems, feature engineering, training and evaluating models, and understanding metrics, validation, and overfitting — with hands-on use of libraries such as scikit-learn, PyTorch, or TensorFlow.
- Hands-on experience with a modern ML platform — Databricks or AWS SageMaker (or equivalent, e.g. Azure ML / Vertex AI) — for training, experiment tracking, and model deployment.
- Strong data analysis skills using Pandas, NumPy, and SQL to explore data, quantify behaviour, and communicate findings.
- Understanding of retrieval-augmented generation (RAG): embeddings, vector/hybrid search, chunking, and grounding/faithfulness.
- Experience working with APIs, JSON schemas, and integrating third-party services from Python.
- Familiarity with both SQL and NoSQL databases.
- Committed to continuous learning, proactive problem-solving, and timely issue identification, with a keen interest in staying current with a fast-moving field.
- Strong communicator, experienced in collaborating with cross-functional teams using tools such as Jira and Slack.
- Creative and innovative thinker, consistently contributing fresh ideas and solutions in alignment with current technological trends.
Nice to Have<
Similar jobs
Est. 141,000 USD
At Zone 5 Technologies, we're redefining what's possible in unmanned aircraft systems. Our team of engineers and innovators is developing cutting-edge autonomous solutions that push the boundaries of UAS technology - sol…
APPLICATIONS FROM OUTSIDE COLOMBIA WILL NOT BE CONSIDERED FOR THIS ROLERobots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that int…
Est. 140,000 USD
Who We Are Flagship Pioneering is a biotechnology company that invents and builds platform companies that change the world. We bring together the greatest scientific minds with entrepreneurial company builders and assemb…
Est. 124,000 USD
Are you ready to make an impact?West Monroe is seeking a Software Engineer to join the AI Assets Foundry Team, working with the internal Labs product team to develop proprietary software assets and AI capabilities that h…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…
Est. 124,000 USD
CentralReach is a leading provider of autism and IDD care software for Applied Behavior Analysis (ABA), multidisciplinary therapy, and special education. Trusted by more than 200,000 users, we enable therapy providers, e…
Est. 120,000 PLN
Ambition Needs a Place to Grow. At Playtika, we create mobile games enjoyed by millions worldwide. Combining the scale of a public company (NASDAQ: PLTK) with the speed and ownership of a startup, we are a global leader…
Here’s a summary of the role: You’ll be a Senior Software Engineer helping shape how AI is built, deployed, and scaled across Diligent’s platform. Working at the intersection of Applied Science, Product, and Engineering,…
Who is Quantium? Quantium is a world leader in data science and artificial intelligence. Established in Australia in 2002, Quantium is a global team of more than 1,200 people across 14 locations with a unique blend of ca…
Est. 144,000 USD
Toshiba Global Commerce Solutions is seeking a hands-on Lead Software Engineer to drive end-to-end solution delivery for major retail platforms. In this role, you will own hands-on implementation (feature development, te…
Est. 120,000 PLN
EBS is a rapidly expanding, entrepreneurial technology company and part of Alarm.com. Alarm.com is the leading cloud-based platform for smart security and the Internet of Things. More than 7.6+ million home and business…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…
Join us in bringing joy to customer experience. Five9 is a leading provider of cloud contact center software, bringing the power of cloud innovation to customers worldwide. Living our values everyday results in our team-…
Est. 60,000 GBP
THE POSITION Our roster has an opening with your name on it We're looking for a Software Engineer to join one of our Core Marketing Platforms teams, where you'll build and optimize high-performance microservices that pow…
Join us in bringing joy to customer experience. Five9 is a leading provider of cloud contact center software, bringing the power of cloud innovation to customers worldwide. Living our values everyday results in our team-…
Est. 125,000 USD
LA28 does not provide relocation assistance. LA28 is the independent, non-profit, privately funded organizing committee for the Los Angeles 2028 Olympic and Paralympic Games. We are on a singular mission to create an Oly…
Est. 144,000 USD
Are you ready to make an impact?Senior AI Software Engineer – Technology & Experience (TechEx) West Monroe is seeking a Senior AI Software Engineer to join our Technology & Experience (TechEx) practice. This is a…
Est. 120,000 GBP
About Baringa Baringa is a global consulting firm that partners with leaders to drive change and create value. With deep industry expertise, and enabled by advanced technology, the firm helps clients to deliver with grea…
Est. 175,000 USD
About SHEIN SHEIN is a global online fashion and lifestyle retailer, offering SHEIN branded apparel and products from a global network of vendors, all at affordable prices. Headquartered in Singapore, with more than 15,0…
Why Valtech? We’re the experience innovation company - a trusted partner to the world’s most recognized brands. To our people we offer growth opportunities, a values-driven culture, international careers and the chance t…
Est. 144,000 USD
Are you ready to make an impact?West Monroe is seeking a Senior Software Engineer to join the Tech Ex AI Assets Foundry Team, working with the internal Labs product team to develop proprietary software assets and AI capa…
About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore…
Why Valtech? We’re the experience innovation company - a trusted partner to the world’s most recognized brands. To our people we offer growth opportunities, a values-driven culture, international careers and the chance t…
Est. 124,000 USD
The Trade Desk is a global technology company and the world’s leading independent platform for digital advertising, with nearly 4,000 employees across more than 30 offices. Our technology helps advertisers reach the righ…
ABOUT ROCKET LAB Rocket Lab is the end-to-end space company building rockets, spacecraft, and critical subsystems that keep the world connected, protected, expand humanity’s reach to the Moon, Mars, and beyond. We move f…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…
Est. 141,000 USD
About Judi Health Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with…
Est. 105,000 USD
At NiCE, we don’t limit our challenges. We challenge our limits. Always. We’re ambitious. We’re game changers. And we play to win. We set the highest standards and execute beyond them. And if you’re like us, we can offer…
Est. 250,000 USD
We’re looking for a Principal Architect to lead the design and delivery of complex, multi-domain systems spanning cloud, data, and AI. This role is ideal for a deeply experienced engineer who owns the hardest architectur…
Robots & Pencils is seeking an AI Engineer to design, build, and deploy production-grade AI systems that deliver measurable business value. This is a hands-on engineering role focused on implementation and delivery.…