Description
About ALX Africa
ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent journey to provide world-class tech skills training and career acceleration programmes. Our mission is to bridge the digital divide, upskill and re-skill talent, and create a generation of innovative leaders. By 2030, we aim to empower 2 million Africans to secure sustainable tech careers.
With hubs in 8 cities across Africa and counting, we provide safe access to quality learning and a dedicated network of expert instructors. Our innovative programmes equip learners with the practical skills and knowledge needed to succeed in today's rapidly evolving tech industry. Through a combination of rigorous coursework, industry partnerships, and hands-on projects, we prepare our students for in-demand roles in software engineering, data science, and cybersecurity.
We achieve this by:
- Providing young professionals with access to the most in-demand tech skills that will power the future.
- Empowering the next generation of technology innovators, entrepreneurs, and business leaders through challenging, real-world coursework.
- Building a lifelong, impactful community of tech professionals that support them at all stages of their career journey.
Our impact thus far:
- 347k+ graduates since 2020
- 257k youth in work
- 31k youth starting own ventures
- 60k youth in jobs created by entrepreneurs
Visit our website www.alxafrica.com to learn more about our digital revolution.
Role Summary
Project A is ALX’s AI learning platform — a set of LLM products used by learners. Every one generates a stream of LLM data, and every one has hypotheses baked into it about what “working” means. The LLMOps Engineer owns the analyzer function: turning that stream into an honest answer about whether the products work. Take RAG as one example — documents must be stored accurately, fetched accurately, and fetched in the right mixture: three separate failure modes, each needing its own eval. Every product decomposes like that. This is a junior-to-mid role with a deliberate growth path: you start close to the technical lead’s designs and grow into full ownership of the function.
You will work in collaboration with Anthropic Engineers, a cross functional team of AI engineers, product managers and data scientists to design world class learning experiences.
Specific Responsibilities
Evaluation Suites
- Build and run eval suites per product, decomposed by failure mode, running on schedule and on every release — regression testing so nothing ships if it broke what worked.
- Keep evals cost-effective as the product line grows.
Reporting, Data & Collaboration
- Own the reporting loop — findings from evals and platform data in front of the team and stakeholders, including surfacing unintended or problematic model behaviour before learners do.
- Steward the core datasets the team depends on, including classified customer-support data.
- Partner with the AI Product Manager on instrumentation — they instrument the product, you build the evals over what is captured. This is a measurement role, not infrastructure — no model hosting or serving.
Skill Requirements - Essential
- Python & data: solid Python and a data inclination, comfortable shaping and analysing messy LLM-generated data.
- Decomposition: the ability to look at an AI product and decompose it into success and failure metrics.
- Eval landscape: familiarity with Langfuse, RAGAS, DSPy, or similar — depth in one, awareness of the rest. These tools are learnable; we hire the fundamentals underneath them.
- Desirable (not required): experience keeping evals cheap at scale; dashboarding and reporting; classical statistics.
Essential Traits for Success
- You want to own a function, not execute tickets.
- You communicate well and like collaborating, you will support every builder on the team.
- You can point to any project, even a small one, where you measured an AI system honestly.
Person Specification/Attributes
- Courage: Willingness to speak up, challenge the status quo, and embrace new challenges.
- Humility: Openness to learning, seeking help when needed, and a focus on serving others.
- Adventure: A passion for setting ambitious goals, tackling difficult tasks, and finding joy in the journey.
- Initiative: Proactive problem-solving, a sense of ownership, and a willingness to go above and beyond.
- Resilience: The ability to bounce back from setbacks, persevere through challenges, and emerge stronger.
Employment Type
This role is a full-time position.
Preferred Time Zones
The preferred time zones are GMT+2.
Due to the considerable amount of virtual working and interaction with colleagues and customers in different physical locations internationally, it is essential that the successful applicant has the drive and ethic to succeed working in small teams physically but in larger efforts virtually. Self-drive to communicate constantly using web collaboration and video conferencing is essential. As an employee, you will be encouraged to continually develop your capability & attain certifications to reflect your growth as an individual.
Similar jobs
About ALX Africa ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent j…
About ALX Africa ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent j…
About ALX Africa ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent j…
Do you love transforming ideas into learning experiences that spark curiosity and change? Are you fluent in the language of design thinking, storytelling, and education technology? Do you find joy in crafting content tha…
Do you thrive at the intersection of creativity, systems thinking, and education? Have you led teams that turn abstract ideas into powerful, learner-centred programs? Are you skilled at translating complex industry insig…
Est. 40,000 USD
Do you love turning data into clear answers that move a business forward? Are you fluent in SQL and Python, and do you take pride in building dashboards and reports that people actually use to make decisions? Do you have…
Do you have experience supporting community programmes, events, or engagement initiatives that drive meaningful participation? Are you highly organised and able to manage multiple activities with strong follow-through? A…
Are you a rigorous impact leader who can build trusted evidence systems at scale? Do you know how to combine world-class evaluation methods with the speed and pragmatism of a high-growth organization? Are you equally com…
About ALX Africa ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent j…
Do you have a passion for identifying and attracting top talent while shaping the future of hiring processes? Are you skilled at building relationships with hiring partners, including communities, agencies, and talent gr…
About ALX Africa ALX Africa, a non-profit organisation under the ALX Foundation, is dedicated to unlocking the potential of Africa's digital future. Formerly part of Sand Tech Holdings, we've embarked on an independent j…
Are you a qualified finance professional with a strong foundation in financial control, reporting, and governance? Do you thrive in fast-paced, multi-entity environments where accuracy, compliance, and continuous improve…
Est. 285,000 USD
At AlixPartners, we solve the most complex and critical challenges by moving quickly from analysis to action when it really matters; creating value that has a lasting impact on companies, their people, and the communitie…
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
Est. 235,000 USD
At AlixPartners, we solve the most complex and critical challenges by moving quickly from analysis to action when it really matters; creating value that has a lasting impact on companies, their people, and the communitie…
At AlixPartners, we solve the most complex and critical challenges by moving quickly from analysis to action when it really matters; creating value that has a lasting impact on companies, their people, and the communitie…
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
Est. 120,000 EUR
N-iX is a global software development company founded in 2002, connecting over 2,400+ tech professionals across 40+ countries. We deliver innovative technology solutions in cloud computing, data analytics, AI, embedded s…
We fuse together exceptional talent who deliver outstanding software solutions. Our approach has helped us grow 60% in 2021, 94% in 2022, while in 2023 we joined forces with Insight, a Fortune 500 company and a leading s…
Est. 124,000 USD
Company Description Air is the leader in Enterprise Readiness. Our mission is to establish readiness as a real-time condition that is continuously achieved. Today, a dangerous Readiness Gap exists between what the front…
At AlixPartners, we tackle complex challenges by transforming insights into innovative solutions, delivering lasting value for businesses, their people, and the communities they serve. Our products are designed to drive…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
About AlphaSense: The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter f…
About AlphaSense: The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter f…
At AlixPartners, we solve the most complex and critical challenges by moving quickly from analysis to action when it really matters; creating value that has a lasting impact on companies, their people, and the communitie…
We are looking for a highly skilled AI Engineer specializing in Large Language Models (LLMs) and Agentic AI. You will architect, build, and deploy production-grade LLM applications — from intelligent knowledge bases and…
Est. 80,000 GBP
About us Appnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as fou…
OPSWAT, a global leader in IT, OT, and ICS critical infrastructure cybersecurity, delivers an end-to-end platform that gives public and private sector organizations and enterprises the critical advantage needed to protec…