Description
About SingleStore
At SingleStore, we’re not just building a database company, we’re defining the future of data management. Going beyond multi-cloud, we offer customers flexible networking, storage, and compute options to meet their requirements. With a few clicks, our cloud service spins up production grade infrastructure using the latest capabilities of major cloud providers and the industry standard Kubernetes ecosystem.
As data systems evolve, the “database” is no longer just where queries run, it’s becoming the foundation for realtime AI applications: retrieval, reasoning, agent workflows, and intelligent automation over enterprise data. That’s the direction we’re building toward.
About the AI Platform Team
We build the software platform that powers AI native experiences across SingleStore: AI/ML capabilities, agent runtimes, tool integration, and the operational layer required to run these systems reliably at scale. Our work sits at the intersection of distributed systems, cloud infrastructure, and practical applied AI.
This team is not “pure research”, it’s engineering heavy. You’ll build product grade systems that let customers safely and reliably use AI on their data.
Role Summary
We are looking for a Software Engineer to design and implement core platform capabilities for AI/ML and AI Agents in SingleStore Cloud. You’ll work on services that enable model/tool orchestration (e.g. MCP style tool discovery and execution), agent workflows, retrieval pipelines (embeddings/vector search), evaluation/observability, and secure multi tenant operations.
You will likely find yourself using Go and Python, Kubernetes, cloud primitives, and the right tools for the job, while applying solid AI/ML fundamentals to make correct engineering decisions.
Role and Responsibilities
- Build and evolve backend services that power AI features: agent orchestration, tool execution, retrieval/RAG pipelines, and model serving integrations.
- Design APIs and control plane workflows for AI platform components (tenant-aware, secure by default, observable).
- Implement MCP style tool discovery / integration patterns so agents can safely call tools, connectors, and internal services.
- Work closely with product managers, designers, customers, and partner engineering teams to deliver high quality AI experiences.
- Engineer for reliability and scale: latency, cost controls, rate limiting, fallbacks, rollouts, and incident response readiness.
- Establish best practices around evaluation: offline test sets, regression detection, prompt/model/version tracking, and quality gates.
- Contribute to secure AI by design approaches: permissions, data access boundaries, prompt injection defenses, and auditability.
- Mentor junior engineers and contribute to a welcoming, high ownership team environment.
Required Skills and Experience
This is a software engineering role that requires strong fundamentals plus working knowledge of AI/ML concepts.
- Strong software engineering skills with experience in distributed systems (Go, Python, or similar).
- Experience building cloud native services: Kubernetes, containers, service-to-service APIs, CI/CD.
- 4+ years of experience working on a SaaS product or production platform.
- Solid understanding of AI/ML fundamentals (you don’t need to be a researcher, but you should understand concepts well enough to build correct systems):
- Supervised learning basics (training vs inference, overfitting, evaluation metrics, classification, anomaly detection, forecasting, regression etc.)
- LLM basics (tokens, context windows, prompting, tool/function calling concepts)
- Embeddings + vector search fundamentals (similarity, indexing tradeoffs, retrieval pitfalls)
- Strong debugging and problem-solving skills, including incident-style troubleshooting across services and infrastructure.
- Intellectual curiosity about investigating issues that impact product quality, reliability, latency, and business metrics.
- Passion for building robust, maintainable systems in a fast-paced, team-oriented environment.
Nice to Have (Preferred)
- Hands on experience with AI agents and orchestration frameworks (tool calling, workflows, planners/executors).
- Practical experience with RAG systems, reranking, grounding, and evaluation strategies.
- Experience with model serving patterns (batch/online inference, caching, streaming responses).
- Knowledge of security considerations for AI systems (data isolation, RBAC, prompt injection threats, audit logs).
- Familiarity with vector databases or vector capabilities in modern data platforms.
- Experience with observability stacks (structured logging, metrics, tracing) and SLO driven engineering.
Tech Stack
Go, Python, Kubernetes, cloud infrastructure, distributed systems, APIs, and modern AI tooling (LLM providers, embeddings, retrieval systems, eval/observability pipelines), ML tooling.
SingleStore delivers the cloud-native database with the speed and scale to power the world’s data-intensive applications. With a distributed SQL database that introduces simplicity to your data architecture by unifying transactions and analytics, SingleStore empowers digital leaders to deliver exceptional, real-time data experiences to their customers. SingleStore is venture-backed and headquartered in San Francisco with offices in Sunnyvale, Raleigh, Seattle, Boston, London, Lisbon, Bangalore, Dublin and Kyiv.
Consistent with our commitment to diversity & inclusion, we value individuals with the ability to work on diverse teams and with a diverse range of people.
To all recruitment agencies: SingleStore does not accept agency resumes. Please do not forward resumes to SingleStore employees. SingleStore is not responsible for any fees related to unsolicited resumes and will not pay fees to any third-party agency or company that does not have a signed agreement with the Company.
SingleStore values individuals for their unique skills and experiences, and we’re proud to offer roles in a variety of locations across the United States. Salary is based on permissible, non-discriminatory factors such as skills, experience, and geographic location, and is just one part of our total compensation and benefits package. Certain roles are also eligible for additional rewards, including merit increases and annual bonuses.
Req ID: ENG00458
Similar jobs
Est. 168,000 USD
SingleStore is building the real-time data platform powering next-generation AI and enterprise applications. We are looking for a Staff Product Manager to lead key areas of our cloud services platform, helping enterprise…
Est. 237,500 USD
Position Overview This role is a principal-level, hands-on product leadership position in the Product organization. It owns the end-to-end strategy, roadmap, and execution for a cross-cutting portfolio spanning AI text-t…
Est. 177,500 USD
SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture enables high-performance transactional and analytical workloads at scale, an…
SingleStore Software Engineers are at the forefront of real-time technology that’s revolutionizing how companies run their businesses everyday. With release cycles throughout the year, our engineers are accustomed to mov…
Est. 144,000 USD
SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture enables high-performance transactional and analytical workloads at scale, an…
SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture enables high-performance transactional and analytical workloads at scale, an…
Est. 175,000 USD
SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture enables high-performance transactional and analytical workloads at scale, an…
Est. 140,000 USD
SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture enables high-performance transactional and analytical workloads at scale, an…
Est. 65,000 EUR
Position Summary SingleStore engineers build the real-time data platform that enables some of the world's most demanding applications. Our cloud-native database architecture enables high-performance transactional and ana…
Est. 80,000 EUR
SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture enables high-performance transactional and analytical workloads at scale, an…
Senior Account Executive – India Position Overview SingleStore is transforming how modern applications are built and powered by data. Our real-time data platform enables organizations to transact, analyze, and act on dat…
Est. 97,500 USD
Position Overview As SingleStore’s IT Operations Engineer, you will help shape the IT toolset used by our end users. This is an active, hands-on position responsible for the planning, design, development, and Tier 1 supp…
Est. 114,000 USD
Position OverviewOur customers are at the forefront of some of the most interesting data in the world, using SingleStore to push the boundaries every day. To do this well, they leverage the expertise of our Support Engin…
Est. 157,500 USD
Position Overview We are looking for a SingleStore Lead Value Engineer who is passionate about customers’ goals, initiatives and objectives; and how to overcome the most difficult data challenges in the industry. In this…
Est. 160,000 USD
Position Overview SingleStore is seeking a Forward Deployed Engineer (FDE) to operate at the intersection of solution architecture, technical delivery, and customer partnership. This role combines elements of a solutions…
Est. 162,500 USD
SingleStore is looking for a Solutions Engineer who is passionate about removing data bottlenecks for their customers and enabling real-time data capabilities to some of the most difficult data challenges in the industry…
Senior Compliance Specialist Position Description SingleStore is building a real-time data platform that helps organizations transact, analyze and act on data in a single system. We are committed to operating with strong…
Est. 80,000 EUR
Position Overview Solution Engineers (SEs) at SingleStore are solving some of the most cutting-edge technical challenges in today’s data-driven world. When customers evaluate SingleStore, SEs are their trusted technical…
Position Overview The Infrastructure Systems Engineering team is in the midst of building our next-generation private cloud infrastructure as part of a greenfield initiative to in-house existing internal use cases on pub…
Est. 162,500 USD
Position Overview SingleStore is seeking an accomplished sales professional to join our Strategic Sales Team. In this role you will be responsible for closing new business and expanding existing business with large strat…
Est. 147,500 USD
SingleStore is seeking an accomplished sales professional to join our Enterprise Sales Team. In this role, you will be responsible for closing new business and expanding existing relationships with large enterprise custo…
Est. 162,500 USD
Position Overview SingleStore is seeking an accomplished sales professional to join our Strategic Sales Team. In this role you will be responsible for closing new business and expanding existing business with large strat…
HR Generalist – India & APAC About the Role The HR Generalist provides day-to-day HR support for SingleStore employees across India and APAC, acting as a primary point of contact for employees and managers. This role…
Est. 160,000 USD
Position Overview SingleStore is seeking a Forward Deployed Engineer (FDE) to operate at the intersection of solution architecture, technical delivery, and customer partnership. This role combines elements of a solutions…
Interested in future Engineering opportunities with SingleStore? Join our Engineering Talent Community and stay connected with upcoming openings across our Product, Engineering, and Infrastructure teams in the United Sta…
Est. 162,500 USD
Position Overview SingleStore is seeking an accomplished sales professional to join our Strategic Sales Team. In this role you will be responsible for closing new business and expanding existing business with large strat…
Est. 152,500 USD
About the Position: Executive Assistant to C-SuiteThe Executive Assistant to the C-Suite is a trusted strategic partner who helps leadership operate at maximum effectiveness. This role goes beyond traditional administrat…
As Director of Platform Engineering at SingleStore, you will lead the teams and technologies that power the company’s internal engineering platforms, infrastructure services, and developer experience. You will be respons…
Est. 105,000 USD
SingleStore is hiring a Partner Operations Manager to own and optimize operations for our channel and indirect revenue business, supporting our partner and reseller ecosystem. As a critical member of the GTM (Go-To-Marke…
Est. 84,000 USD
SingleStore is hiring a Senior Revenue Operations Analyst to own operations for the top of funnel revenue business, partnering closely with Marketing, Sales/ Business Development, and other cross functional teams (e.g. S…