inhousefyi
← Back to listings

Staff AI Product Engineer

NscaleHouston, Texas, United States · Posted 15 days ago
Full-timeEst. 256,667 USD
Apply now

Description

About Nscale

Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centers, software, and applications that power today’s AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As a Nscaler, you’ll build trust through openness and transparency, where everyone is inspired to do their best work. Collaboration is key, and we work together swiftly and respectfully, embracing adaptability and resilience in all we do.

About the Role

Nscale is looking for a Staff AI Product Engineer to drive technical direction across the AI product domain. Working across 2–4 teams, you’ll set architectural standards, resolve complex cross-cutting concerns, and create engineering leverage that accelerates the entire product organization.

As a Staff engineer, you define how Nscale’s AI services platform is built — establishing the patterns, APIs, and systems that other engineers rely on to deliver reliably and at speed. Your scope spans the full platform layer: AI service capabilities, API gateway, developer experience, billing, identity, and the extensibility surfaces that enterprise and developer customers build on. Your decisions will have meaningful, lasting impact on platform scalability, developer experience, and product velocity.

Responsibilities

  • Set technical direction for the AI product platform domain across multiple teams
  • Drive cross-team architectural decisions: service boundaries, API contracts, data models, and platform standards
  • Identify and lead systemic improvements — performance, reliability, cost, or developer experience — that create leverage across the organization
  • Resolve ambiguous, open-ended technical problems where the solution space is genuinely undefined
  • Coach and grow Senior AI Product Engineers across teams; raise technical capability broadly
  • Partner with product leadership and engineering managers to align technical strategy with business direction
  • Evaluate build-vs-buy decisions for key platform capabilities and drive them to clear conclusions
  • Represent the product engineering domain in cross-functional architecture reviews

Requirements

  • 8–12 years of software engineering experience
  • Proven ability to set technical direction for a product domain, including cross-team architectural patterns
  • Deep expertise in API design, platform engineering, and large-scale distributed systems
  • Experience designing cloud services with clear control plane / data plane separation and cell-based architecture for horizontal scalability and blast-radius isolation
  • Experience building and operating developer-facing platforms used by large numbers of engineers or customers
  • Proven ability to define the provisioning contract other teams onboard onto: typed inputs, readiness semantics, published outputs, and declared dependencies between provisioned services
  • Experience with dependency-ordered composition across services owned by different teams — readiness gating, eventual consistency, and deciding what may be provisioned in parallel
  • Track record of setting versioning and compatibility policy for customer-facing configuration surfaces, and of sequencing change across the schema, controller, packaging, and deployment layers that must land in order
  • Sustained hands-on production ownership at scale — has carried on-call for systems they designed and fed that operational experience back into the architecture
  • Track record of raising stability across a domain: SLO and error-budget policy, incident review that produces systemic fixes, and reliability tracked as a measurable trend rather than per-incident firefighting
  • Experience making cost a first-class engineering signal: usage attribution, cost-per-unit visibility, and guardrails that keep spend predictable as the platform scales
  • Strong ability to resolve ambiguous, open-ended technical problems at system scope
  • Demonstrated ability to influence without formal authority — across teams, disciplines, and seniority levels
  • Track record of creating durable technical standards and practices adopted across an organization

Preferred

  • Experience designing SDK and Terraform provider strategies that enable customers to extend and automate the platform
  • Track record of building extensible platform layers: plugin systems, API versioning strategies, client library design
  • Experience building AI/ML product platforms: inference APIs, fine-tuning UX, model management, evaluation tooling
  • Experience building self-service, paved-path onboarding so teams can ship new deployable units without platform-team involvement
  • Background in GPU cloud or compute platforms serving ML workloads; experience operating platforms with strict SLAs at scale

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Salary Range
$220,000$293,333 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.

Similar jobs

NscaleSingapore, Singapore

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology sol…

Full-time
NscaleHouston, Texas, United States

Est. 242,500 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleRemote

Est. 155,000 USD

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centers, software, and applications that power today's AI stack using sustainable technology sol…

Full-timeRemote
NscaleHouston, Texas, United States

Est. 182,500 USD

. About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superio…

Full-time
NscaleNew York, New York, United States

Est. 200,000 USD

About the role At Nscale, we’re on a mission to build the engine of superintelligence, and developers are at the center of how that future gets built. We’re looking for a Developer Relations Engineer to help define how d…

Full-time
NscaleHouston, Texas, United States

Est. 160,000 USD

ROLE OVERVIEW Nscale is seeking a Development Program Manager to be the organizational backbone of our Americas data center development team — building and maintaining the processes, folder structures, dashboards, and re…

Full-time
NscaleRemote

Est. 145,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-timeRemote
NscaleUnited States

Est. 225,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleLondon, United Kingdom

Est. 120,000 GBP

About Nscale Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology sol…

Full-time
NscaleSeattle, Washington, United States

Est. 150,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleUnited States

Est. 75,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleHouston, Texas, United States

Est. 250,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleSan Francisco, California, United States

Est. 286,667 USD

About The Role At Nscale, we're on a mission to build the engine of superintelligence, and developers are at the center of how that future gets built. We're looking for a Director of Developer Relations to lead and build…

Full-time
NscaleNew York, New York, United States

Est. 173,333 USD

Product Marketing Manager Hybrid - NYC or SFO About the Job At Nscale, our Marketing team plays a critical role in driving the adoption and engagement of our sovereign AI cloud platform. We take a data-centric approach t…

Full-time
NscaleHouston, Texas, United States

Est. 205,000 USD

About the role: The AI infrastructure market moves weekly. As the Director of Competitive Insights, you will not just track competitors; you will translate complex market movements—such as new Nvidia allocations, legacy…

Full-time
NscaleRemote

Est. 120,000 USD

About Nscale Nscale is the vertically integrated AI cloud engineered for AI. We own and operate the full stack — energy, data centres, GPU superclusters, orchestration, and AI services — delivering high-performance infra…

Full-timeRemote
NscaleUnited States

Est. 180,000 USD

ROLE OVERVIEW Nscale is seeking a Senior Development Manager to drive the development of new AI data center sites across the Americas — advancing projects from site control through due diligence, entitlement, permitting,…

Full-time
NscaleHouston, Texas, United States

Est. 60,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleHouston, Texas, United States

Est. 230,000 USD

ROLE OVERVIEW Nscale is seeking a Director, Data Center Development to lead end-to-end development of new AI data center sites across the Americas — from origination and site control through entitlement, design coordinat…

Full-time
NscaleUnited States

Est. 125,000 USD

ROLE OVERVIEW Nscale is seeking a Development Associate to support the development of new AI data center sites across the Americas. Reporting to the Director, Data Center Development, you will work alongside developmentm…

Full-time
NscaleHouston, Texas, United States

Est. 243,333 USD

About the role We’re seeking a Staff Product Engineer to define the paved roads developers use to adopt, operate, and scale on Nscale, from first API call to production workloads. This is a high-impact IC role for someon…

Full-time
NscaleUnited States, United States

Est. 215,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleUnited Kingdom

Est. 120,000 GBP

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleHouston, Texas, United States

Est. 140,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleNew York, New York, United States

Est. 250,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-time
NscaleRemote

Est. 215,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior…

Full-timeRemote
NscaleUnited States

Est. 225,000 USD

About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale simplifies AI development while enabling superior…

Full-time
NscaleNew York, New York, United States

Est. 115,000 USD

Role Overview We’re looking for a senior, strategic Social Media Lead with 10+ years of experience scaling global B2B tech brands to millions of followers and highly engaged communities. This is not a “manage the channel…

Full-time
NscaleSeattle, Washington, United States

Est. 300,000 USD

Principal Network Engineer, AI Infrastructure & High-Performance Networking About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and larg…

Full-time
NscaleUnited States

Est. 195,000 USD

Senior Observability Platform Engineer – Nscale About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale s…

Full-time