Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems
SK hynix memory solutions America Inc.San Jose, California, United States · Posted 2 months agoDescription
About the Company:
At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM and NAND flash technologies, we drive the evolution of advancing mobile technology, empowering cloud computing, and pioneering future technologies. Our cutting-edge memory technologies are essential in today's most advanced electronic devices and IT infrastructure, enabling enhanced performance and user experiences across the digital landscape.
We're looking for innovative minds to join our mission of shaping the future of technology. At SK Hynix Memory, you'll be part of a team that's pioneering breakthrough memory solutions while maintaining a strong commitment to sustainability. We're not just adapting to technological change – we're driving it, with significant investments in artificial intelligence, machine learning, and eco-friendly solutions and operational practices. As we continue to expand our market presence and push the boundaries of what's possible in semiconductor technology, we invite you to be part of our journey to creating the next generation of memory solutions that will define the future of computing.
Why Join Us?
- Build foundational AI infrastructure that powers next-gen enterprise systems.
- Work on cutting-edge agentic AI — not just chatbots, but autonomous systems that reason, plan, and act.
- Opportunity to influence AI strategy, deployment, and governance in a high-impact environment.
About the Role:
We are seeking a hands-on AI Engineer to design, deploy, and maintain on-prem AI infrastructure and build agentic AI systems that drive real-world automation. You’ll be responsible for setting up scalable AI environments, implementing RAG pipelines, fine-tuning embedded models, and architecting AI agents that operate autonomously in enterprise settings. This role sits at the intersection of AI systems engineering and applied ML — you’ll bridge infrastructure, model deployment, and agent logic.
Responsibilities:
- Design and deploy on-prem AI infrastructure — including GPU clusters, model serving (e.g., vLLM, TGI, Triton), vector DBs (e.g., Milvus, Qdrant, FAISS), and orchestration (Kubernetes, Helm, Docker).
- Build and optimize RAG pipelines — including document chunking, retrieval strategies (hybrid, re-ranking), and evaluation of retrieval accuracy and latency.
- Develop agentic AI systems — design stateful agents with memory, tool use, and planning capabilities (e.g., using LangGraph, AutoGen, or custom frameworks).
- Fine-tune and deploy embedded models — work with LoRA, QLoRA, or full fine-tuning for domain-specific tasks; optimize for edge/on-device inference.
- Implement Model Control Protocols (MCP) — ensure model governance, versioning, access control, and monitoring for production AI systems.
- Collaborate with product and engineering teams to integrate AI capabilities into enterprise workflows — especially in storage, QA, or systems engineering contexts.
- Automate and monitor AI pipelines — build CI/CD for model deployment, logging, and performance tracking.
Minimum Qualifications:
- 2+ years of experience in AI/ML engineering, with hands-on deployment of AI systems on-prem or private cloud.
- Proven experience building agentic AI systems — including state management, tool integration, and multi-step reasoning.
- Strong working knowledge of RAG architectures — chunking, retrieval, re-ranking, evaluation metrics.
- Experience with model fine-tuning (LoRA, QLoRA, full fine-tuning) and embedding models for retrieval.
- Familiarity with Model Control Protocols (MCP) or similar governance frameworks (model versioning, access control, audit trails).
- Proficiency in Python, Linux, Docker/Kubernetes, and vector databases (e.g., Milvus, Qdrant, Pinecone).
- Experience with AI serving frameworks (vLLM, TGI, Triton, Ollama, etc.).
Preferred Qualifications:
- Experience deploying AI in enterprise storage or hardware-adjacent environments.
- Background in systems engineering or QA automation — bonus if you’ve used AI to automate testing or validation.
- Familiarity with embedded AI or edge inference (ONNX, TensorRT, GGUF, etc.).
- Experience with AI agent frameworks (LangGraph, AutoGen, BabyAGI, etc.).
- Knowledge of AI observability tools (LangSmith, Weights & Biases, Prometheus/Grafana for AI).
- As a Storage company, knowledge of storage area/NVMe is a PLUS.
Education Requirement:
- Bachelor of Science in CS, EE, ME, or other applicable Engineering field.
COMPENSATION: $140,000/yr - $165,000/yr
REGARDING COMPENSATION:
SK hynix memory solutions America Inc. offers you the opportunity to apply your skills to exciting projects while working with innovative teams. Our compensation package is complimented by a generous benefits package including medical, dental, vision, life insurance and a company 401(k) match, as well as cafeteria, onsite gym and much more. If you are motivated by technical challenges, we offer a collaborative work environment that encourages career growth.
The salary offered to a selected candidate will be tailored based on several factors, including the location, job grade, relevant knowledge, skills, and experience. We also take into account the internal equity among our current team members to ensure fairness and competitiveness
Similar jobs
Est. 205,000 USD
Job Title: AI Memory Solution ArchitectOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing advanced…
Est. 185,000 USD
Job Title: AI System EngineerOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing advanced memory so…
Est. 202,500 USD
Job Title: AI/HPC System Engineer Office Location: San Jose, CA Job Type: Full-Time Work Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing advanced me…
Est. 205,000 USD
Job Title: AI/HPC System ArchitectOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing advanced memo…
Est. 185,000 USD
Job Title: Sr. Manager, AI Transformation Office Location: San Jose, CA Job Type: Full-Time Work Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor innovation, developing ad…
Est. 145,000 USD
Job Title: Business Development Manager / Sr. ManagerOffice Location: San Jose, CA Job Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, deve…
Est. 145,000 USD
Job Title: Manager, HR Business Partner Office Location: San Jose, CA Work Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor innovation, developing advanced memory solution…
Est. 85,000 USD
Job Title: Business Development Associate (Contract) Duration: 18-Months Office Location: San Jose, CA Work Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, dev…
Est. 121,000 USD
Job Title: Sr. Technical Recruiter Office Location: San Jose, CA Job Type: Full-Time Work Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor innovation, developing advanced…
Est. 160,000 USD
About the Company: At SK Hynix Memory Solutions, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM…
Est. 160,000 USD
About the Company: At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM…
Est. 175,000 USD
About the Company: At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM…
Est. 140,000 USD
About the Company: At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM…
Est. 135,000 USD
Job Title: Technical Marketing EngineerOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor innovation, developing advance…
Est. 142,500 USD
About the Company: At SK Hynix Memory Solutions, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM…
Est. 220,000 USD
At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM and NAND flash tech…
Est. 123,500 USD
Job Title: Field Application Engineer, NAND/SSDOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing…
Est. 210,000 USD
Job Title: Principal Engineer, HBM Field Application Office Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, devel…
Est. 107,500 USD
Job Title: Application Test Engineer - CPU Validation & Server System QualificationOffice Location: San Jose, CAWork Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor i…
Est. 125,000 USD
Title: Sales Account Manager Location: San Jose, CA Job Type: Full-Time Work Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing advanced memory solutio…
Est. 147,500 USD
Job Title: Staff Engineer, HBM Field ApplicationOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing…
Est. 235,000 USD
Job Title: On/Off-Chip SI/PI EngineerOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing advanced m…
Est. 200,000 USD
Job Title: Analog/Mixed-Signal Circuit Design EngineerOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, deve…
Est. 202,500 USD
Job Title: Principal Engineer, Signal-Integrity and Power-IntegrityOffice Location: San Jose, CAWork Model: Onsite About SK hynix America At SK hynix America, we're at the forefront of semiconductor innovation, developin…
Est. 142,500 USD
About the Company: At SK hynix memory solutions, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in NAND…
Est. 110,000 USD
Job Description: SK Hynix Memory Solutions has a key design center in San Jose with focus on enterprise datacenter SSD development. The Reliability System Engineering team is seeking a talented and detail-oriented test e…
Est. 160,000 USD
Job Title: Staff Engineer, DRAM Field ApplicationOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developin…
Est. 245,000 USD
Please Note: To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. Advancing the World’s Technology Toget…
Est. 142,500 USD
About the Company: At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM…
Est. 85,000 USD
Job Title: Venture Investment AnalystOffice Location: San Jose, CAJob Type: Full-TimeWork Model: Onsite About SK hynix AmericaAt SK hynix America, we're at the forefront of semiconductor innovation, developing advanced m…