inhousefyi
← Back to listings

Senior Staff/Staff Machine Learning Engineer

CoupangBeijing, China · Posted Jul 17, 2025
Full-time
Apply now

Description

Senior Staff/Staff Machine Learning Engineer-BJ/SH

Company Introduction

We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did we ever live without Coupang?” Born out of an obsession to make shopping, eating, and living easier than ever, we are collectively disrupting the multi-billion-dollar commerce industry from the ground up and establishing an unparalleled reputation for being leading and reliable force in South Korean commerce.

We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the sped we have been at since our inception. We are all entrepreneurial surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.

Our mission to build the future of commerce is real. We push the boundaries of what’s possible to solve problems and break traditional tradeoffs. Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world.

As a Senior Staff Machine Learning Engineer in Search and Discovery, you will leverage the most advanced algorithms to improve Coupang’s product search and discovery quality. You will spearhead the integration of Large Language Models (LLMs) and Generative AI to revolutionize our core search pipeline—including query understanding, product understanding, semantic retrieval, and final-stage ranking. You are expected to be a leading expert in one or multiple areas including information retrieval, recommendation systems, machine learning, deep learning, or natural language processing. The ideal candidates are pragmatic, resourceful, embrace seemingly impossible challenges, and have a proven track record of deploying high-scale, low-latency AI solutions in production.

What You Will Do

  • System Diagnostics: Root cause the bottlenecks of the current search and recommendation systems and quantify the defects across the entire search funnel (query rewriting/ retrieval/ranking).
  • State-of-the-Art Solutions: Propose and architect end-to-end solutions that leverage advanced ML, DL, and Generative AI/LLMs to upgrade traditional search components into AI-native architectures.
  • Core Funnel Optimization with LLMs:
  • Query Understanding: Build next-generation query understanding services (intent detection, query rewrite, semantic expansion, entity extraction) utilizing fine-tuned LLMs.
  • Candidate Retrieval: Design and scale semantic/dense retrieval systems, combining traditional vector search (ANN) with generative retrieval techniques.
  • Ranking & Reranking: Develop and optimize LLM-based listwise/pairwise reranking models, and tackle performance trade-offs (latency, cost, throughput) for real-time serving.
  • Production & Evaluation: Implement solutions, optimize offline/online inference performance (using model distillation, quantization, vLLM/TensorRT), and conduct rigorous A/B tests.
  • Technical Leadership: Be a thought leader, mentor senior engineers, and gain consensus across cross-functional organizations (Infrastructure, Platform, Product) to drive the search AI roadmap.

Example Projects Include

  • LLM-Powered Query Understanding: We train and fine-tune in-house LLMs to perform multi-task query tagging, real-time query rewriting/expansion, and precise intent categorization.
  • Generative & Semantic Retrieval: We use deep representation learning, two-tower models, and LLM-generated semantic embeddings combined with vector databases (e.g., Milvus, Vespa) for hyper-accurate candidate retrieval.
  • LLM Reranking & Distillation: We explore listwise and pairwise LLM reranking models to evaluate query-item relevance, while distilling their reasoning capabilities into smaller, sub-millisecond models for real-time serving.
  • Deep Conversion & Personalization: We build Deep Learning-based conversion prediction models ($CVR$) incorporating real-time user state, query intent, and multi-modal product representations.
  • Graph-based Relationships: We leverage graph neural networks (GNNs) and knowledge graphs to ground our LLMs, exploring latent relationships between query sessions and catalog documents.

Basic Qualifications

  • 10+ years of professional experience in related fields including Search, Information Retrieval, RecSys, ML, DL, or NLP.
  • Solid software engineering foundation with proficient coding skills in Python, C++, or Java.
  • Distributed Systems Experience: Proven experience handling large data volumes, training large-scale models, and serving high-QPS pipelines in distributed environments (e.g., Spark, Ray, Kubernetes).
  • Pragmatic Problem Solver: Demonstrated ability to take ambiguous business problems, formulate them mathematically, and deliver production-grade ML solutions.
  • Education: Master’s Degree in Computer Science, Data Science, or related engineering fields.

Preferred Qualifications

  • LLM & GenAI Expertise: Deep hands-on experience in fine-tuning (SFT, LoRA), aligning (RLHF/DPO), or distilling LLMs specifically for search, recommendation, or NLP tasks (e.g., query expansion, dense retrieval, reranking).

Similar jobs

Staff AI Engineer7 months ago
WorkatoPalo Alto, California, United States

Est. 175,000 USD

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time
Zone 5 TechnologiesUnited States

Est. 141,000 USD

At Zone 5 Technologies, we're redefining what's possible in unmanned aircraft systems. Our team of engineers and innovators is developing cutting-edge autonomous solutions that push the boundaries of UAS technology - sol…

Full-time
WorkatoPalo Alto, California, United States

Est. 175,000 USD

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time
AI Researcher3 months ago
WorkatoSingapore, Singapore

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time
CongaBoston, Massachusetts, United States

Est. 140,000 USD

A career that’s the whole package! At Conga, we’ve built a community where our colleagues can thrive. Here you’ll find opportunities to innovate and support growth through individual and team development, all within an e…

Full-time
Staff AI Engineer2 months ago
WorkatoRemote

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-timeRemote
WorkatoSofia, Bulgaria

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time
WorkatoSingapore, Singapore

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time
WorkatoSan Francisco, California, United States

Est. 80,000 USD

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time

APPLICATIONS FROM OUTSIDE COLOMBIA WILL NOT BE CONSIDERED FOR THIS ROLERobots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that int…

Full-timeRemote
BaringaLondon, United Kingdom

Est. 120,000 GBP

About Baringa Baringa is a global consulting firm that partners with leaders to drive change and create value. With deep industry expertise, and enabled by advanced technology, the firm helps clients to deliver with grea…

Full-time
AxleRockville, Maryland, United States

Est. 165,000 USD

(ID: 2026-1572) Axle is a bioscience and information technology company that offers advancements in translational research, biomedical informatics, and data science applications to research centers and healthcare organiz…

Full-time
HillpointeWinter Park, Florida, United States

Est. 124,000 USD

WHY HILLPOINTE? Hillpointe is a fully integrated real estate development and investment management firm focused on developing market-rate workforce housing across the Sun Belt. Ranked at the top of NMHC's list of Builder…

Full-time
EncoraTaguig City, Philippines

Position Title: Machine Learning Specialist (Research & Engineering) Work Location: BGC, Taguig City. (2 x onsite per week hybrid set up) We are seeking a versatile Machine Learning Specialist to own the end-to-end l…

Full-time
Coupang InternalSeattle, Washington, United States

Est. 141,000 USD

Please complete the attached Internal Transfer Request Form and submit. Please make sure to apply with your Coupang e-mail address. Company Introduction We exist to wow our customers. We know we’re doing the right thing…

Full-time
CoupangMountain View, California, United States

Est. 175,000 USD

Company Introduction We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did I ever live without Coupang?” Born out of an obsession to make shopping, eating, and living…

Full-time
AI Engineer6 months ago

Robots & Pencils is seeking an AI Engineer to design, build, and deploy production-grade AI systems that deliver measurable business value. This is a hands-on engineering role focused on implementation and delivery.…

Full-timeRemote
SharkNinjaBoston, Massachusetts, United States

Est. 180,000 USD

About Us SharkNinja is a global product design and technology company, with a diversified portfolio of 5-star rated lifestyle solutions that positively impact people’s lives in homes around the world. Powered by two trus…

Full-time

Est. 120,000 PLN

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…

Full-timeRemote
AI Engineer13 days ago
EncoraTaguig City, National Capital Region, Philippines

Position Title: AI Builder Work Location: BGC, Taguig City. (2 x onsite per week hybrid set up) Job Description: As an AI Builder, a full-stack AI software engineer, you will drive the engine of our core AI innovation, a…

Full-time
Data Scientist4 months ago
Cato NetworksTel Aviv, Tel Aviv District, Israel

Welcome to the future of cloud networking and security! Cato Networks is the first company to converge enterprise networking and security into one centralized and global service that is delivered by cloud. It is led by n…

Full-time

Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…

Full-timeRemote

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence…

Full-timeRemote

Est. 140,000 USD

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence…

Full-timeRemote
NebiusRemote

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to…

Full-timeRemote
CoupangSingapore, Singapore

About Coupang Play Coupang Play is an OTT video streaming service. We offer a wide range of content, including Original Series, TV Shows, Movies, and Sports. We are in the business of delivering exceptional storytelling.…

Full-time
LTSRemote

Est. 140,000 USD

Location: United States – RemoteClearance: Ability to obtain and maintain a Public Trust LTS is seeking a highly skilled Senior Applied AI Engineer to focus on continuously improving the intelligence behind the platform.…

Full-timeRemote
BOLDNoida, Uttar Pradesh, India

BOLD is seeking for the newest addition to our existing Data Science team, you’ll combine your analytical skills and business knowledge to deliver key insights to our Product and Management teams. You’ll help drive produ…

Full-time
West MonroeChicago, Illinois, United States

Est. 125,000 USD

Are you ready to make an impact?The Tech Ex Labs Senior Product Owner will define and deliver the roadmap for the firm's portfolio of proprietary software assets and AI capabilities. This role partners with business lead…

Full-time
Anduril IndustriesCosta Mesa, California, United States

Est. 141,000 USD

Anduril Industries is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century…

Full-time