Senior QA Analyst / Tester

Orion InnovationRemote · Posted 10 days ago

Full-timeRemoteEst. 120,000 USD

Description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

The Red Team Tester will conduct testing of AI models to find vulnerabilities, develop new evaluation frameworks, communicate risks to stakeholders across the global teams and the network of member firms, and collaborate with defensive and development teams.

Key accountabilities

% of time Accountability

10 Design and execute comprehensive adversarial testing campaigns against AI models, including but not limited to large language models, multimodal systems, and autonomous agents.
10 Research attack vectors and prompt injection techniques to identify model vulnerabilities, jailbreaks, and unintended behaviors. Evaluate and introduce AI Security tools that decrease mean time to detect and respond to AI-specific threats.
50 Conduct red team exercises simulating real-world deployment scenarios and edge cases. Systematically probe for bias, toxicity, misinformation generation, and other harmful outputs across diverse contexts and demographics. Improve firm’s security posture against emerging AI threats. Concentration is on executing standardized security tests.
10 Create adversarial datasets and benchmarks to evaluate model robustness under various attack conditions.
10 Collaborate with security teams (e.g., GSOC, member firm security teams, developers) to perform red teaming activities, and document and present findings, vulnerabilities, and remediation recommendations to drive the mitigation of identified risks.
10 Develop and maintain process documentation, create reports on testing activities, track operational metrics, and perform other programmatic tasks as required to support the AI Red Team's function.

This is the job for you if you have…

Minimum 5 years of penetration testing, red team operations, or AI Red Team experience.

Computer science, information technology, programming, development, Artificial Intelligence, or cybersecurity degree (Bachelor's or higher preferred) from an accredited college or university or equivalent work experience.

Background in AI red teaming, red teaming, or offensive cyber operations.

Understanding of Artificial Intelligence, Machine Learning, software applications, cloud computing, and networking. Excellent communication and stakeholder management skills. Ability to work effectively across geographies and time zones.

Core technical skills include:

• Testing tools: SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike/Mythic/C2, NMAP, sqlmap, or similar tools

• Web application technologies and layer 7 protocols (HTTP, DNS, FTP)

• Technical knowledge of Generative AI, Agentic AI, A2A, and/or MCP

• Programming languages: Python, Ruby, Go, C++, PowerShell, bash or similar

• Certifications: OSCP, GPEN, GPXN, AI Red Teamer Job Role Path (HackTheBox), AISEC+, GASAE, GOAA, GASAE, OSAI+, or other industry AI or Red Team related certifications desired

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

What information we collect during our application and recruitment process and why we collect it;
How we handle that information; and
How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.

Orion InnovationRemote

Full-timeRemote

Test Automation Engineer3 months ago

Orion InnovationRemote

Full-timeRemote

Senior/Lead Mobile Engineer6 days ago

Orion InnovationRemote

Full-timeRemote

Gen AI Developer/ Senior Developer6 months ago

Orion InnovationIndia

Full-time

AI Engineers (3-8 years)3 months ago

Orion InnovationHyderabad, Telangana, India

Full-time

AI Tech Lead (Manager)2 months ago

Orion InnovationHyderabad, Telangana, India

Full-time

Sr. Cloud Architect23 days ago

Orion InnovationRemote

Est. 175,000 USD

Full-timeRemote

Full Stack Developer1 month ago

Orion InnovationRemote

Full-timeRemote

Data Scientist3 months ago

Orion InnovationHyderabad, Telangana, India

Full-time

System Architect8 days ago

Orion InnovationMississauga, Ontario, Canada

Full-time

Client Program Manager 5910614 days ago

Orion InnovationIselin, New Jersey, United States

Est. 160,000 USD

Full-time

Environmental Project Manager17 days ago

Orion InnovationRemote

Est. 115,000 USD

Full-timeRemote

Gen AI Lead5 months ago

Orion InnovationChennai, Tamil Nadu, India

Full-time

Cloud Architect3 days ago

Orion InnovationRemote

Est. 141,000 USD

Full-timeRemote

AI Security Analyst1 month ago

AlphaSenseRemote

About AlphaSense: The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter f…

Full-timeRemote

Quality Compliance Specialist13 days ago

Orion InnovationNew Brunswick, New Jersey, United States

Est. 85,000 USD

Full-time

Data Engineer1 month ago

Orion InnovationChennai, Tamil Nadu, India

Full-time

Senior Java Developer14 days ago

Orion InnovationRemote

Full-timeRemote

Technical Delivery Manager23 days ago

Orion InnovationNew Jersey, United States

Est. 140,000 USD

Full-time

206125 - Architect / SME / Team lead27 days ago

Orion InnovationRemote

Full-timeRemote

Senior Solution Architect1 month ago

Orion InnovationNew Jersey, United States

Est. 165,000 USD

Full-time

Senior Data Architect (Pre-Sales)6 months ago

Orion InnovationIndia

Full-time

IT Implementation Analyst13 days ago

Orion InnovationAlpharetta, Georgia, United States

Est. 85,000 USD

Full-time

Architect / POD Lead – Data Engineering17 days ago

Orion InnovationBangalore, Karnataka, India

Full-time

Rust Systems Engineer20 days ago

Orion InnovationRemote

Full-timeRemote

QA Automation Engineer, Professional Services R&D3 days ago

OktaBengaluru, India

Secure Every Identity, from AI to HumanIdentity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This…

Full-time

IT Implementation Analyst13 days ago

Orion InnovationFrisco, Texas, United States

Est. 85,000 USD

Full-time

Software Engineer II17 days ago

New RelicRemote

Est. 65,000 EUR

We are a global team of innovators and pioneers dedicated to shaping the future of observability. At New Relic, we build an intelligent platform that empowers companies to thrive in an AI-first world by giving them unpar…

Full-timeRemote

Operations Support Engineer7 days ago

Orion InnovationChennai, Tamil Nadu, India

Full-time

Product Owner Jr.4 months ago

Orion InnovationMexico City, Mexico City, Mexico

Full-time

Senior QA Analyst / Tester

Description

Similar jobs