Keeper Security logo

Keeper Security

More roles at Keeper Security

Senior Software Development Test Engineer (SDET), AI & Automation

Work from home

Remote role where the employee must remain based in a particular country.

Listed for United States

Source: the job board's country tag. The advert itself does not name United States.

Employer listed it 7 days ago 路 Added 3 weeks ago

Been open since 3 weeks ago, still being checked, but it has been live a while.

Salary

Not stated

Location

Listed for United States

Timezone

Not stated

Contract

Full-time

Experience

Senior

Category

Software

The employer did not publish a salary, and we have too few comparable roles to estimate one.

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
This is a 100% remote position, with an opportunity to work a hybrid schedule for candidates based in the El Dorado Hills, CA or Chicago, IL metro areas.
Contract
citizen or lawful permanent resident.
Experience asked for
5+ years of experience in SDET, software development, test automation or another code-intensive quality engineering role
Pay
Not mentioned in the advert

Remote flexibility

Work from home

This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.

What the employer says

  • Source listing states candidate location: "Remote, US"
  • Job description states: "based in the El Dorado Hills"

What Nomaders makes of it

  • Payroll and tax are likely handled in that country only

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Questions worth asking: Nomaders interpretation

  • No pay is stated. Ask for the salary range before investing time in interviews.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

Description

Keeper Security is hiring a Senior Software Development Engineer in Test (SDET), AI & Automation to join our AI team and help build a modern, automated approach to quality across AI-powered products and services. This is a 100% remote position, with an opportunity to work a hybrid schedule for candidates based in the El Dorado Hills, CA or Chicago, IL metro areas.

Keeper鈥檚 cybersecurity software is trusted by millions of people and thousands of organizations globally. Keeper is published in 23 languages and sold in over 150 countries. Join one of the fastest-growing cybersecurity companies and help establish scalable quality engineering practices for AI-driven systems operating in security-sensitive environments.

About Keeper

Keeper Security is one of the fastest-growing cybersecurity software companies that protects thousands of organizations and millions of people in over 150 countries. Keeper is a pioneer of zero-knowledge and zero-trust security built for any IT environment. Its core offering, KeeperPAM庐, is an AI-enabled, cloud-native platform that protects all users, devices and infrastructure from cyber attacks. Recognized for its innovation in the Gartner Magic Quadrant for Privileged Access Management (PAM), Keeper secures passwords and passkeys, infrastructure secrets, remote connections and endpoints with role-based enforcement policies, least privilege and just-in-time access. Learn why Keeper is trusted by leading organizations to defend against modern adversaries at KeeperSecurity.com.

About the Job

As a Senior SDET, AI & Automation, you will serve as an embedded quality engineering partner within Keeper鈥檚 AI team. You will work alongside engineers and Product throughout design and development to define test strategy, establish acceptance criteria and build automated coverage as AI-powered capabilities are being developed.

This role requires experience testing both traditional deterministic software systems and non-deterministic AI/ML systems. Traditional application behavior can often be validated against consistent expected outputs, while AI models may produce different but acceptable results across models, prompts and inputs. You will help design testing approaches that account for this variability while still establishing measurable quality, reliability and safety standards. You will build automation frameworks, develop deterministic and probabilistic validation strategies, integrate testing into CI/CD workflows and help Keeper move toward continuous quality engineering rather than end-of-cycle QA.

Responsibilities

Partner directly with AI engineers, Software Engineers and Product Managers during design and development to define test strategy, acceptance criteria and automation requirements

Design and maintain automated testing frameworks for AI-powered applications, backend services, APIs and supporting software systems

Develop testing strategies for both deterministic software behavior and non-deterministic AI/ML outputs

Define measurable evaluation criteria, tolerances and quality thresholds for AI model and LLM-driven functionality

Build automated regression, integration, API and end-to-end coverage alongside feature development

Develop test harnesses and evaluation workflows for prompts, models, agents, tool-calling workflows and AI-integrated applications

Validate AI behavior across different models, prompts, inputs and system configurations

Develop automated test utilities using languages such as Python, Java, JavaScript/TypeScript, Rust or similar technologies

Integrate automated validation and quality gates into CI/CD pipelines using GitHub Actions, Jenkins, GitLab CI or similar platforms

Build and maintain test datasets, mocks, fixtures and synthetic data required for repeatable AI and software validation

Analyze model and application failures to distinguish defects, expected model variability, data issues and test instability

Evaluate AI outputs for reliability, consistency, safety and alignment with expected product behavior

Work with engineering teams to improve application testability, observability and diagnostic capabilities

Track test cases, execution results and coverage using TestRail or similar test management platforms

Analyze logs, telemetry and system behavior to identify root causes and produce clear, reproducible defect reports

Requirements

  • 路5+ years of experience in SDET, software development, test automation or another code-intensive quality engineering role
  • 路Hands-on experience testing AI/ML, LLM-powered or model-integrated software systems
  • 路Strong understanding of the differences between deterministic software testing and non-deterministic AI/ML validation
  • 路Experience defining evaluation criteria, expected behaviors, tolerances or scoring approaches for AI-driven functionality
  • 路Must know automation frameworks, like Playwright & Pytest

Benefits

  • 路Medical, Dental & Vision (inclusive of domestic partnerships
  • 路Employer Paid Life Insurance & Employee/Spouse/Child Supplemental life
  • 路Voluntary Short/Long Term Disability Insurance
  • 路401K (Roth/Traditional)
  • 路A generous PTO plan that celebrates your commitment and seniority (including paid Bereavement/Jury Duty, etc)

How to apply

  1. 1Check the flexibility label above, work from home, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Keeper Security, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 19d ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Pay not stated 路 You'll be taken to the employer's careers page.