GenAI/LLM Test Engineer
Listing sourced from adzuna on 10/10/2026. CVCraft does not host this job; clicking Apply redirects to the source.
Job Description
We are looking for a GenAI/LLM Test Engineer with strong experience in AI/ML product testing, Python, AI evaluation frameworks, SQL, and test automation . The role will focus on testing LLM-based applications, RAG systems, AI agents, prompts, model outputs, and data pipelines. Required Skills: LLM/GenAI Product Testing Python & SQL AI Evaluation Frameworks ā Ragas, DeepEval, LangSmith, Promptfoo, OpenAI Evals, TruLens Test Automation, Regression & API Testing Performance & Adversarial Testing Gā¦
Salary Context for DevOps Engineer
The US national median for DevOps Engineer is $130,000; in Seattle the median is $171,600 (+32% vs national).
Tailor your resume to this role before applying
75% of applicants get filtered by ATS before a human reads them. Run a free 60-second scan to see what keywords are missing from your resume.
Free ATS ScanPass the ATS Filter Before Applying
Most resumes never reach a human. CVCraft scans your resume against this exact role's keywords in 60 seconds ā free.
Scan My Resume Free