AI Evaluation Engineer

Role/Job title :AI Evaluation Engineer Work Location :London Type work : Contract Mode of work : Hybrid Responsibilities: * Define and implement end-to-end evaluation strategy for generative AI conversational systems (LLMs, RAG pipelines, agents). * Establish evaluation metrics * Test Dataset & Benchmarking * Benchmark models (GPT variants, open-source LLMs) and prompt strategies * Implement automated evaluation pipelines * Conduct human-in-the-loop evaluation for qualitative validation. * Prom…