01Overview
About E2M
E2M Solutions works as a trusted white-label partner for digital agencies. We support agencies with consistent and reliable delivery through services such as website design, web development, ecommerce, SEO, AI SEO, PPC, AI automation, and content writing. Founded on solid business ethics, we are an equal opportunity organization powered by 300+ experienced professionals, partnering with 400+ digital agencies across the US, UK, Canada, Europe, and Australia. At E2M, we value ownership, consistency, and people who are committed to doing meaningful work and growing together.
Job Summary
We're looking for an AI QA Engineer to own quality across our growing portfolio of AI-powered products custom dashboards, AI CRMs, RFP platforms, lead-gen systems, agentic workflows, and automations delivered to agency clients across the US, UK, and AU. This role spans both the AI layer (prompts, agents, RAG, model outputs) and the full application stack around it (web app UI, APIs, databases, integrations, multi-tenant access). You'll catch issues that traditional QA misses *and* the ones that pure ML evaluation misses the messy middle where a working model still ships a broken product.
Key Responsibilities
*AI & LLM Quality*
- Design test strategies for LLM-powered features, agents, RAG systems, and workflow automations (n8n, custom pipelines, MCP-based systems)
- Build and maintain golden datasets, evaluation suites, and prompt regression tests so model or prompt changes don't silently break production
- Validate output quality across factual accuracy, format adherence, tone, hallucination rate, instruction-following, and refusal behavior
- Test agentic and multi-step workflows end-to-end tool calls, handoffs, error recovery, loop detection, cost and latency under load
- Stress-test RAG pipelines: retrieval accuracy, chunking quality, context relevance, citation correctness
- Run adversarial testing prompt injection, jailbreak attempts, malformed inputs, edge-case cli .
