Robin Miklinski
I took responsibility for quality and release assurance on the first customer-facing AI product at Reward Gateway, the employee-benefits platform Edenred acquired for £1.15bn. The application had already been built. The evaluation infrastructure had not. It was a retrieval-based assistant built on AWS Bedrock with OpenSearch, serving many enterprise customers from one system. It shipped natively on iOS and Android as well as the web, and I owned release assurance across all three surfaces. A failure of isolation was not a bug in one account but a disclosure across several. There was no defensible basis for deciding whether it was ready to launch.
Because the model’s wording varied between runs, conventional exact-output checks were insufficient. The same prompt can return three different answers and all of them be acceptable. I replaced pass/fail equality with semantic assertions, classifier-based validation and sampling across repeated runs, so the suite could judge whether a response completed the task and stayed inside the system’s rules. The adversarial half covered direct and indirect prompt injection, jailbreaks, tenant data isolation, personal data leakage, authentication flows and retrieval scope.
The suite ran to 180 tests across unit, integration, API and functional layers: forty-four on security, thirteen on tenant isolation alone, and a set of benchmark answers reviewed by subject-matter experts to judge whether the assistant was actually right.
The suite made the limits of the launch evidence visible. Without a labelled dataset, answer accuracy could not be measured at scale. Response times had no agreed service level, and the pipeline handling updated and deleted content remained untested. I turned each gap into an explicit residual risk for the go/no-go panel to assess. The product launched with a clear account of what was known, what remained uncertain and where further investment would produce better evidence.
The same approach applied to continuous evaluation. Every run queried the model and carried a usage cost, so test frequency was a commercial decision as well as an engineering one. I quantified the cost and made the trade-off visible to the people responsible for it. That is part of release assurance too: not pretending a control exists when the organisation has not yet chosen to fund it.
The suite became the release gate for later AI work and set the platform’s wider AI testing approach: AI-assisted test generation, and risk-based test selection driven by what a code change touched.
Background
Before the AI work I built Reward Gateway’s quality function from nothing: fifteen engineers across London and Sofia, supporting more than two hundred people in product and engineering. I designed its quality career framework so senior engineers could progress, and built the automation and measurement platform underneath it. That platform held a 0.02% flake rate across roughly a thousand end-to-end tests, against an industry norm of five to fifteen per cent. The infrastructure helped support the platform’s scale and release cadence in the years before Edenred acquired the company for £1.15bn.
I began in defence and intelligence data systems at BAE Systems Detica, Steria Defence UK and Fujitsu Services, where a change had to be traced to its reason and a boundary had to hold against an assumed attacker. Since then: peak trading performance testing at 15,000 concurrent users at ASOS, security scanning moved into the delivery pipeline at Huddle in 2015, and the test framework behind a billing system launch and a first international customer at Perkbox.
My work spans Python, JavaScript, TypeScript and C#, from product implementation to the evidence needed for sound release decisions. That range matters when a system can fail in ways that are fluent, plausible and wrong.
BSc (Hons) Internet Engineering, University of Exeter. ISTQB Foundation Certificate in Software Testing. I spoke at BrowserStack World Tour 2024 on observable test automation at scale.
Outside work
I DJ and produce electronic music as Eidetic. Self-taught since 2007, resident at EGG London in 2017 and 2018, and a radio show, Late Night Relics on AAJA Radio.