Contact us
Single-threaded testing in a parallel world:
CI+ testing tools were designed for one user, one device at a time – while the customer’s engineering teams work across multiple devices and builds in parallel.
Scaling and automating CI+ conformance testing for a global streaming technology platform
Challenge
A global streaming technology platform needed a way to run CI+ conformance testing at scale across distributed engineering teams without the cost and delays of manual, late-stage testing.
Approach
Resillion designed and integrated a server-based CI+ test harness into the customer’s existing CI/CD workflows.
Results
Resillion integrated 200 CI+ test cases into automated workflows, cutting CI+ testing from 2 weeks of manual effort to less than 3 days.
The customer operates a software platform that powers streaming on millions of TVs and devices. Its technology enables people to access apps and streaming services through smart TVs, streaming sticks and connected devices.
As well as powering the viewing experience, the platform connects streaming services and advertisers to large audiences – so it needs to work reliably across many devices, partners and markets.
Challenge: Overcoming single-device CI+ testing limitations
To support pay-TV and protect streaming content, the customer’s devices must meet CI+ conformance requirements. These are industry-mandated tests that make sure protected content works correctly and securely in real-world use.
The challenge wasn’t CI+ compliance itself – it was that the traditional CI+ testing model (one user, one device, one licence) didn’t fit the customer’s mature, automation-first engineering approach.
At the scale the customer operates, increasing coverage by simply adding more licences and manual effort would have driven cost and slowed feedback – so conformance needed to evolve.
Specifically, the customer needed to solve four practical problems:
1
2
Scaling constraints:
As the customer’s device ecosystem and release cadence grew, the existing approach couldn’t keep up without adding cost and delay.
3
Need for automation:
The customer had already invested in automation and wanted CI+ testing to run on demand and overnight, not as a manual step.
4
Late-stage validation:
Conformance testing was done late in the process, so issues could appear weeks after code was written – costing more to fix at that stage.
Our approach: Embedding CI+ certification testing into engineering workflows
Resillion redesigned how CI+ conformance testing fits into the customer’s workflow.
- Server-based CI+ test harness: Enabled parallel testing across multiple devices.
- Integrated into CI/CD: Teams can trigger tests on demand or run them automatically overnight.
- Closer to developers: Testing moved earlier in the process, reducing delays and hand-offs.
CI+ testing used to be something you did right at the end. With this harness in place, the customer can run it as part of day-to-day engineering and get answers fast - which takes a lot of risk out of certification.
Results: Reduced certification risk through continuous CI+ conformance testing
By making CI+ testing part of everyday engineering, the customer reduced certification risk and avoided last-minute delays.
- Around 200 CI+ test cases integrated into automated workflows
- Faster testing: Reduced from ~2 weeks of manual effort to 2–3 days with automation. Test duration can be reduced further by taking advantage of the CI+ test server’s parallel execution capabilities. So we could test 3 devices in less than 1 day.
- Continuous testing: Nightly runs replaced late-stage testing
- Earlier issue detection: Developers can fix problems sooner, reducing disruption later
By making CI+ fit the customer’s existing engineering workflows, we helped them move from late-stage validation to continuous assurance - with on-demand and overnight testing that surfaces issues days earlier.
Why Resillion
- Industry-approved tooling and harness engineering: we build and maintain official test tools, materials and automation harnesses that make complex standards practical to execute at scale.
- Shift-left automation that scales: we integrate assurance into CI/CD so conformance becomes a continuous signal – finding issues early and reducing re-test and release disruption.
- Deep standards expertise: strong experience translating CI+ requirements into practical, repeatable testing.
- Trusted, audit-ready delivery: supported by established quality processes and recognised certifications/accreditations – helping teams generate evidence stakeholders can rely on.
Where AI adds value to conformance testing
- While automation accelerates test execution, AI can help teams understand and act on the results.
- In environments like the customer’s, AI can be applied to analyse large volumes of conformance test output, spot recurring failure patterns and show any potential risks earlier in the development cycle. This reduces manual triage effort and helps engineering teams focus on fixing issues, rather than interpreting results.
Related Insights
Providing solutions in a unified, structured approach across all critical domains to enable end-to-end quality.
Get in touch
Providing solutions in a unified, structured approach across all critical domains to enable end-to-end quality – Because we’re the only ones who can.
