{"guid":"NOWy7qEDBb3KfRqu2sMyPw","title":"(Virtual Talk) Quality on Autopilot: Scaling Testing in Uyuni","subtitle":"A TestOps journey","slug":"4975-virtual-talk-quality-on-autopilot-scaling-testing-in-uyuni","link":"https://c3voc.de","description":"How do you scale quality in a fast-moving open source project like Uyuni? \n\nIn this talk, I’ll walk you through our journey adopting TestOps practices to bring automation, visibility, and resilience into our quality engineering process.\n\nWe’ll explore how infrastructure automation with Terraform and Salt laid the foundation for consistent, on-demand testing environments. From there, we introduced test observability using Prometheus and Grafana to analyze historical trends and gain visibility into test behavior over time.\n\nA key part of our process includes tracking flaky tests and known issues through a custom system that connects our internal QE workflows directly with test reports.\n\nTo accelerate feedback loops, we implemented smart test selection in Pull Requests, targeting only the affected components with relevant end-to-end tests.\n\nWe also integrated synthetic monitoring of key product metrics into our daily pipelines, ensuring continuous insight into overall health.\n\nThanks to designing our own DevContainers, we improved engineer's experience on their IDEs.\n\nWe are also working on providing public AWS-based test reports reinforcing transparency.\n\nOur journey is a story of small, iterative changes that helped us align quality with development at scale.\n\nLicensed to the public under https://creativecommons.org/licenses/by-sa/4.0/","original_language":"eng","persons":["Oscar Barrios Torrero"],"tags":["4975","2025","osc25","Open Source","Saal","osc25-eng","Day 2"],"view_count":6,"promoted":false,"date":"2025-06-27T12:15:00.000+02:00","release_date":"2025-06-28T00:00:00.000+02:00","updated_at":"2025-11-30T13:15:08.905+01:00","length":2241,"duration":2241,"thumb_url":"https://static.media.ccc.de/media/events/osc/2025/4975-NOWy7qEDBb3KfRqu2sMyPw.jpg","poster_url":"https://static.media.ccc.de/media/events/osc/2025/4975-NOWy7qEDBb3KfRqu2sMyPw_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/osc/2025/4975-NOWy7qEDBb3KfRqu2sMyPw.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/osc/2025/4975-NOWy7qEDBb3KfRqu2sMyPw.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/4975-virtual-talk-quality-on-autopilot-scaling-testing-in-uyuni","url":"https://api.media.ccc.de/public/events/NOWy7qEDBb3KfRqu2sMyPw","conference_title":"openSUSE Conference 2025","conference_url":"https://api.media.ccc.de/public/conferences/osc25","related":[],"recordings":[{"size":28,"length":2241,"mime_type":"audio/opus","language":"eng","filename":"osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2025-06-28T14:51:07.021+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/opus/osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_opus.opus","url":"https://api.media.ccc.de/public/recordings/88583","event_url":"https://api.media.ccc.de/public/events/NOWy7qEDBb3KfRqu2sMyPw","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":34,"length":2241,"mime_type":"audio/mpeg","language":"eng","filename":"osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2025-06-28T14:55:41.432+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/mp3/osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/88585","event_url":"https://api.media.ccc.de/public/events/NOWy7qEDBb3KfRqu2sMyPw","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":158,"length":2241,"mime_type":"video/webm","language":"eng","filename":"osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-07-01T14:50:05.877+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/webm-hd/osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/88756","event_url":"https://api.media.ccc.de/public/events/NOWy7qEDBb3KfRqu2sMyPw","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":75,"length":2241,"mime_type":"video/webm","language":"eng","filename":"osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-07-01T14:48:57.690+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/webm-sd/osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/88755","event_url":"https://api.media.ccc.de/public/events/NOWy7qEDBb3KfRqu2sMyPw","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":46,"length":2241,"mime_type":"video/mp4","language":"eng","filename":"osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-06-28T14:55:03.213+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/h264-sd/osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_sd.mp4","url":"https://api.media.ccc.de/public/recordings/88584","event_url":"https://api.media.ccc.de/public/events/NOWy7qEDBb3KfRqu2sMyPw","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":134,"length":2241,"mime_type":"video/mp4","language":"eng","filename":"osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-06-28T13:29:59.086+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/h264-hd/osc25-4975-eng-Virtual_Talk_Quality_on_Autopilot_Scaling_Testing_in_Uyuni_hd.mp4","url":"https://api.media.ccc.de/public/recordings/88462","event_url":"https://api.media.ccc.de/public/events/NOWy7qEDBb3KfRqu2sMyPw","conference_url":"https://api.media.ccc.de/public/conferences/osc25"}]}