{"guid":"c2db9233-db47-5725-abae-009aec97c103","title":"Infrastructure at Arch - Making servers go brrrrr","subtitle":null,"slug":"arch-conf-online-2020-6381-infrastructure-at-arch-making-servers-go-brrrrr","link":"https://pretalx.com/arch-conf-online-2020/talk/B9BPWX/","description":"The number of services Arch provides has steadily grown over the years. How many services and servers are there, and how does it even all fit together?\n\nAlso, what do we have planned for the future and how can you help?\n\nFind out in this talk!\n\nArch Linux is a complex open-source project with many moving parts, quite a few pieces of infrastructure, and many people involved. Arch uses some modern DevOps tools like Ansible and Terraform.\nAll of our infrastructure is entirely in the open (except for where is unreasonable to do so).\nWhile we do try to follow the general Arch dogma of keeping things simple, this sometimes conflicts with\ndoing things _right_ and maintainable.\n\nWe're mostly hosted at Hetzner with a few sponsored servers for non-critical and non-trusted services.\n\nAmong our public services are:\n\n- Accounts/SSO\n- AUR\n- BBS\n- Bug tracker\n- GitLab\n- Mailing lists\n- Main page and package list\n- Mirror list\n- Patchwork\n- Security tracker\n- Wiki\n\nNext to these public services, we also operate quite a few staff-only services such as:\n\n- Build servers\n- Kanboard\n- Mail servers\n- Monitoring stack: Grafana, Prometheus, Alertmanager\n- Phrik\n- Quassel\n\nOur servers and services used to be hand-configured without any audit trail. In the past years, we've started\nthe effort of formalising all services we operate using Ansible and Terraform which has been very helpful.\n\n### Ongoing efforts\n\nWhile there have always been minor efforts here and there for various tasks, in recent times we've seen some\nincreased activity especially in these topics:\n\n- Automation: Many parts in Arch have always been done manually. We're currently trying to automate many aspects\n  of the release process for the ISO, VMs and Docker (all separate projects with different requirements).\n- Keycloak SSO migration: We want to have a central account service that allows for secure user account  and access management.\n- GitLab migration: We want our GitLab to be the central point for code contribution, issue reporting, and automation.\n  A full migration would also hopefully allow us to get rid of Flyspray, Kanboard, and Patchwork which decreases stack complexity.\n- Increase user engagement: As Arch Linux is a 100% volunteer-driven project, we need to be as friendly and\n  welcoming to any potential outside contributors as we can. To this end, we're trying to increase bus factors\n  and visibility to get users engaged.\n\n### The future\n\nWe have a long list things we eventually want to have and we're slowly moving there. The general outlook is:\n\n- More contributors\n- More automation\n- More openness\n- More granular access","original_language":"eng","persons":["Sven-Hendrik Haase"],"tags":["arch-conf-2020","6381","2020","archlinux","archconf2020","archconf","linux","conference"],"view_count":975,"promoted":false,"date":"2020-10-10T13:00:00.000+02:00","release_date":"2020-11-01T00:00:00.000+01:00","updated_at":"2026-03-18T06:30:05.420+01:00","length":2768,"duration":2768,"thumb_url":"https://static.media.ccc.de/media/conferences/archconf/2020/6381-hd.jpg","poster_url":"https://static.media.ccc.de/media/conferences/archconf/2020/6381-hd_preview.jpg","timeline_url":"https://static.media.ccc.de/media/conferences/archconf/2020/6381-hd.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/conferences/archconf/2020/6381-hd.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/arch-conf-online-2020-6381-infrastructure-at-arch-making-servers-go-brrrrr","url":"https://api.media.ccc.de/public/events/c2db9233-db47-5725-abae-009aec97c103","conference_title":"Arch Conf 2020","conference_url":"https://api.media.ccc.de/public/conferences/arch-conf-2020","related":[],"recordings":[{"size":65,"length":2768,"mime_type":"video/mp4","language":"eng","filename":"arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2020-11-02T00:01:26.110+01:00","recording_url":"https://cdn.media.ccc.de/events/archconf/2020/h264-sd/arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_sd.mp4","url":"https://api.media.ccc.de/public/recordings/48483","event_url":"https://api.media.ccc.de/public/events/c2db9233-db47-5725-abae-009aec97c103","conference_url":"https://api.media.ccc.de/public/conferences/arch-conf-2020"},{"size":30,"length":2768,"mime_type":"audio/opus","language":"eng","filename":"arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2020-11-02T00:01:10.155+01:00","recording_url":"https://cdn.media.ccc.de/events/archconf/2020/opus/arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_opus.opus","url":"https://api.media.ccc.de/public/recordings/48482","event_url":"https://api.media.ccc.de/public/events/c2db9233-db47-5725-abae-009aec97c103","conference_url":"https://api.media.ccc.de/public/conferences/arch-conf-2020"},{"size":91,"length":2768,"mime_type":"video/webm","language":"eng","filename":"arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2020-11-02T00:00:59.657+01:00","recording_url":"https://cdn.media.ccc.de/events/archconf/2020/webm-sd/arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/48481","event_url":"https://api.media.ccc.de/public/events/c2db9233-db47-5725-abae-009aec97c103","conference_url":"https://api.media.ccc.de/public/conferences/arch-conf-2020"},{"size":42,"length":2768,"mime_type":"audio/mpeg","language":"eng","filename":"arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2020-11-02T00:00:41.937+01:00","recording_url":"https://cdn.media.ccc.de/events/archconf/2020/mp3/arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/48480","event_url":"https://api.media.ccc.de/public/events/c2db9233-db47-5725-abae-009aec97c103","conference_url":"https://api.media.ccc.de/public/conferences/arch-conf-2020"},{"size":205,"length":2768,"mime_type":"video/webm","language":"eng","filename":"arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2020-11-02T00:00:29.120+01:00","recording_url":"https://cdn.media.ccc.de/events/archconf/2020/webm-hd/arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/48479","event_url":"https://api.media.ccc.de/public/events/c2db9233-db47-5725-abae-009aec97c103","conference_url":"https://api.media.ccc.de/public/conferences/arch-conf-2020"},{"size":118,"length":2768,"mime_type":"video/mp4","language":"eng","filename":"arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2020-11-01T22:49:20.924+01:00","recording_url":"https://cdn.media.ccc.de/events/archconf/2020/h264-hd/arch-conf-2020-6381-eng-Infrastructure_at_Arch_-_Making_servers_go_brrrrr_hd.mp4","url":"https://api.media.ccc.de/public/recordings/48457","event_url":"https://api.media.ccc.de/public/events/c2db9233-db47-5725-abae-009aec97c103","conference_url":"https://api.media.ccc.de/public/conferences/arch-conf-2020"}]}