{"guid":"ab3df465-a959-4dff-a44a-760b2a964376","title":"Postgres with many data","subtitle":"To MAXINT and beyond","slug":"froscon2025-3326-postgres_with_many_data","link":"https://programm.froscon.org/2025/events/3326.html","description":"Picking up the topic of previous talks about using PostgreSQL to store many data, very many data, and absurdly many data, this \ntalk wants to talk about the problems and challenges that one might experience when trying to shove all the data into PostgreSQL.\n\nMany things that are simple with small amounts of data can become headache-inducing. \nAs data grows even a simple 'select count(*)' can be unpleasantly slow. \nTaking a naive backup could easily take more than a day, and restoring such a backup is similarly time-consuming.\n We will explore the limits of where PostgreSQL can go, the limits imposed by physics, hardware, and software, \nand ideas how we can go beyond those limitations. \nWe'll also look at some performance problems and the many strategies we have to mitigate them. \nHopefully this talk will give you the confidence that PostgreSQL can grow with your data, and show you some of the options \nyou have to improve performance when your data just keeps growing and growing.\n\nLicensed to the public under http://creativecommons.org/licenses/by/4.0","original_language":"eng","persons":["Patrick Lauer"],"view_count":159,"promoted":false,"date":"2025-08-16T17:00:00.000+02:00","release_date":"2025-08-16T00:00:00.000+02:00","updated_at":"2026-02-22T12:15:08.491+01:00","tags":["3326","2025","froscon2025","Database","HS 6","froscon2025-eng","Day 1"],"length":3647,"duration":3647,"thumb_url":"https://static.media.ccc.de/media/events/froscon/2025/3326-ab3df465-a959-4dff-a44a-760b2a964376.jpg","poster_url":"https://static.media.ccc.de/media/events/froscon/2025/3326-ab3df465-a959-4dff-a44a-760b2a964376_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/froscon/2025/3326-ab3df465-a959-4dff-a44a-760b2a964376.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/froscon/2025/3326-ab3df465-a959-4dff-a44a-760b2a964376.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/froscon2025-3326-postgres_with_many_data","url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_title":"FrOSCon 2025","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025","related":[],"recordings":[{"size":274,"length":3647,"mime_type":"video/webm;codecs=av01","language":"eng","filename":"froscon2025-3326-eng-Postgres_with_many_data_av1-hd.webm","state":"new","folder":"av1-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-08-16T20:52:10.188+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2025/av1-hd/froscon2025-3326-eng-Postgres_with_many_data_av1-hd.webm","url":"https://api.media.ccc.de/public/recordings/90313","event_url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025"},{"size":55,"length":3647,"mime_type":"audio/mpeg","language":"eng","filename":"froscon2025-3326-eng-Postgres_with_many_data_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2025-08-16T19:23:02.008+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2025/mp3/froscon2025-3326-eng-Postgres_with_many_data_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/90286","event_url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025"},{"size":304,"length":3647,"mime_type":"video/webm","language":"eng","filename":"froscon2025-3326-eng-Postgres_with_many_data_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-08-16T20:24:04.415+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2025/webm-hd/froscon2025-3326-eng-Postgres_with_many_data_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/90308","event_url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025"},{"size":119,"length":3647,"mime_type":"video/webm","language":"eng","filename":"froscon2025-3326-eng-Postgres_with_many_data_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-08-16T19:51:04.885+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2025/webm-sd/froscon2025-3326-eng-Postgres_with_many_data_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/90296","event_url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025"},{"size":30,"length":3647,"mime_type":"audio/opus","language":"eng","filename":"froscon2025-3326-eng-Postgres_with_many_data_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2025-08-16T19:22:49.111+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2025/opus/froscon2025-3326-eng-Postgres_with_many_data_opus.opus","url":"https://api.media.ccc.de/public/recordings/90283","event_url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025"},{"size":111,"length":3647,"mime_type":"video/mp4","language":"eng","filename":"froscon2025-3326-eng-Postgres_with_many_data_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-08-16T19:22:28.144+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2025/h264-sd/froscon2025-3326-eng-Postgres_with_many_data_sd.mp4","url":"https://api.media.ccc.de/public/recordings/90279","event_url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025"},{"size":317,"length":3647,"mime_type":"video/mp4","language":"eng","filename":"froscon2025-3326-eng-Postgres_with_many_data_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-08-16T19:21:43.336+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2025/h264-hd/froscon2025-3326-eng-Postgres_with_many_data_hd.mp4","url":"https://api.media.ccc.de/public/recordings/90274","event_url":"https://api.media.ccc.de/public/events/ab3df465-a959-4dff-a44a-760b2a964376","conference_url":"https://api.media.ccc.de/public/conferences/froscon2025"}]}