{"guid":"c69c5de6-5ab6-470a-a5cc-6c0699a47de1","title":"Huey: Pivoting hundreds of millions of rows in the Browser","subtitle":"Blazing fast in-browser Analytics based on DuckDB/WASM","slug":"froscon2024-3023-huey_pivoting_hundreds_of_millions_of_rows_in_the_browser","link":"https://programm.froscon.org/2024/events/3023.html","description":"Huey is a browser-based application that lets you explore and analyze large local datasets with an interactive pivot table. Huey is blazing fast, courtesy of DuckDB / WASM. It can load data in .csv, .parquet or JSON format, and it can also open DuckDB database files. \n\nHuey's key features are:\n\n- An intuitive and responsive pivot table that supports filtering and (sub)totals\n- Supports many different aggregate functions for reporting and data exploration\n- Automatic breakdown of date/time columns into separate parts (year, month, quarter etc) for reporting\n- Supports reading .parquet, .csv, .json and .duckdb database files. (Support for reading MS - \nExcel .xlsx files and .sqlite is planned)\n- Export of results and/or SQL queries to file or clipboard\n- Blazing fast, even for large files - courtesy of DuckDB\n- Zero install. Download or checkout the source tree, and open src/index.html in your browser! No server required.\n\nNote: although Huey can run locally, there is nothing that keeps you from deploying it in a webserver if you want to.\n\nDuckDB / WASM enables web developers to build light-weight OLAP and analytics applications directly in the browser. Thanks to DuckDB, performance is blazing fast, while memory consumption remains modest. In this lecture I will demonstrate Huey's features and explain how it was build using DuckDB / WASM\n\nDuckDB as well as Huey are open source under a permissive MIT license. Find Huey source on github: https://github.com/rpbouman/huey\nLive demo: https://rpbouman.github.io/huey/src/index.html","original_language":"eng","persons":["Roland Bouman"],"view_count":122,"promoted":false,"date":"2024-08-17T10:00:00.000+02:00","release_date":"2024-08-17T00:00:00.000+02:00","updated_at":"2026-02-24T14:45:07.725+01:00","tags":["froscon2024","3023","2024","Database"],"length":3411,"duration":3411,"thumb_url":"https://static.media.ccc.de/media/events/froscon/2024/3023-c69c5de6-5ab6-470a-a5cc-6c0699a47de1.jpg","poster_url":"https://static.media.ccc.de/media/events/froscon/2024/3023-c69c5de6-5ab6-470a-a5cc-6c0699a47de1_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/froscon/2024/3023-c69c5de6-5ab6-470a-a5cc-6c0699a47de1.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/froscon/2024/3023-c69c5de6-5ab6-470a-a5cc-6c0699a47de1.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/froscon2024-3023-huey_pivoting_hundreds_of_millions_of_rows_in_the_browser","url":"https://api.media.ccc.de/public/events/c69c5de6-5ab6-470a-a5cc-6c0699a47de1","conference_title":"FrOSCon 2024","conference_url":"https://api.media.ccc.de/public/conferences/froscon2024","related":[],"recordings":[{"size":358,"length":3411,"mime_type":"video/webm","language":"eng","filename":"froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2024-08-17T15:33:02.623+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2024/webm-hd/froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/78699","event_url":"https://api.media.ccc.de/public/events/c69c5de6-5ab6-470a-a5cc-6c0699a47de1","conference_url":"https://api.media.ccc.de/public/conferences/froscon2024"},{"size":122,"length":3411,"mime_type":"video/webm","language":"eng","filename":"froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2024-08-17T14:48:05.119+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2024/webm-sd/froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/78691","event_url":"https://api.media.ccc.de/public/events/c69c5de6-5ab6-470a-a5cc-6c0699a47de1","conference_url":"https://api.media.ccc.de/public/conferences/froscon2024"},{"size":119,"length":3411,"mime_type":"video/mp4","language":"eng","filename":"froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2024-08-17T13:43:57.840+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2024/h264-sd/froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_sd.mp4","url":"https://api.media.ccc.de/public/recordings/78642","event_url":"https://api.media.ccc.de/public/events/c69c5de6-5ab6-470a-a5cc-6c0699a47de1","conference_url":"https://api.media.ccc.de/public/conferences/froscon2024"},{"size":29,"length":3411,"mime_type":"audio/opus","language":"eng","filename":"froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2024-08-17T13:35:03.348+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2024/opus/froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_opus.opus","url":"https://api.media.ccc.de/public/recordings/78636","event_url":"https://api.media.ccc.de/public/events/c69c5de6-5ab6-470a-a5cc-6c0699a47de1","conference_url":"https://api.media.ccc.de/public/conferences/froscon2024"},{"size":52,"length":3411,"mime_type":"audio/mpeg","language":"eng","filename":"froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2024-08-17T13:34:41.567+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2024/mp3/froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/78635","event_url":"https://api.media.ccc.de/public/events/c69c5de6-5ab6-470a-a5cc-6c0699a47de1","conference_url":"https://api.media.ccc.de/public/conferences/froscon2024"},{"size":522,"length":3411,"mime_type":"video/mp4","language":"eng","filename":"froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2024-08-17T13:29:19.687+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2024/h264-hd/froscon2024-3023-eng-Huey_Pivoting_hundreds_of_millions_of_rows_in_the_Browser_hd.mp4","url":"https://api.media.ccc.de/public/recordings/78630","event_url":"https://api.media.ccc.de/public/events/c69c5de6-5ab6-470a-a5cc-6c0699a47de1","conference_url":"https://api.media.ccc.de/public/conferences/froscon2024"}]}