{"guid":"313f600d-7418-4821-99fd-3d788de500ae","title":"Den Flaschenhals in einer langsamen Pipe optimieren durch Parallelisierung","subtitle":null,"slug":"froscon2019-2407-den_flaschenhals_in_einer_langsamen_pipe_optimieren_durch_parallelisierung","link":"https://programm.froscon.de/2019/events/2407.html","description":"Neues aus meiner Shell-Küche: in einem Skript zum Disassemblieren eines einfachen seriellen Protokolls mit Hilfe von “sed” werden die Input-Daten immer größer und sed braucht immer länger – inzwischen bei letzten Messdaten über 20 Minuten! Das muss doch auch schneller gehen?!\n\nHeute haben (fast) alle Rechner mehrere CPU-Cores und (Hyper)Threads. Warum also läuft das zu langsame sed nicht parallel auf allen verfügbaren CPUs und vervielfacht so den Durchsatz des Tools ?\n\nKlingt einfach, ist aber zunächt gar nicht sooo trivial alleine mit Shell-Mitteln. Die Probleme werden gezeigt, und wie man mit ein bissl Aufwand das alles in den Griff bekommen kann.\n\nUnd dann gibt es noch ein tolles Kommandozeilen-Tool, welches genau diese Parallelisierung eines Programms wie sed in einer Pipe mit allen seinen Problemen perfekt löst, ganz ohne die grauen Haare der “nur-in-Shell-Lösung”.","original_language":"deu","persons":["Harald König"],"tags":["froscon2019","2407","other"],"view_count":142,"promoted":false,"date":"2019-08-10T00:00:00.000+02:00","release_date":"2019-08-10T02:00:00.000+02:00","updated_at":"2026-01-21T10:00:11.878+01:00","length":2795,"duration":2795,"thumb_url":"https://static.media.ccc.de/media/events/froscon/2019/2407-hd.jpg","poster_url":"https://static.media.ccc.de/media/events/froscon/2019/2407-hd_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/froscon/2019/2407-hd.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/froscon/2019/2407-hd.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/froscon2019-2407-den_flaschenhals_in_einer_langsamen_pipe_optimieren_durch_parallelisierung","url":"https://api.media.ccc.de/public/events/313f600d-7418-4821-99fd-3d788de500ae","conference_title":"FrOSCon 2019","conference_url":"https://api.media.ccc.de/public/conferences/froscon2019","related":[{"event_id":7265,"event_guid":"480a501f-cb98-4af1-bbab-273c383e2080","weight":8},{"event_id":7268,"event_guid":"7007a0ab-a90c-4c5a-8ff2-e9faa6eba646","weight":9},{"event_id":7276,"event_guid":"9ac982ee-aeaa-431d-9622-527a14e8023c","weight":6},{"event_id":7279,"event_guid":"967fa2a1-265f-47c1-90b2-ec8dba08b328","weight":8},{"event_id":7281,"event_guid":"bb5b04bd-9599-4d93-bd12-c779f381cf5e","weight":9},{"event_id":7296,"event_guid":"b8424140-1639-44f7-a19a-67af58ad61e9","weight":8},{"event_id":7301,"event_guid":"6413e0b9-d88c-4a3c-a0a5-d4b3a0224a98","weight":10},{"event_id":7332,"event_guid":"50ad5991-1b2f-4a92-ba87-dec6456f085a","weight":10},{"event_id":7348,"event_guid":"d826f086-8ce2-4925-9dfa-b02db91c73ca","weight":8}],"recordings":[{"size":143,"length":2795,"mime_type":"video/mp4","language":"deu","filename":"froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2019-08-10T13:15:56.509+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2019/h264-hd/froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_hd.mp4","url":"https://api.media.ccc.de/public/recordings/36599","event_url":"https://api.media.ccc.de/public/events/313f600d-7418-4821-99fd-3d788de500ae","conference_url":"https://api.media.ccc.de/public/conferences/froscon2019"},{"size":42,"length":2795,"mime_type":"audio/mpeg","language":"deu","filename":"froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2019-08-10T17:52:34.957+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2019/mp3/froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/36610","event_url":"https://api.media.ccc.de/public/events/313f600d-7418-4821-99fd-3d788de500ae","conference_url":"https://api.media.ccc.de/public/conferences/froscon2019"},{"size":91,"length":2795,"mime_type":"video/webm","language":"deu","filename":"froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2019-08-10T17:53:37.346+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2019/webm-sd/froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/36612","event_url":"https://api.media.ccc.de/public/events/313f600d-7418-4821-99fd-3d788de500ae","conference_url":"https://api.media.ccc.de/public/conferences/froscon2019"},{"size":68,"length":2795,"mime_type":"video/mp4","language":"deu","filename":"froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2019-08-10T17:54:45.200+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2019/h264-sd/froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_sd.mp4","url":"https://api.media.ccc.de/public/recordings/36615","event_url":"https://api.media.ccc.de/public/events/313f600d-7418-4821-99fd-3d788de500ae","conference_url":"https://api.media.ccc.de/public/conferences/froscon2019"},{"size":28,"length":2795,"mime_type":"audio/opus","language":"deu","filename":"froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2019-08-10T18:04:35.136+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2019/opus/froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_opus.opus","url":"https://api.media.ccc.de/public/recordings/36630","event_url":"https://api.media.ccc.de/public/events/313f600d-7418-4821-99fd-3d788de500ae","conference_url":"https://api.media.ccc.de/public/conferences/froscon2019"},{"size":234,"length":2795,"mime_type":"video/webm","language":"deu","filename":"froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2019-08-10T18:05:10.580+02:00","recording_url":"https://cdn.media.ccc.de/events/froscon/2019/webm-hd/froscon2019-2407-deu-Den_Flaschenhals_in_einer_langsamen_Pipe_optimieren_durch_Parallelisierung_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/36631","event_url":"https://api.media.ccc.de/public/events/313f600d-7418-4821-99fd-3d788de500ae","conference_url":"https://api.media.ccc.de/public/conferences/froscon2019"}]}