{"guid":"5d3a6fa9-3034-56f1-b9e8-b233194de3aa","title":"How do models like ChatGPT (LLM) work, can you hack them and run them offline?","subtitle":null,"slug":"2025-186-how-do-models-like-chatgpt-llm-work-can-you-hack-them-and-run-them-offline-","link":"https://pretalx.hackerhotel.nl/2025/talk/GR78YQ/","description":"What is an LLM? Can you run it yourself? Can you hack it?\n\nThis session will explain high-level how an LLM works, how you can run this yourself (maybe for privacy reasons), Coding with LLMs and the hacking possibilities of these AI systems. Expect many demos and hopefully useful tips and tricks, so you can directly try all this stuff out yourself.\n\nKeyword: Supervised Learning and Reenforced Learning, Hugging Face, Quantization, Ollama, open-webui, Prompt Hacking, Tokens, Context Length\n\nI will explain basics of Machine Learning concepts\nHow these ML concepts have created LLMs and how they somewhat work\nWhat is needed to run LLMs (Inference) and how you can run it your self\nhow to test various LLMs\nprompt hacking\nusing LLMs for coding\nMany live demos\n\nLicensed to the public under http://creativecommons.org/licenses/by/4.0","original_language":"eng","persons":["Anykey"],"view_count":786,"promoted":false,"date":"2025-02-16T11:00:00.000+01:00","release_date":"2025-02-16T00:00:00.000+01:00","updated_at":"2026-04-21T23:30:05.847+02:00","tags":["186","2025","hackerhotel2025","Talks","Mission Critical Room (Rembrandt)","hackerhotel2025-eng","Day 3"],"length":3510,"duration":3510,"thumb_url":"https://static.media.ccc.de/media/events/hackerhotel/2025/186-5d3a6fa9-3034-56f1-b9e8-b233194de3aa.jpg","poster_url":"https://static.media.ccc.de/media/events/hackerhotel/2025/186-5d3a6fa9-3034-56f1-b9e8-b233194de3aa_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/hackerhotel/2025/186-5d3a6fa9-3034-56f1-b9e8-b233194de3aa.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/hackerhotel/2025/186-5d3a6fa9-3034-56f1-b9e8-b233194de3aa.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/2025-186-how-do-models-like-chatgpt-llm-work-can-you-hack-them-and-run-them-offline-","url":"https://api.media.ccc.de/public/events/5d3a6fa9-3034-56f1-b9e8-b233194de3aa","conference_title":"HackerHotel 2025","conference_url":"https://api.media.ccc.de/public/conferences/hackerhotel2025","related":[],"recordings":[{"size":53,"length":3510,"mime_type":"audio/mpeg","language":"eng","filename":"hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2025-02-16T15:59:56.279+01:00","recording_url":"https://cdn.media.ccc.de/events/hackerhotel/2025/mp3/hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/84945","event_url":"https://api.media.ccc.de/public/events/5d3a6fa9-3034-56f1-b9e8-b233194de3aa","conference_url":"https://api.media.ccc.de/public/conferences/hackerhotel2025"},{"size":434,"length":3510,"mime_type":"video/webm","language":"eng","filename":"hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-02-22T13:45:16.450+01:00","recording_url":"https://cdn.media.ccc.de/events/hackerhotel/2025/webm-hd/hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/84948","event_url":"https://api.media.ccc.de/public/events/5d3a6fa9-3034-56f1-b9e8-b233194de3aa","conference_url":"https://api.media.ccc.de/public/conferences/hackerhotel2025"},{"size":128,"length":3510,"mime_type":"video/webm","language":"eng","filename":"hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-02-22T12:47:58.042+01:00","recording_url":"https://cdn.media.ccc.de/events/hackerhotel/2025/webm-sd/hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/84947","event_url":"https://api.media.ccc.de/public/events/5d3a6fa9-3034-56f1-b9e8-b233194de3aa","conference_url":"https://api.media.ccc.de/public/conferences/hackerhotel2025"},{"size":150,"length":3510,"mime_type":"video/mp4","language":"eng","filename":"hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-02-22T09:32:38.216+01:00","recording_url":"https://cdn.media.ccc.de/events/hackerhotel/2025/h264-sd/hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_sd.mp4","url":"https://api.media.ccc.de/public/recordings/84946","event_url":"https://api.media.ccc.de/public/events/5d3a6fa9-3034-56f1-b9e8-b233194de3aa","conference_url":"https://api.media.ccc.de/public/conferences/hackerhotel2025"},{"size":35,"length":3510,"mime_type":"audio/opus","language":"eng","filename":"hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2025-02-22T09:32:27.372+01:00","recording_url":"https://cdn.media.ccc.de/events/hackerhotel/2025/opus/hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_opus.opus","url":"https://api.media.ccc.de/public/recordings/84944","event_url":"https://api.media.ccc.de/public/events/5d3a6fa9-3034-56f1-b9e8-b233194de3aa","conference_url":"https://api.media.ccc.de/public/conferences/hackerhotel2025"},{"size":753,"length":3510,"mime_type":"video/mp4","language":"eng","filename":"hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-02-22T08:50:00.660+01:00","recording_url":"https://cdn.media.ccc.de/events/hackerhotel/2025/h264-hd/hackerhotel2025-186-eng-How_do_models_like_ChatGPT_LLM_work_can_you_hack_them_and_run_them_offline_hd.mp4","url":"https://api.media.ccc.de/public/recordings/84943","event_url":"https://api.media.ccc.de/public/events/5d3a6fa9-3034-56f1-b9e8-b233194de3aa","conference_url":"https://api.media.ccc.de/public/conferences/hackerhotel2025"}]}