{"guid":"ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","title":"Image generative AI - FOSS only","subtitle":null,"slug":"image-generative-ai-foss-only","link":"https://sessions.hack-mas.at/event/w4DZtGfeNK86AGbhr/image-generative-ai-foss-only","description":"Try out open source image generation - and learn how to control AI magic. No prior knowlege needed. Bring ideas on what you want to generate.First theory / terminology you'll need for the toolsPropriety tools and why they suckThe 3 major base-models SD1.5, SDXL and FLUX.1/SD3 - diffusion vs flow modelsELI5: latent spaces, u-nets, [un]CLIP, VAE, cfg-scale, samplers and schedulersThen I'll show you how to use the 2 major web UIs:The beginner tool a1111 stable diffusion web uiThe pro tool comfyuiFast view over other tools that I haven't triedThen I'll explain what you can customize - with example workflows in comfyui    Models: LoRAs - low rank adapters - diff/patches to base models for generation guidance, i.e. pose, canny edge, styles, concepts, etc.    IPAdapter: Transfer styles, faces and do per-layer-prompting    Hyper/turbo models: Generate 20 1kx1k images per second on a 4090    Conditioning: unCLIP use pictures as prompt. Latent space walks + Different CLIPs for different layersInitialization: Start from a (masked) image - inpainting, outpainting, overpainting, refining, transformingSpecial models for upscaling (SUPIR) and animation (AnimateDiff)Bring a laptop / tablet / phone if you want to try it. I'll rent a 3090/4090 and provide you a beginner setup for at least 20h during/after the talk.A matrix channel / mastodon hashtag for AI art would be cool. Maybe we can do a contest / exhibition?Slides: https://schickmas.at/2dd2f1cbd7c3","original_language":"eng","persons":["rnbwdsh"],"tags":["hackmas2024","245326662","2024",""],"view_count":229,"promoted":false,"date":"2024-08-30T19:30:00.000+02:00","release_date":"2024-08-31T00:00:00.000+02:00","updated_at":"2026-04-01T23:00:05.475+02:00","length":3363,"duration":3363,"thumb_url":"https://static.media.ccc.de/media/events/hackmas/2024/245326662-ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa.jpg","poster_url":"https://static.media.ccc.de/media/events/hackmas/2024/245326662-ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/hackmas/2024/245326662-ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/hackmas/2024/245326662-ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/image-generative-ai-foss-only","url":"https://api.media.ccc.de/public/events/ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","conference_title":"Hack ma's Castle 2024","conference_url":"https://api.media.ccc.de/public/conferences/hackmas2024","related":[],"recordings":[{"size":487,"length":3363,"mime_type":"video/webm","language":"eng","filename":"hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2024-08-31T11:34:03.817+02:00","recording_url":"https://cdn.media.ccc.de/events/hackmas/2024/webm-hd/hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/79554","event_url":"https://api.media.ccc.de/public/events/ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","conference_url":"https://api.media.ccc.de/public/conferences/hackmas2024"},{"size":141,"length":3363,"mime_type":"video/webm","language":"eng","filename":"hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2024-08-31T11:11:58.233+02:00","recording_url":"https://cdn.media.ccc.de/events/hackmas/2024/webm-sd/hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/79551","event_url":"https://api.media.ccc.de/public/events/ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","conference_url":"https://api.media.ccc.de/public/conferences/hackmas2024"},{"size":157,"length":3363,"mime_type":"video/mp4","language":"eng","filename":"hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2024-08-31T10:47:52.408+02:00","recording_url":"https://cdn.media.ccc.de/events/hackmas/2024/h264-sd/hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_sd.mp4","url":"https://api.media.ccc.de/public/recordings/79544","event_url":"https://api.media.ccc.de/public/events/ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","conference_url":"https://api.media.ccc.de/public/conferences/hackmas2024"},{"size":35,"length":3363,"mime_type":"audio/opus","language":"eng","filename":"hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2024-08-31T10:39:41.298+02:00","recording_url":"https://cdn.media.ccc.de/events/hackmas/2024/opus/hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_opus.opus","url":"https://api.media.ccc.de/public/recordings/79543","event_url":"https://api.media.ccc.de/public/events/ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","conference_url":"https://api.media.ccc.de/public/conferences/hackmas2024"},{"size":51,"length":3363,"mime_type":"audio/mpeg","language":"eng","filename":"hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2024-08-31T10:39:21.762+02:00","recording_url":"https://cdn.media.ccc.de/events/hackmas/2024/mp3/hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/79542","event_url":"https://api.media.ccc.de/public/events/ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","conference_url":"https://api.media.ccc.de/public/conferences/hackmas2024"},{"size":667,"length":3363,"mime_type":"video/mp4","language":"eng","filename":"hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2024-08-31T10:39:18.185+02:00","recording_url":"https://cdn.media.ccc.de/events/hackmas/2024/h264-hd/hackmas2024-245326662-eng-Image_generative_AI_-_FOSS_only_hd.mp4","url":"https://api.media.ccc.de/public/recordings/79541","event_url":"https://api.media.ccc.de/public/events/ee03c2d6-c1d3-5ac8-87f0-df5ce3bef3fa","conference_url":"https://api.media.ccc.de/public/conferences/hackmas2024"}]}