{"guid":"X7iAfbQWjNDM--j2p7i62w","title":"Using openSUSE Leap as base layer operating system for AI/ML container orchestration using SUSE Rancher.","subtitle":"A short talk showcasing how openSUSE Leap can be used as a base layer operating system for the containerization of AI/ML as well as GenAI workloads.","slug":"5025-using-opensuse-leap-as-base-layer-operating-system-for-ai-ml-container-orchestration-using-suse-rancher","link":"https://c3voc.de","description":"The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall business while maintaining **control over their data.**\n\nIn this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications** through seamless orchestration via **openSUSE Leap** and **Rancher-managed Kubernetes**. This approach helps overcome challenges in adopting and deploying cutting-edge GenAI applications securely and efficiently at the edge.\n\nKey Topics:\n\n- Overview of **Large Language Models (LLMs)**\n- Scope for **Edge Computing** in AI revolution\n- Benefits over privacy concerns by **localization of LLMs**\n- Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics**\n- Integration of Retrieval-Augmented Generation (**RAG**) Pipeline into **Rancher \u0026 K3s**\n- Challenges while deploying **GenAI applications at the Edge**\n\nThis short talk will showcase a real-world GenAI-based application, highlighting the utilization of the **RAG pipeline** as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees will learn about **Rancher and K3s** in managing Kubernetes deployments for GenAI applications, LLM optimization techniques such as **RAG**, overview of **Fine Tuning** and **AI Agents**.\n\nLicensed to the public under https://creativecommons.org/licenses/by-sa/4.0/","original_language":"eng","persons":["Rudraksh Karpe"],"tags":["5025","2025","osc25","Cloud, Containers, Virtualization","galerie","osc25-eng","Day 2"],"view_count":17,"promoted":false,"date":"2025-06-27T16:15:00.000+02:00","release_date":"2025-06-28T00:00:00.000+02:00","updated_at":"2025-11-16T22:30:06.923+01:00","length":1481,"duration":1481,"thumb_url":"https://static.media.ccc.de/media/events/osc/2025/5025-X7iAfbQWjNDM--j2p7i62w.jpg","poster_url":"https://static.media.ccc.de/media/events/osc/2025/5025-X7iAfbQWjNDM--j2p7i62w_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/osc/2025/5025-X7iAfbQWjNDM--j2p7i62w.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/osc/2025/5025-X7iAfbQWjNDM--j2p7i62w.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/5025-using-opensuse-leap-as-base-layer-operating-system-for-ai-ml-container-orchestration-using-suse-rancher","url":"https://api.media.ccc.de/public/events/X7iAfbQWjNDM--j2p7i62w","conference_title":"openSUSE Conference 2025","conference_url":"https://api.media.ccc.de/public/conferences/osc25","related":[],"recordings":[{"size":14,"length":1481,"mime_type":"audio/opus","language":"eng","filename":"osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2025-06-28T13:58:15.577+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/opus/osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_opus.opus","url":"https://api.media.ccc.de/public/recordings/88517","event_url":"https://api.media.ccc.de/public/events/X7iAfbQWjNDM--j2p7i62w","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":52,"length":1481,"mime_type":"video/webm","language":"eng","filename":"osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-07-01T14:58:55.732+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/webm-sd/osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/88773","event_url":"https://api.media.ccc.de/public/events/X7iAfbQWjNDM--j2p7i62w","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":128,"length":1481,"mime_type":"video/webm","language":"eng","filename":"osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-07-01T14:57:59.994+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/webm-hd/osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/88772","event_url":"https://api.media.ccc.de/public/events/X7iAfbQWjNDM--j2p7i62w","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":22,"length":1481,"mime_type":"audio/mpeg","language":"eng","filename":"osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2025-06-28T13:58:30.592+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/mp3/osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/88521","event_url":"https://api.media.ccc.de/public/events/X7iAfbQWjNDM--j2p7i62w","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":43,"length":1481,"mime_type":"video/mp4","language":"eng","filename":"osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2025-06-28T13:58:12.006+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/h264-sd/osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_sd.mp4","url":"https://api.media.ccc.de/public/recordings/88516","event_url":"https://api.media.ccc.de/public/events/X7iAfbQWjNDM--j2p7i62w","conference_url":"https://api.media.ccc.de/public/conferences/osc25"},{"size":170,"length":1481,"mime_type":"video/mp4","language":"eng","filename":"osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2025-06-28T13:05:42.203+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2025/h264-hd/osc25-5025-eng-Using_openSUSE_Leap_as_base_layer_operating_system_for_AI_ML_container_orchestration_using_SUSE_Rancher_hd.mp4","url":"https://api.media.ccc.de/public/recordings/88454","event_url":"https://api.media.ccc.de/public/events/X7iAfbQWjNDM--j2p7i62w","conference_url":"https://api.media.ccc.de/public/conferences/osc25"}]}