{"guid":"yyUzJaUkdX4xt5HSCl88ow","title":"Unleashing the Power of GenAI with Edge Ecosystem Analytics and Kubernetes Orchestration","subtitle":null,"slug":"4524-unleashing-the-power-of-genai-with-edge-ecosystem-analytics-and-kubernetes-orchestration","link":"https://c3voc.de","description":"The exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall\nbusiness while maintaining **control over their data.**\n\nIn this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge.\n\nKey Topics:\n\n- Overview of **Large Language Models (LLMs)**\n- Scope for **Edge Computing** in AI revolution\n- Benefits over privacy concerns by **localization of LLMs**\n- Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics**\n- Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher \u0026 K3s**\n- Challenges while deploying **GenAI applications at the Edge**\n\nThis short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and \n **AI Agents.**\n\n\nThe exponentially growing **AI/ML** and **LLMs** advancements bring concerns about privacy, as there is a risk of data exposure to online LLMs service providers. Setting up **LLMs in-house** requires a **high computational cost** which is a major obstacle for businesses across various sectors such as Retail, Healthcare, Finance, etc. These industries seek to leverage the power of LLMs to drive **profitability** in their overall\nbusiness while maintaining **control over their data.**\n\nIn this session, we will explore the **Edge Ecosystem Analytics** and its transformative potential in **GenAI Applications**. Through seamless orchestration via **Rancher managed Kubernetes** which can help individuals overcome challenges in adopting and deploying cutting edge Gen-AI applications at the edge.\n\nKey Topics:\n\n- Overview of **Large Language Models (LLMs)**\n- Scope for **Edge Computing** in AI revolution\n- Benefits over privacy concerns by **localization of LLMs**\n- Real-world Application Showcase by leveraging **GenAI for Edge Ecosystem Analytics**\n- Integration of Retrieval Augmentation Generation (RAG) Pipeline into **Rancher \u0026 K3s**\n- Challenges while deploying **GenAI applications at the Edge**\n\nThis short talk will showcase a real-world GenAI-based application, highlighting the utilization of the RAG pipeline as well as a **data modeling pipeline** to continually improve analytic outputs and its seamless integration with **Rancher and K3s**. Attendees would learn about Rancher, K3s in managing Kubernetes deployments for GenAI applications, LLMs optimizations techniques such as **RAG,** overview of **Fine Tuning** and \n **AI Agents.**\n","original_language":"eng","persons":["Rudraksh Karpe"],"tags":["osc24","4524","2024","New Technologies"],"view_count":8,"promoted":false,"date":"2024-06-28T16:15:00.000+02:00","release_date":"2024-07-07T00:00:00.000+02:00","updated_at":"2025-01-25T22:30:08.000+01:00","length":505,"duration":505,"thumb_url":"https://static.media.ccc.de/media/events/osc/2024/4524-yyUzJaUkdX4xt5HSCl88ow.jpg","poster_url":"https://static.media.ccc.de/media/events/osc/2024/4524-yyUzJaUkdX4xt5HSCl88ow_preview.jpg","timeline_url":"https://static.media.ccc.de/media/events/osc/2024/4524-yyUzJaUkdX4xt5HSCl88ow.timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/events/osc/2024/4524-yyUzJaUkdX4xt5HSCl88ow.thumbnails.vtt","frontend_link":"https://media.ccc.de/v/4524-unleashing-the-power-of-genai-with-edge-ecosystem-analytics-and-kubernetes-orchestration","url":"https://api.media.ccc.de/public/events/yyUzJaUkdX4xt5HSCl88ow","conference_title":"openSUSE Conference 2024","conference_url":"https://api.media.ccc.de/public/conferences/osc24","related":[],"recordings":[{"size":175,"length":505,"mime_type":"video/webm","language":"eng","filename":"osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2024-07-12T08:16:54.667+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2024/webm-hd/osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/78403","event_url":"https://api.media.ccc.de/public/events/yyUzJaUkdX4xt5HSCl88ow","conference_url":"https://api.media.ccc.de/public/conferences/osc24"},{"size":63,"length":505,"mime_type":"video/webm","language":"eng","filename":"osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2024-07-08T13:59:49.190+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2024/webm-sd/osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/78327","event_url":"https://api.media.ccc.de/public/events/yyUzJaUkdX4xt5HSCl88ow","conference_url":"https://api.media.ccc.de/public/conferences/osc24"},{"size":38,"length":505,"mime_type":"video/mp4","language":"eng","filename":"osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2024-07-07T22:45:54.482+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2024/h264-sd/osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_sd.mp4","url":"https://api.media.ccc.de/public/recordings/78286","event_url":"https://api.media.ccc.de/public/events/yyUzJaUkdX4xt5HSCl88ow","conference_url":"https://api.media.ccc.de/public/conferences/osc24"},{"size":4,"length":505,"mime_type":"audio/opus","language":"eng","filename":"osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_opus.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2024-07-07T19:14:02.829+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2024/opus/osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_opus.opus","url":"https://api.media.ccc.de/public/recordings/78272","event_url":"https://api.media.ccc.de/public/events/yyUzJaUkdX4xt5HSCl88ow","conference_url":"https://api.media.ccc.de/public/conferences/osc24"},{"size":7,"length":505,"mime_type":"audio/mpeg","language":"eng","filename":"osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_mp3.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2024-07-07T19:13:45.327+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2024/mp3/osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_mp3.mp3","url":"https://api.media.ccc.de/public/recordings/78271","event_url":"https://api.media.ccc.de/public/events/yyUzJaUkdX4xt5HSCl88ow","conference_url":"https://api.media.ccc.de/public/conferences/osc24"},{"size":95,"length":505,"mime_type":"video/mp4","language":"eng","filename":"osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2024-07-07T18:19:33.493+02:00","recording_url":"https://cdn.media.ccc.de/events/osc/2024/h264-hd/osc24-4524-eng-Unleashing_the_Power_of_GenAI_with_Edge_Ecosystem_Analytics_and_Kubernetes_Orchestration_hd.mp4","url":"https://api.media.ccc.de/public/recordings/78264","event_url":"https://api.media.ccc.de/public/events/yyUzJaUkdX4xt5HSCl88ow","conference_url":"https://api.media.ccc.de/public/conferences/osc24"}]}