State of AI - Online (free event)
Harnessing Large Language Models Locally
Philipp Bauer
The landscape of freely available Large Language Models (LLMs) has seen remarkable advancements in performance. Through the utilization of quantization techniques, the possibility of running these models on standard computers, without the need for high-end accelerator cards, has become a reality. Join us in this session to explore the motivations behind running LLMs on your own machine, and gain practical insights into the process of deploying and leveraging language models within your projects.
This event took place on Wednesday, October 25, 2023.
Download Slides
Watch the Video Recording
Presenter: Philipp Bauer - Sr. Software Developer
When: Wednesday, Oct 25, 2023 12:00pm Central Time (CT)
Duration: 75 minutes (approximately)
Join us for an introduction into the use of local LLMs with Philipp Bauer. This talk will cover the basics of deploying and using an LLM on your own machine, as well as motivations behind using a local LLM and some of the challenges and pitfalls that come with it.
During this session we will make sense of the “zoo” of available LLMs and touch on the pros and cons of some of them, look at recent developments in the field and set up a C#/.NET project that can leverage a language model to get you started building your own AI applications. We will also explore some of the most important parameters that influence the models’ performance and how to tune them for your specific use case.
Whether you are new to using LLMs or have been using them for a while, this talk will give you a better understanding of what is possible using LLMs directly instead of using a cloud service. Don’t miss this chance to learn from Philipp’s experience and ask questions about your own projects.