README
Introduction
- How To Use This Guide
- Why Run Large Language Models Locally?
Understanding Large Language Models
Selecting Models
Models For Coding
- Overview of Code Llama Variations
- Other Notable Open Source Models for Coding
Installation
Evaluation
- Testing Each Model
- Evaluating Models with a Standardized Test
Best Practices
- Best Practices for Running Local LLMs
Prompts
- Collection of Prompts
- Creating a Shell Script
Advanced Usage
Additional Resources

Powered by GitBook

On this page

Best Practices

Best Practices for Running Local LLMs

This section offers best practices for running LLMs locally.

Last updated 5 months ago