📄️ Quick Start
LlamaEdge is a suite of component libraries and command line tools for developers to embed and run LLMs in their own apps. The best way to quickly experience LlamaEdge is to use easy-to-use utilities built on top of it.
📄️ LlamaEdge step-by-step
Let's dive into a simple and practical tutorial on getting started with LlamaEdge, focusing on how to use a Command Line Interface (CLI) installer to run a model, along with some useful WasmEdge commands. This guide can be adjusted and applied to run Llama 2 series of models, tailored to give you a hands-on approach to running your large language model with LlamaEdge.
📄️ Calling external tools
Tool calling is one of the truly "LLM native" interaction modes that has never existed before.
📄️ API Reference
Introduction
🗃️ Ecosystem apps
8 items
🗃️ Long-term memory and knowledge
4 items
📄️ Use LlamaEdge in Docker
You can run all the commands in this document without any change on any machine with the latest Docker and at least 8GB of RAM available to the container.
📄️ Use LlamaEdge in Kubernetes
Coming soon.