📄️ Quick start with LLM models
LlamaEdge is a suite of component libraries and command line tools for developers to embed and run LLMs in their own apps. The best way to quickly experience LlamaEdge is to use easy-to-use utilities built on top of it.
📄️ Start an OpenAI compatible API server
LlamaEdge support running LLMs along with embbedding models, allowing you to start a drop-in replacement for OpenAI API.
📄️ Calling external tools
Tool calling is one of the truly "LLM native" interaction modes that has never existed before.
📄️ API Reference
Introduction
🗃️ Long-term memory and knowledge
4 items