Home

Welcome to the embabel-llm-database wiki!

What is the embabel-llm-database?

A simple rest server that hosts a repository of LLM Models and their providers, as well as some basic stats about each one. The server is maintained by an embabel-agent that retrieves updates from various sources.

Getting Started

Prerequisites

• ollama https://ollama.com/download
• llama3.1:8b ollama pull llama3.1:8b

Running

1. clone the repository https://github.com/embabel/embabel-llm-database
2. compile mvn clean package
3. run the server java -jar embabel-database-server/target/embabel-database-server-${VERSION}.jar
4. test curl localhost:8000/api/v1/models