This page contains programs, libraries, and executable type things for ai, including docker images, ollama builds etc.
| Program | Description | Rating |
|---|---|---|
| vllm the easy way | lets you install vllm via docker | N/A |
| Jan | My BEST happy openai clone with local models. More stable than lmstudio. | 5 |
| anythingLLM | Lets you use RAG etc. with llm a bit hard to use however | 4 |
| strix halo toolboxes | Lets you build stuff on framework desktops or those using the strix halo amd pc. | 5 |
| amdgpu_top | see what the heck your expensive amd framework gpu is doing | 5 |
| selfhost_llm | helps you calculate which models will work with your gpu | 5 |
| openwebui | self-hosted ai model web search interface | 5 |