Llm inference api

AnythingLLM

All-in-one private LLM and RAG desktop app for Mac, Windows, and Linux

Document Q&A

Open

23,170

259

4.4

Released 1y ago

100% Free

Share

Francisco Bischoff

🙏 33 karma

Apr 15, 2024

AnythingLLM is easy to use, and allows us to build private databases using several (any) kinds of media (text, pdf, audio, etc) and use it as a source of knowledge for any LLM you might wonder to experiment!

334 Reply Share Delete Report

Oracle

Predict the future with AI forecasts.

Divination

Open

6,681

160

2.6

Released 2y ago

Free + from $10/mo

Share

Mary McLain (Meg)

🙏 14 karma

Jun 19, 2023

Wow! Gives specific predictions along with factual justification for them. I was blown away!

Reply Share Delete Report

LLMChat

Chat with top AI models in a clean, private interface.

Chatting

Open

9,914

109

3.0

Released 1y ago

100% Free

Share

kanawati

🙏 1,060 karma

Feb 9, 2025

Prefect Idea! I love it. I just wish to keep up the good work

92 Reply Share Delete Report

LLaMA

Open-source AI models for customization and deployment.

Large Language Models

Open

4,552

71

3.6

v4 released 6mo ago

No pricing

Share

Tealgreen

🙏 265 karma

Apr 7, 2025

A huge disappointment. It fails standard tasks that Sonnet 3.5 completes with no issue. I’ll be skipping this version.

53 Reply Share Delete Report

LLMStack

Create AI apps and chatbots in minutes without coding

Apps

Open

2,328

61

3.0

Released 2y ago

100% Free

Share

Pocket LLM

Accelerate AI training with hash-based algorithms.

Document search

Open

5,063

56

Released 2y ago

No pricing

Share

PrivateLLM

Your private AI chatbot for Apple devices, offline and secure.

Chatting

Open

6,555

49

5.0

Released 2y ago

Share

brian croteau

🙏 29 karma

Feb 26, 2025

A fantastic tool for IPhone 16 Pro and other mobile phones. They just released the full suite of Dolphin 🐬 3.0 models and I am impressed by the variety and functionality. Slowed the bigger you get in the parameter count but worth it for something able to be run in your pocket with no cloud calls. Cheap too! Good product.

325 Reply Share Delete Report

Lmql

Supercharge your LLM prompting with code

Models

Open

3,879

37

5.0

Released 2y ago

100% Free

Share

Rustle

Aug 8, 2023

I have used this for several personal assistant applications and it works amazingly. Obviously it is still restricted to the flaws of any model you are using it with, but the ability to constrain prompts is incredibly helpful (especially when it comes to getting things like JSON format from the AI).

Reply Share Delete Report