OpenAssistant_API_Pythia_12B
Creating and Using an Open Assistant API locally (Pythia 12B GPT model)
README
OpenAssistant_API_Pythia_12B
Creating and Using an Open Assistant API locally (Pythia 12B GPT model)
- OASST_tutorial.ipynb - Breaks down how everything works.
- oasstapiv1.py - Host a local API for the Open Assistant Pythia 12B model.
- chat-oasst-api.py - File to interact with the local API. You will need to modify
SERVER_IP
Video tutorial:
MongoDB - Build AI That Scales

