Groq Chat ๐๐ฌ
GroqChat: Local ChatGPT-like environment in your browser using best open model LLama 3.1 Series on the Grow fastest inference engine.
README
Groq Chat ๐๐ฌ
Groq Chat is a lightning-fast, browser-based chat interface for language models powered by Groq's LPU (Language Processing Unit). Experience ChatGPT-like conversations using Meta's LLAMA 3.1 series, with enhanced privacy and productivity features.
๐ Features
- ๐ง Powered by Groq's LPU for ultra-fast language model inference
- ๐ค Access to Meta's LLAMA 3.1 series models (405B, 70B, 8B parameters)
- ๐ Privacy-focused: Runs entirely in your browser, no server-side data storage
- ๐ RAG support for web page URLs: Attach and crawl web pages for context-aware conversations
- ๐๏ธ Speech-to-text functionality for voice interactions
- ๐ Edit messages and branch conversations
- ๐พ Save and manage conversation history locally
- ๐๏ธ Delete conversations as needed
- ๐ No login required - just bring your Groq API key
๐ Getting Started
Online Version
Visit https://groqchat-three.vercel.app/ to use Groq Chat online.
Local Setup
To run Groq Chat locally:
-
Clone the repository:
git clone https://github.com/yourusername/groq-chat.git cd groq-chat -
Install dependencies:
npm install -
Run the development server:
npm run dev -
Open http://localhost:3000 in your browser.
๐ง Usage
- Enter your Groq API key when prompted.
- Start chatting with the language model of your choice.
- Use the URL attachment feature to add context from web pages.
- Utilize speech-to-text for voice interactions.
- Edit, branch, save, or delete conversations as needed.
๐ ๏ธ Tech Stack
- Next.js
- Vercel for deployment
- IndexedDB for local storage
- Groq API for language model inference
๐ Upcoming Features
- Multi-modality support (when available from Groq)
- Custom JavaScript macros for enhanced functionality
- File attachment support (PDF, documents)
- Auto-formatting options
๐ค Contributing
This is an open-source project. Contributions, issues, and feature requests are welcome!
๐ License
๐ Acknowledgements
- Groq for their incredible LPU technology
- Meta for the LLAMA 3.1 series models
- Vercel for their excellent hosting and deployment services
Built with โค๏ธ by Unclecode (Follow me on X).
