By unverified author Claim this AI

LMQL is a query language designed specifically for large language models (LLMs). It combines the natural language prompts with the expressiveness of Python to facilitate the interaction with LLMs.

The tool provides various features such as constraints, debugging, retrieval, control flow, and support for 🤗 Transformers, which make it easier to prompt responses from the LLM.

LMQL offers a broad range of pre-built prompts for tasks such as telling a joke, generating a packing list, searching Wikipedia, and chatting with a bot.

In addition to providing high-level constraints, LMQL also allows users to control the generation process programmatically by supporting regular Python control flow statements.

The tool generates the required tokens automatically and validates the produced sequence as soon as the provided validation condition is definitively violated.LMQL also supports arbitrary Python code in the prompt clause, enabling dynamic prompts and text processing.

The Scripted Beam Search feature decodes the expert name and answer jointly, exploring multiple possible answers. LMQL supports Python's assert to check the correctness of the generated output, which can be useful for evaluating data sets.

Overall, LMQL is a powerful tool that simplifies the interaction with LLMs and enables Python developers to work with natural language prompts more efficiently.

Releases

Get notified when a new version of Lmql is released

Notify me

Initial release

April 5, 2023

Initial release of Lmql.

+ Submit new release

Pricing

Pricing model

Free

Paid options from

Free

Use tool

Save

🔗 Copy link

🗳️ Vote Best AI Tool

Comments(1)

Rustle

Aug 8, 2023

Rated it

I have used this for several personal assistant applications and it works amazingly. Obviously it is still restricted to the flaws of any model you are using it with, but the ability to constrain prompts is incredibly helpful (especially when it comes to getting things like JSON format from the AI).

Reply Share Delete Report