LLMQL -- A language for constraint-guided and efficient LLM programming

Programmatic prompting with constrained LLM output. Open Souce.

"LMQL is a programming language for large language models (LLMs) based on a superset of Python. LMQL offers a novel way of interweaving traditional programming with the ability to call LLMs in your code. It goes beyond traditional templating languages by integrating LLM interaction natively at the level of your program code."

https://github.com/eth-sri/lmql

2 comments