Tools
Powerful How To Compress Your Prompts And Reduce Llm costs
The LLMLingua project compresses prompts before sending them to a model, keeping only the most important information. The result is faster responses, smaller bills, and an easier path to scaling LLMs.
Source: HackerNoon
