Add distill-json and semantic-llm-cache to Development/Tools#142
Add distill-json and semantic-llm-cache to Development/Tools#142karthyick wants to merge 1 commit into
Conversation
Two Python tools for reducing OpenAI API costs: token compression and semantic response caching.
There was a problem hiding this comment.
Code Review
This pull request adds two new tools, distill-json and semantic-llm-cache, to the README.md file. The review feedback highlights the need to update the Chinese version of the documentation for consistency and suggests removing the pip install commands from the tool descriptions to match the existing style of the list.
|
|
||
| Calculate how much it will cost to generate certain number of words by using OpenAI GPT-3.5 API. | ||
|
|
||
| - [distill-json](https://github.com/karthyick/DISTILL) |
|
|
||
| - [distill-json](https://github.com/karthyick/DISTILL) | ||
|
|
||
| Lossless JSON compression for ChatGPT/OpenAI API payloads. Reduces tokens 60-85% on bulk repeated records via schema extraction, dictionary encoding, and equivalence partitioning. Drop-in replacement for `json.dumps()` — output stays human-and-LLM-readable. `pip install distill-json`. |
There was a problem hiding this comment.
The inclusion of pip install commands in the description is inconsistent with other entries in this section. Most items focus on the tool's utility and leave installation details to the linked repository.
| Lossless JSON compression for ChatGPT/OpenAI API payloads. Reduces tokens 60-85% on bulk repeated records via schema extraction, dictionary encoding, and equivalence partitioning. Drop-in replacement for `json.dumps()` — output stays human-and-LLM-readable. `pip install distill-json`. | |
| Lossless JSON compression for ChatGPT/OpenAI API payloads. Reduces tokens 60-85% on bulk repeated records via schema extraction, dictionary encoding, and equivalence partitioning. Drop-in replacement for `json.dumps()` — output stays human-and-LLM-readable. |
|
|
||
| - [semantic-llm-cache](https://github.com/karthyick/prompt-cache) | ||
|
|
||
| Decorator-based semantic caching for ChatGPT/OpenAI API calls. Wrap any LLM call with `@semantic_cache` and skip 20-40% of API calls when prompts are semantically similar. Lightweight Python alternative to GPTCache. `pip install semantic-llm-cache`. |
There was a problem hiding this comment.
Similar to the entry above, the pip install command should be removed to maintain consistency with the rest of the list.
| Decorator-based semantic caching for ChatGPT/OpenAI API calls. Wrap any LLM call with `@semantic_cache` and skip 20-40% of API calls when prompts are semantically similar. Lightweight Python alternative to GPTCache. `pip install semantic-llm-cache`. | |
| Decorator-based semantic caching for ChatGPT/OpenAI API calls. Wrap any LLM call with `@semantic_cache` and skip 20-40% of API calls when prompts are semantically similar. Lightweight Python alternative to GPTCache. |
Adding two Python tools to Development → Tools that reduce OpenAI API costs:
distill-json
Lossless JSON compression for ChatGPT/OpenAI API payloads. Reduces tokens 60-85% on bulk repeated records via schema extraction, dictionary encoding, and equivalence partitioning. Drop-in replacement for
json.dumps().semantic-llm-cache
Decorator-based semantic caching for OpenAI API calls. Skip 20-40% of API calls when prompts are semantically similar. Lightweight Python alternative to GPTCache (which is already in this section).
Both:
pip install distill-json/pip install semantic-llm-cacheThanks for maintaining this list!