Skip to content

Commit

Permalink
typo
Browse files Browse the repository at this point in the history
  • Loading branch information
parkervg committed Sep 1, 2024
1 parent 7f471a9 commit b6a78eb
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,9 @@ When using local Transformer models, we can efficiently backtrack the KV cache a
pip install grammar-guide
```
## Examples
- [With Anthropic](./examples/anthropic-gg.ipynb)
- [With OpenAI](./examples/openai-gg.ipynb)
- [With Transformers](./examples/transformers-gg.ipynb)

### With Transformer Models
When using HuggingFace Transformer models, we get an extra speed boost by leveraging efficient caching and backtracking of the KV cache. When a grammar correction is made, we backtrack to the state of the KV cache aligned to the longest prefix that is valid under our Lark context-free grammar.
Expand Down

0 comments on commit b6a78eb

Please sign in to comment.