#

ngram-decoding

Here is 1 public repository matching this topic...

wtlow003 / ngram-decoding

(Re)-implementation of "Prompt Lookup Decoding" by Apoorv Saxena, with extended ideas from LLMA Decoding.

n-gram llm-inference speculative-decoding prompt-lookup-decoding ngram-decoding

Updated Aug 20, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the ngram-decoding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the ngram-decoding topic, visit your repo's landing page and select "manage topics."