<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[42x Faster Prompt Lookup Drafting in llama.cpp]]></title><description><![CDATA[<em>This post did not contain any content.</em>

<div class="row mt-3"><div class="card col-md-9 col-lg-6 position-relative link-preview p-0">



<a href="https://jadidbourbaki.github.io/blog/prompt-lookup-llama-cpp/" title="42x Faster Prompt Lookup Drafting in llama.cpp">
<img src="https://jadidbourbaki.github.io/blog/prompt-lookup-llama-cpp/preview.png" class="card-img-top not-responsive" style="max-height: 15rem;" alt="Link Preview Image" onerror="this.parentElement.remove()" />
</a>



<div class="card-body">
<h5 class="card-title">
<a class="text-decoration-none" href="https://jadidbourbaki.github.io/blog/prompt-lookup-llama-cpp/">
42x Faster Prompt Lookup Drafting in llama.cpp
</a>
</h5>
<p class="card-text line-clamp-3">Four changes to the n-gram caches of llama.cpp make drafting for prompt lookup decoding up to 41.6x faster per drafted token, load the static cache up to 23.5x faster, and lower peak memory up to 2.65x.</p>
</div>
<a href="https://jadidbourbaki.github.io/blog/prompt-lookup-llama-cpp/" class="card-footer text-body-secondary small d-flex gap-2 align-items-center lh-2">



<img src="https://jadidbourbaki.github.io/favicon.ico" alt="favicon" class="not-responsive overflow-hiddden" style="max-width: 21px; max-height: 21px;" onerror="this.remove()"/>



<p class="d-inline-block text-truncate mb-0"> <span class="text-secondary">(jadidbourbaki.github.io)</span></p>
</a>
</div></div>]]></description><link>https://citiverse.it/topic/bea02c16-760d-4e01-9121-cc05faa20ee9/42x-faster-prompt-lookup-drafting-in-llama.cpp</link><generator>RSS for Node</generator><lastBuildDate>Thu, 01 Oct 2026 20:12:14 GMT</lastBuildDate><atom:link href="https://citiverse.it/topic/bea02c16-760d-4e01-9121-cc05faa20ee9.rss" rel="self" type="application/rss+xml"/><pubDate>Sun, 27 Sep 2026 12:55:50 GMT</pubDate><ttl>60</ttl></channel></rss>