<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Huawei open sourced model-agnostic quantization for GGUFs]]></title><description><![CDATA[<em>This post did not contain any content.</em>

<div class="row mt-3"><div class="card col-md-9 col-lg-6 position-relative link-preview p-0">



<a href="https://github.com/huawei-csl/MACaQ" title="GitHub - huawei-csl/MACaQ: SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.">
<img src="https://repository-images.githubusercontent.com/1452417816/74bc9106-306c-4e93-96da-77dcff2e0d77" class="card-img-top not-responsive" style="max-height: 15rem;" alt="Link Preview Image" onerror="this.parentElement.remove()" />
</a>



<div class="card-body">
<h5 class="card-title">
<a class="text-decoration-none" href="https://github.com/huawei-csl/MACaQ">
GitHub - huawei-csl/MACaQ: SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.
</a>
</h5>
<p class="card-text line-clamp-3">SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch. - huawei-csl/MACaQ</p>
</div>
<a href="https://github.com/huawei-csl/MACaQ" class="card-footer text-body-secondary small d-flex gap-2 align-items-center lh-2">



<img src="https://github.githubassets.com/favicons/favicon.svg" alt="favicon" class="not-responsive overflow-hiddden" style="max-width: 21px; max-height: 21px;" onerror="this.remove()"/>



<p class="d-inline-block text-truncate mb-0">GitHub <span class="text-secondary">(github.com)</span></p>
</a>
</div></div>]]></description><link>https://citiverse.it/topic/44f4626b-f2a5-4cd2-8907-fedc4b3856e9/huawei-open-sourced-model-agnostic-quantization-for-ggufs</link><generator>RSS for Node</generator><lastBuildDate>Fri, 20 Nov 2026 23:19:04 GMT</lastBuildDate><atom:link href="https://citiverse.it/topic/44f4626b-f2a5-4cd2-8907-fedc4b3856e9.rss" rel="self" type="application/rss+xml"/><pubDate>Wed, 11 Nov 2026 20:59:28 GMT</pubDate><ttl>60</ttl><item><title><![CDATA[Reply to Huawei open sourced model-agnostic quantization for GGUFs on Thu, 12 Nov 2026 21:14:17 GMT]]></title><description><![CDATA[<p dir="auto">that's very sensible, there's only so much time in a day, and it's best to spend it on things you actually enjoy <img src="https://citiverse.it/assets/plugins/nodebb-plugin-emoji/emoji/android/1f642.png?v=b870d38dd46" class="not-responsive emoji emoji-android emoji--slightly_smiling_face" style="height:1.4em;width:auto;vertical-align:middle" title=":)" alt="🙂" /></p>
]]></description><link>https://citiverse.it/post/https://lemmy.ml/comment/28975125</link><guid isPermaLink="true">https://citiverse.it/post/https://lemmy.ml/comment/28975125</guid><dc:creator><![CDATA[yogthos@lemmy.ml]]></dc:creator><pubDate>Thu, 12 Nov 2026 21:14:17 GMT</pubDate></item><item><title><![CDATA[Reply to Huawei open sourced model-agnostic quantization for GGUFs on Thu, 12 Nov 2026 20:32:05 GMT]]></title><description><![CDATA[<p dir="auto">yes, it is all truly different and i guess i fell out of love with it since i started my software development chapter of my life with machine learning -- it still is neat to hear about it, but i guess it doesn't have the same attraction for me that it used to have back in 2015 to make me want to stay up to date.</p>
]]></description><link>https://citiverse.it/post/https://lemmy.ml/comment/28974260</link><guid isPermaLink="true">https://citiverse.it/post/https://lemmy.ml/comment/28974260</guid><dc:creator><![CDATA[eldavi@lemmy.ml]]></dc:creator><pubDate>Thu, 12 Nov 2026 20:32:05 GMT</pubDate></item><item><title><![CDATA[Reply to Huawei open sourced model-agnostic quantization for GGUFs on Thu, 12 Nov 2026 19:10:20 GMT]]></title><description><![CDATA[<p dir="auto">I'm having a lot of fun with this stuff because it's something that's genuinely new and different from anything I've done before. I've been doing software development for over two decades now, and it's kind of become routine. Most software projects are just remixes of other projects you've done before, and all the excitement I had when I got into programming has mostly dissipated. But LLMs are something that's just so different, and nobody really knows how to use them effectively yet. Their capabilities keep improving all the time. And there's so much room to discover things that nobody else has tried before.</p>
]]></description><link>https://citiverse.it/post/https://lemmy.ml/comment/28972690</link><guid isPermaLink="true">https://citiverse.it/post/https://lemmy.ml/comment/28972690</guid><dc:creator><![CDATA[yogthos@lemmy.ml]]></dc:creator><pubDate>Thu, 12 Nov 2026 19:10:20 GMT</pubDate></item><item><title><![CDATA[Reply to Huawei open sourced model-agnostic quantization for GGUFs on Thu, 12 Nov 2026 18:57:52 GMT]]></title><description><![CDATA[<p dir="auto">sometime i'm glad i'm not a software engineer anymore -- there's so much new stuff out there and it's clear that i've started falling behind for this and every other arena in life like my parents and grandparents were.</p>
]]></description><link>https://citiverse.it/post/https://lemmy.ml/comment/28972478</link><guid isPermaLink="true">https://citiverse.it/post/https://lemmy.ml/comment/28972478</guid><dc:creator><![CDATA[eldavi@lemmy.ml]]></dc:creator><pubDate>Thu, 12 Nov 2026 18:57:52 GMT</pubDate></item><item><title><![CDATA[Reply to Huawei open sourced model-agnostic quantization for GGUFs on Wed, 11 Nov 2026 23:35:52 GMT]]></title><description><![CDATA[<p dir="auto">seems like any GGUF</p>
]]></description><link>https://citiverse.it/post/https://lemmy.ml/comment/28952379</link><guid isPermaLink="true">https://citiverse.it/post/https://lemmy.ml/comment/28952379</guid><dc:creator><![CDATA[yogthos@lemmy.ml]]></dc:creator><pubDate>Wed, 11 Nov 2026 23:35:52 GMT</pubDate></item><item><title><![CDATA[Reply to Huawei open sourced model-agnostic quantization for GGUFs on Wed, 11 Nov 2026 22:57:04 GMT]]></title><description><![CDATA[<p dir="auto">Is this LLM specific or for all models?</p>
]]></description><link>https://citiverse.it/post/https://lemmy.ml/comment/28951634</link><guid isPermaLink="true">https://citiverse.it/post/https://lemmy.ml/comment/28951634</guid><dc:creator><![CDATA[geneva_convenience@lemmy.ml]]></dc:creator><pubDate>Wed, 11 Nov 2026 22:57:04 GMT</pubDate></item></channel></rss>