Hacker News
Huawei releases MACaQ, its internal quantizer for local inference
135 points by thefox96
ago
|
33 comments
lukasc-ch
|next
[-]
People are reproducing it and creating GGUFs https://www.reddit.com/r/LocalLLaMA/s/36atJ2nNjh
Rabbit504030201
|next
|previous
[-]
https://huawei-csl.com/blog/macaq/
Why does some HN users seem to prefer GitHub page whenever available at expense of official site? I mean, Huawei is still sanctioned, anything they host third party outside China can disappear at any hour.
nout
|root
|parent
|next
[-]
I prefer GitHub, because I can see the code and immediately know where to click. Product pages are always full of various marketing shots, videos, etc that just takes more time to parse through.
gt0
|root
|parent
|next
[-]
This is pretty much the reason that if I read about a new product, I generally just go to the Wikipedia page. I just want the no-bullshit version, no "Say hello to blah" video or marketing word salad.
andsoitis
|root
|parent
|previous
[-]
In this particular case I think you'd be pleased with it https://huawei-csl.com/blog/macaq/
It is from their lab in Switzerland, after all.
Schlagbohrer
|next
|previous
[-]
The top 3 repos sorted by stars on Huawei's github page are all for quantization. I am not an LLM scientist so I can't tell what the difference is between them, or why they need three different pipelines for model quantization.
utternerd
|previous
[-]
[flagged]
QuantumNomad_
|root
|parent
|next
[-]
Probably intended to reference macaque monkeys.
keyle
|root
|parent
|next
[-]
I forgot my French, but isn't it incredibly rude?
PorciiVorbesc
|root
|parent
|next
[-]
Why?