Skip to content

KV cache quantized to q8_0#2969

Closed
JohannesGaessler wants to merge 1 commit intoggml-org:masterfrom
JohannesGaessler:kv-q8_0
Closed

KV cache quantized to q8_0#2969
JohannesGaessler wants to merge 1 commit intoggml-org:masterfrom
JohannesGaessler:kv-q8_0

Commits

Commits on Sep 18, 2023