Uploading GGUF Models to GCP

[KickItLikeShika]

are GGUF optimized models supported?

[nlathia]

Is this using huggingface @KickItLikeShika?

It's tricky to keep modelstore fully up to date with HF, but one straightforward alternative you can have is to save the file and use modelstore to save the file:
https://modelstore.readthedocs.io/en/latest/concepts/libraries.html#what-to-do-if-a-library-is-not-supported

[KickItLikeShika]

Nope, it's using llama.cpp, but GGUF formats are supported in HF
thanks for dropping the link, will give it a look

[nlathia]

Thanks! Let me know how it works out for you @KickItLikeShika. Perhaps you could consider contributing to the library as well?

https://github.com/operatorai/modelstore/blob/main/modelstore/models/CONTRIBUTING.md