Search results

ggml : refactor ggml-cpu.c into multiple C++ source files

refactoringRefactoringRefactoring

roadmapPart of a roadmap projectPart of a roadmap project

Status: Open.

#10180 In ggml-org/llama.cpp;

· ggerganov opened on Nov 5, 2024

imatrix : use GGUF to store importance matrices

breaking changeChanges that break ABIs, APIs, file formats, or other forms of backwards compatibility.Changes that break ABIs, APIs, file formats, or other forms of backwards compatibility.

enhancementNew feature or requestNew feature or request

examples

pythonpython script changespython script changes

refactoringRefactoringRefactoring

Review Complexity : MediumGenerally require more time to grok but manageable by beginner to medium expertise levelGenerally require more time to grok but manageable by beginner to medium expertise level

Status: Draft (not ready).

ggml-org/llama.cppnumber 9400

#9400 In ggml-org/llama.cpp;

· compilade opened on Sep 10, 2024

Refactor: Add more typechecking to GGUFWriter.add_key_value

help wantedExtra attention is neededExtra attention is needed

refactoringRefactoringRefactoring

Status: Open.

#9095 In ggml-org/llama.cpp;

· mofosyne opened on Aug 19, 2024

Refactor: Existing examples refactoring opportunities

help wantedExtra attention is neededExtra attention is needed

refactoringRefactoringRefactoring

Status: Open.

#7559 In ggml-org/llama.cpp;

· mofosyne opened on May 27, 2024

llama : support Jamba hybrid Transformer-Mamba models

androidIssues specific to AndroidIssues specific to Android

embeddingsembedding related topicsembedding related topics

enhancementNew feature or requestNew feature or request

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

modelModel specificModel specific

need feedbackTesting and feedback with results are neededTesting and feedback with results are needed

pythonpython script changespython script changes

refactoringRefactoringRefactoring

Review Complexity : HighGenerally require indepth knowledge of LLMs or GPUsGenerally require indepth knowledge of LLMs or GPUs

server

Status: Draft (not ready).

ggml-org/llama.cppnumber 7531

#7531 In ggml-org/llama.cpp;

· compilade opened on May 25, 2024

common, ngram_cache: added const reference for std::pair<> and std::tuple<> more 16 bytes:

refactoringRefactoringRefactoring

Review Complexity : LowTrivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fixTrivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix

Status: Open (in progress).

ggml-org/llama.cppnumber 7270

#7270 In ggml-org/llama.cpp;

· GermanAizek opened on May 14, 2024

ggml, ngram-cache, log: added const and const ref for function params

refactoringRefactoringRefactoring

Review Complexity : MediumGenerally require more time to grok but manageable by beginner to medium expertise levelGenerally require more time to grok but manageable by beginner to medium expertise level

Status: Open (in progress).

ggml-org/llama.cppnumber 7269

#7269 In ggml-org/llama.cpp;

· GermanAizek opened on May 14, 2024

tokenization: no double BOS tokens

refactoringRefactoringRefactoring

Review Complexity : MediumGenerally require more time to grok but manageable by beginner to medium expertise levelGenerally require more time to grok but manageable by beginner to medium expertise level

Status: Open (in progress).

ggml-org/llama.cppnumber 7107

#7107 In ggml-org/llama.cpp;

· JohannesGaessler opened on May 6, 2024

ggml : unified CMake build

buildCompilation issuesCompilation issues

enhancementNew feature or requestNew feature or request

refactoringRefactoringRefactoring

roadmapPart of a roadmap projectPart of a roadmap project

Status: Open.

#6913 In ggml-org/llama.cpp;

· ggerganov opened on Apr 25, 2024

Refactor chat template API

demoDemonstrate some concept or idea, not intended to be mergedDemonstrate some concept or idea, not intended to be merged

refactoringRefactoringRefactoring

Review Complexity : MediumGenerally require more time to grok but manageable by beginner to medium expertise levelGenerally require more time to grok but manageable by beginner to medium expertise level

Status: Draft (not ready).

ggml-org/llama.cppnumber 6822

#6822 In ggml-org/llama.cpp;

· ngxson opened on Apr 22, 2024

llama : switch to floating-point token positions

demoDemonstrate some concept or idea, not intended to be mergedDemonstrate some concept or idea, not intended to be merged

refactoringRefactoringRefactoring

Review Complexity : HighGenerally require indepth knowledge of LLMs or GPUsGenerally require indepth knowledge of LLMs or GPUs

Status: Draft (not ready).

ggml-org/llama.cppnumber 5679

#5679 In ggml-org/llama.cpp;

· ggerganov opened on Feb 23, 2024

P-Step Truncation Sampling

generation qualityQuality of model outputQuality of model output

need feedbackTesting and feedback with results are neededTesting and feedback with results are needed

refactoringRefactoringRefactoring

Review Complexity : HighGenerally require indepth knowledge of LLMs or GPUsGenerally require indepth knowledge of LLMs or GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 5675

#5675 In ggml-org/llama.cpp;

· p-e-w opened on Feb 23, 2024