Skip to content

Displays an animated progress bar below the chat input field that shows how much of the available context window is filled.

License

Notifications You must be signed in to change notification settings

mamei16/context-progress-bar-text-generation-webui

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Context Progress Bar for text-generation-webui

Displays an animated progress bar below the chat input field that shows how much of the available context window is filled.

image

Right now, only the llama.cpp, llamacpp_HF, ExLlamav2 and ExLlamav2_HF model loaders are supported.

The new llama.cpp loader is only supported for older versions of text-generation-webui (<= v3.4.1) or newer versions if llama-cpp-binaries <= v0.14.0 is installed. You then need to activate metrics for the llama server. To do this, put the word metrics into the "extra-flags" field of the "Model" tab. Alternatively, add the command line flag --extra-flags metrics when starting the web UI or add it to the file text-generation-webui/user_data/CMD_FLAGS.txt.

About

Displays an animated progress bar below the chat input field that shows how much of the available context window is filled.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published