You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
server : add single-client multi-prompt support (ggml-org#4232)
* * add multiprompt support
* * cleanup
* * more cleanup
* * remove atomicity of id_gen, and change lock_guard to unique_lock on completion requests
* * remove all references to mutex_multitasks
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <[email protected]>
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <[email protected]>
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <[email protected]>
* Update examples/server/server.cpp
Co-authored-by: Jared Van Bortel <[email protected]>
* * change to set
0 commit comments