Skip to content

Commit 8f26a66

Browse files
committed
server : add single-client multi-prompt support (ggml-org#4232)
* * add multiprompt support * * cleanup * * more cleanup * * remove atomicity of id_gen, and change lock_guard to unique_lock on completion requests * * remove all references to mutex_multitasks * Update examples/server/server.cpp Co-authored-by: Jared Van Bortel <[email protected]> * Update examples/server/server.cpp Co-authored-by: Jared Van Bortel <[email protected]> * Update examples/server/server.cpp Co-authored-by: Jared Van Bortel <[email protected]> * Update examples/server/server.cpp Co-authored-by: Jared Van Bortel <[email protected]> * * change to set
1 parent 323e29a commit 8f26a66

File tree

0 file changed

+0
-0
lines changed

    0 file changed

    +0
    -0
    lines changed

    0 commit comments

    Comments
     (0)