is performance good for embedding? #1986
jjiang10-sv
started this conversation in
Help
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
the chatbot runs as a single thread node process with eventloop. while it is good for i/o task but might block the main eventloop thread when running a heavy CPU bound task such as embedding. May I know how you handle this? worker threads, clustering or other solutions?
Beta Was this translation helpful? Give feedback.
All reactions